dopt.online.adam

Contains an implementation of ADAM that relies on automatic differentiation

Members

Functions

adam
Updater adam(Operation[] outputs, Operation[] wrt, Projection[Operation] projs, Operation alpha = float32([], [0.001f]), Operation beta1 = float32([], [0.9f]), Operation beta2 = float32([], [0.999f]), Operation eps = float32([], [1e-8]))

Creates a delegate that can be used to perform a step using the ADAM update rule.

Meta

Authors

Henry Gouk