dopt.online.amsgrad

Members

Functions

amsgrad

Updater amsgrad(Operation[] outputs, Operation[] wrt, Projection[Operation] projs, Operation alpha = float32([], [0.001f]), Operation beta1 = float32([], [0.9f]), Operation beta2 = float32([], [0.999f]), Operation eps = float32([], [1e-8]))

Creates a delegate that can be used to perform a step using the AMSGrad update rule.

• adam
• amsgrad
• sgd

• Projection
• Updater