Encapsulates information about network parameters.
This can be used to keep track of per-parameter loss functions (e.g., weight decay), and also projection functions that can be applied using constrained optimisation methods.
Used for applying loss terms to this parameter (e.g., weight decay)
A projection operation that can enforce some constraint
An "variable" operation.
See Implementation
Encapsulates information about network parameters.
This can be used to keep track of per-parameter loss functions (e.g., weight decay), and also projection functions that can be applied using constrained optimisation methods.