Effective Learning Rules as Natural Gradient Descent
{{output}}
We establish that a broad class of effective learning rules-those that improve a scalar performance measure over a given time window-can be expressed as natural gradient descent with respect to an appropriately defined metric. Specifically, parameter updates i... ...
