Stochastic weight matrix dynamics during learning and Dyson Brownian motion
{{output}}
We demonstrate that the update of weight matrices in learning algorithms can be described in the framework of Dyson Brownian motion, thereby inheriting many features of random matrix theory. We relate the level of stochasticity to the ratio of the learning rat... ...