Glassy dynamics near the interpolation transition in deep recurrent networks
{{output}}
We examine learning dynamics in deep recurrent networks, focusing on the behavior near the boundary in the depth-width plane separating under- from overparametrized networks, known as the interpolation transition. The training data are Bach chorales in four-pa... ...