首页 正文

Glassy dynamics near the interpolation transition in deep recurrent networks

{{output}}
We examine learning dynamics in deep recurrent networks, focusing on the behavior near the boundary in the depth-width plane separating under- from overparametrized networks, known as the interpolation transition. The training data are Bach chorales in four-pa... ...