Story
Backprop Alternative: Augmented Lagrangian Predictive Coding
1 report
1 website
1 discussion
Latest report
Overview
Augmented Lagrangian Predictive Coding Training 1000-layer networks without backpropagation We introduce PC-ALM, a local alternative to backpropagation. PC-ALM trains residual MLPs up to 1000 layers, nearly matching backprop's performance despite using only layer-local dynamics. PC-ALM equips each layer with a feedback control dynamical system that distributes and propagates supervision credit thr...
Summary from pub.sakana.ai.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · pub.sakana.ai
Hacker News discussion ↗
Historical count: 8 · 8 saved in sample · Historical sample
Awaiting analysis