Score Broadcast and Decorrelation Framework for Credit Assignment
A new paper introduces Score Broadcast and Decorrelation (SBD), a framework for broadcast-based credit assignment in differentiable losses. The approach generalizes the Error Broadcast and Decorrelation (EBD) framework, which was limited to mean-squared-error settings. SBD leverages an orthogonality principle between the output score and hidden-layer activations, unifying credit assignment across standard differentiable loss families without requiring weight transport.
Key facts
- SBD is a framework for broadcast-based credit assignment.
- It generalizes the EBD framework beyond MSE.
- The orthogonality principle requires the optimal score to have conditional mean zero.
- The paper is on arXiv with ID 2605.30638.
- Error broadcast is a biologically plausible alternative to backpropagation.
Entities
Institutions
- arXiv