Local Synaptic Rules Can Implement SIGReg Gradient Without Backpropagation
A new study has found that two local learning mechanisms in the brain—specifically spike-timing-dependent plasticity (STDP⁺) and homeostatic plasticity via flashlight granule-cell-like neurons—can effectively mimic a SIGReg-like self-supervised learning goal without using backpropagation. This method does away with the need for gradient calculations, global error signals, weight transport, or any labeling, focusing instead on the firing rates before and after synapses, local firing statistics, and the timing of natural sensory inputs. In a clustering test, an organized input sequence boosted cluster separation to 2.49, while random input kept it at 0.83, resulting in nearly a threefold increase just from the order of inputs. A two-layer network also showed similar results with ordered MNIST data, suggesting that biological neural circuits might achieve complex learning through local rules, offering a potential alternative to backpropagation in neuromorphic computing.
Key facts
- Two local synaptic rules (STDP⁺ and homeostatic plasticity) implement exact gradient of SIGReg-like objective.
- No gradient calculations, global error signals, weight transport, or labels required.
- Inputs: pre- and post-synaptic firing rates, local statistics, temporal contiguity.
- Synthetic clustering task: ordered presentation CSR=2.49, random CSR=0.83 (≈3.5σ separation).
- Temporally ordered MNIST: two-layer network shows similar performance.
- Study published on arXiv (2607.21622v1).
- Implications for biological learning and neuromorphic computing.
Entities
Institutions
- arXiv