Sparse Goodness: How Selective Measurement Transforms Forward-Forward Learning
📰 ArXiv cs.AI
arXiv:2604.13081v1 Announce Type: cross Abstract: The Forward-Forward (FF) algorithm is a biologically plausible alternative to backpropagation that trains neural networks layer by layer using a local goodness function to distinguish positive from negative data. Since its introduction, sum-of-squares (SoS) has served as the default goodness function. In this work, we systematically study the design space of goodness functions, investigating both which activations to measure and how to aggregate
DeepCamp AI