Uzay Girit
YOU?
Author Swipe
View article: The Quantization Model of Neural Scaling
The Quantization Model of Neural Scaling Open
We propose the Quantization Model of neural scaling laws, explaining both the observed power law dropoff of loss with model and data size, and also the sudden emergence of new capabilities with scale. We derive this model from what we call…