The Floating Droid
YOU?
Author Swipe
View article: Inverse Scaling: When Bigger Isn't Better
Inverse Scaling: When Bigger Isn't Better Open
Work on scaling laws has found that large language models (LMs) show predictable improvements to overall loss with increased scale (model size, training data, and compute). Here, we present evidence for the claim that LMs may show inverse …