Scaling Model Size Cannot Close Sample Efficiency Gap with Humans

What was said

"If you look at the way the scaling loss equations work, they tell you that the parameter and data terms are added to the loss independently. Even if you increase the number of parameters by infinity, that would only decrease by a factor of 10 the amount of data that you need in order to keep the same loss. Humans are somewhere between thousands to millions of times more sample efficient than these models."

Drawing on Chinchilla scaling law research, the speaker argues that making AI models infinitely larger would only reduce required training data by 10x, far short of the thousands-to-millions-fold efficiency gap between AI and human learning. This technical finding directly contradicts the widespread belief that simply scaling models bigger will achieve human-level learning efficiency.