Open Source Models Lag Frontier AI by Only 4 Months Due to Data Distillation

What was said

"Epoch recently reported that open models lag state-of-the-art frontier models by 4 months. I think the reason it is relatively easy for open source and previous laggards to catch up to within months of the frontier is that data is the real driver of progress. And data can be easily distilled from public APIs, whereas hyperparameters and training tricks and architectural optimizations cannot."

According to Epoch research cited by the speaker, open source AI models remain only 4 months behind proprietary frontier models because training data can be reverse-engineered from public APIs. This challenges assumptions about proprietary advantages in AI development and suggests data accessibility, not algorithmic innovation, determines competitive positioning.