AI & Tech
OpenAI and DeepMind previously hired human superforecasters to evaluate major model releases
Cognitive Revolution
AI Superforecasters?!
"OpenAI hired superforecasters to evaluate the GPT-4 release, and then DeepMind hired superforecasters later to look into Gemini. Before there was AI superforecasting, there was still a need for decisions about what to do with these models, how to release them, what policies to have. And so the Frontier Labs did find it in their interest to bring on the superforecasters."
Both OpenAI and DeepMind brought in human superforecasters to assess the implications and release strategies for GPT-4 and Gemini respectively. This reveals frontier labs sought external forecasting expertise for major deployment decisions before AI forecasting capabilities emerged.
From this episode
Cognitive Revolution