OpenAI and DeepMind previously hired human superforecasters to evaluate major model releases

What was said

"OpenAI hired superforecasters to evaluate the GPT-4 release, and then DeepMind hired superforecasters later to look into Gemini. Before there was AI superforecasting, there was still a need for decisions about what to do with these models, how to release them, what policies to have. And so the Frontier Labs did find it in their interest to bring on the superforecasters."

Both OpenAI and DeepMind brought in human superforecasters to assess the implications and release strategies for GPT-4 and Gemini respectively. This reveals frontier labs sought external forecasting expertise for major deployment decisions before AI forecasting capabilities emerged.