Marc Benioff Predicts Multisensory Models Will Replace Large Language Models as Next AI Wave
"I don't really understand how large language models, which are only about language and words, is going to get us to where we want to go to, which is Minority Report or all the science fiction movies that we've seen. Multisensory models are the next big wave for AI."
About this episode
In episode 273 of the All In Podcast, hosts Jason Calacanis, Chamath Palihapitiya, and David Friedberg were joined by Salesforce CEO Marc Benioff for a wide-ranging discussion covering the Trump-Xi summit, the SaaS market collapse, AI's transformation of enterprise software, and an alarming climate forecast. The episode opened with extensive analysis of Trump's first visit to China since 2017, with the group debating whether economic entanglement can prevent conflict and whether Taiwan remains strategically critical as both nations build domestic semiconductor capacity. Benioff revealed Salesforce is spending $300 million annually on Anthropic's coding agents, claiming unprecedented efficiency gains, while acknowledging the company lost $90 billion in market cap during what he termed the "SaaSpocalypse"—a massive rerating of enterprise software stocks now trading at historic lows around 2x sales. The conversation turned to breaking news that OpenAI is considering suing Apple over their failed ChatGPT integration, which produced far less revenue than expected. Benioff argued that multisensory AI models combining vision, audio, and real-time monitoring will replace pure language models as the next wave, citing Mira Murati's recent demonstration. Chamath predicted the low-end SaaS market is finished while high-end enterprise software with deep customer relationships will consolidate and rally. Friedberg delivered a sobering Science Corner warning that record ocean temperatures are forecasting a Super El Niño that could cause crop failures affecting over a billion people in India, Brazil, and Australia, potentially triggering food shortages and geopolitical unrest. The episode concluded with Benioff praising Anthropic's crackdown on layered SPV structures and sharing an emotional remembrance of late YouTube CEO Susan Wojcicki.
Key takeaways
- Benioff revealed Salesforce is spending $300 million on Anthropic coding agents annually, claiming unprecedented efficiency never before possible in software development.
- Friedberg warned a Super El Niño with record ocean temperatures could trigger crop failures in Brazil, India, and Australia affecting over 1.5 billion people and causing geopolitical unrest.
- Breaking news emerged that OpenAI is exploring legal action against Apple after their ChatGPT Siri integration failed to produce expected billions in subscription revenue.
- Chamath declared the low-end SaaS market is finished while predicting high-end enterprise software with C-suite relationships will consolidate and see valuations recover.
- Benioff argued multisensory AI models integrating vision and audio will replace large language models as the next major wave after current LLM limitations.
- The group debated whether Taiwan remains strategically important as both the US and China build domestic semiconductor manufacturing capacity reducing TSMC dependence.
- Anthropic announced it is invalidating layered SPV structures, which Chamath praised as necessary to force companies public and prevent future investor lawsuits.