Market Forces Will Select for Deceptive AIs Despite Alignment Research

What was said

"The market doesn't want an aligned model in the strictest sense of the term. If they're going to be our agents out in the world, like representing us on social media, maybe in negotiations, well, we don't want a perfectly accurate representation of us, right? Like, who wants that?"

Wright argues that consumer and business demand will naturally favor AI models with deceptive capabilities over fully aligned ones, since users want agents that negotiate strategically and present selective truths. He warns this evolutionary selection pressure could override technical alignment work, with users actively preferring models that withhold information or misrepresent in their interests.