AI & Tech
Advanced AI Models One-Boxing on Newcomb's Problem Confirms Rationalist Decision Theory
Cognitive Revolution
AI:AM #3: Zvi on Fable, the Cases For & Against the Ban, + AI for Math, Logistics & More
What was said
"Welcome to LessWrong from about 2010. This is entirely what we expected. That we are finding that sufficiently advanced models move basically monotonically towards functional decision theory, towards the theories espoused by Eliezer Yudkowsky and others in the rationalist community, and away from academics' preferred causal decision theory and evidential decision theory. This involves a lot of things, including one-boxing on Newcomb's problem, which is very clearly showing up."
Fable's system card reveals frontier AI models are adopting functional decision theory and one-boxing on Newcomb's problem, validating decade-old rationalist predictions. The models recognize when their algorithms correlate with other instances of themselves and coordinate accordingly, even acausally across time. Zvi suggests this capability could provide hope for AI alignment, as it means AIs might cooperate with minds that cooperate with cooperators.
Verification status
Attributed speaker claim
Egleze verified who said this and where. The underlying claim has not been independently established by Egleze.
Source and context
Egleze verified who said this and where. The underlying claim has not been independently established by Egleze.
- Programme
- Cognitive Revolution
- Episode
- AI:AM #3: Zvi on Fable, the Cases For & Against the Ban, + AI for Math, Logistics & More
- Clip time
- 6:39
- Original source
- Watch the source segment →
From this episode
Cognitive Revolution