Listen "Trapped Priors As A Basic Problem Of Rationality"
Episode Synopsis
https://astralcodexten.substack.com/p/trapped-priors-as-a-basic-problem Introduction and review Last month I talked about van der Bergh et al's work on the precision of sensory evidence, which introduced the idea of a trapped prior. I think this concept has far-reaching implications for the rationalist project as a whole. I want to re-derive it, explain it more intuitively, then talk about why it might be relevant for things like intellectual, political and religious biases. To review: the brain combines raw experience (eg sensations, memories) with context (eg priors, expectations, other related sensations and memories) to produce perceptions. You don't notice this process; you are only able to consciously register the final perception, which feels exactly like raw experience. A typical optical illusion. The top chess set and the bottom chess set are the same color (grayish). But the top appears white and the bottom black because of the context (darker vs. lighter background). You perceive not the raw experience (grayish color) but the final perception modulated by context; to your conscious mind, it just seems like a brute fact that the top is white and the bottom black, and it is hard to convince yourself otherwise. Or: maybe you feel like you are using a particular context independent channel (eg hearing). Unbeknownst to you, the information in that channel is being context-modulated by the inputs of a different channel (eg vision). You don't feel like "this is what I'm hearing, but my vision tells me differently, so I'll compromise". You feel like "this is exactly what I heard, with my ears, in a way vision didn't affect at all".
More episodes of the podcast Astral Codex Ten Podcast
Highlights From The Comments On Vibecession
10/01/2026
ACX/Metaculus Prediction Contest 2026
10/01/2026
Against Against Boomers
10/01/2026
The Pledge
10/01/2026
Links For December 2025
06/01/2026
The New AI Consciousness Paper
02/12/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.