Episode 14.20: Polysemantic Encoding

22/07/2025 13 min Episodio 242
Episode 14.20: Polysemantic Encoding

Listen "Episode 14.20: Polysemantic Encoding"

Episode Synopsis

When nodes are involved in multiple encodings, the brain or networks can encode far more concepts but at the expense of being harder or impossible to interpret. Accordingly, there is a trade-off between power and interpretability, even between power and security: how do we know what polysemic neural nets are doing or “thinking”?