Inside Hopper: Memory, Tiling, and the Tensor Core Engine

15/10/2025 5 min
Inside Hopper: Memory, Tiling, and the Tensor Core Engine

Listen "Inside Hopper: Memory, Tiling, and the Tensor Core Engine"

Episode Synopsis

A deep dive into NVIDIA's Hopper GPUs and how they reinvent matrix multiplication. We explore the memory hierarchy from GM/HBM to on-chip SMEM, the role of coalescing, tiling, and the Tensor Core, and how TMA, swizzling, and pipelining keep data flowing to the math units—driving the AI accelerations behind modern transformers.Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information. Sponsored by Embersilk LLC