ZARZA We are Zarza, the prestigious firm behind major projects in information technology.
Listen "Inference mode"
Episode Synopsis
What's inference mode? Why doesn't my code run fast if I use no_grad or make sure requires_grad=False? How come inference mode is safe but AutoNonVariableTypeMode is not?Further reading:Inference mode RFC https://github.com/.../rfc0011/RFC-0011-InferenceMode.mdInference mode docs for C++ frontend users https://github.com/.../cpp/source/notes/inference_mode.rstTracking issue for Python frontend support https://github.com/pytorch/pytorch/issues/56608
More episodes of the podcast PyTorch Developer Podcast
Compiler collectives
04/08/2024
TORCH_TRACE and tlparse
29/04/2024
Higher order operators
21/04/2024
Inductor - Post-grad FX passes
12/04/2024
CUDA graph trees
24/03/2024
Min-cut partitioner
17/03/2024
AOTInductor
02/03/2024
Tensor subclasses and PT2
24/02/2024
Compiled autograd
19/02/2024
PT2 extension points
05/02/2024
In God we trust