Unmasking the Lottery Ticket Hypothesis

Byte Sized Breakthroughs
09/08/2024
Unmasking the Lottery Ticket Hypothesis

Listen "Unmasking the Lottery Ticket Hypothesis"

Descargar episodio Ver en sitio original

Episode Synopsis


The research paper delves into the detailed workings of Iterative Magnitude Pruning (IMP) in deep learning, exploring the 'why' and 'how' of its success in finding sparse subnetworks within larger neural networks.

The key takeaways for engineers/specialists include understanding the role of the pruning mask in guiding training, the importance of SGD robustness in navigating the error landscape, and the relationship between the Hessian eigenspectrum and the maximum pruning ratio for efficient network pruning.

Read full paper: https://arxiv.org/abs/2210.03044

Tags: Deep Learning, Neural Networks, Network Pruning, Machine Learning

More episodes of the podcast Byte Sized Breakthroughs

TransAct Transformer-based Realtime User Action Model for Recommendation at Pinterest 08/07/2024
Zero Bubble Pipeline Parallelism 08/07/2024
The limits to learning a diffusion model 08/07/2024
A Better Match for Drivers and Riders Reinforcement Learning at Lyft 08/07/2024
AutoEmb Automated Embedding Dimensionality Searchg in Streaming Recommendations 08/07/2024
NeuralProphet Explainable Forecasting at Scale 08/07/2024
No-Transaction Band Network A Neural Network Architecture for Efficient Deep Hedging 08/07/2024
ZeRO Memory Optimizations: Toward Training Trillion Parameter Models 08/07/2024
DriveVLM: Vision-Language Models for Autonomous Driving in Urban Environments 18/07/2024
Robustness Evaluation of HD Map Constructors under Sensor Corruptions for Autonomous Driving 18/07/2024
© 2003-2025 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA