[short] An Emulator for Fine-Tuning Large Language Models using Small Language Models

Arxiv Papers
20/10/2023 2 min

Listen "[short] An Emulator for Fine-Tuning Large Language Models using Small Language Models"

Descargar episodio Ver en sitio original

Episode Synopsis

The paper introduces emulated fine-tuning (EFT), a method for combining the knowledge learned by a large language model during pre-training with the knowledge learned by a small model during fine-tuning. EFT allows for test-time adjustment of behavioral traits and improves helpfulness and factuality without additional training.

https://arxiv.org/abs//2310.12962

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

More episodes of the podcast Arxiv Papers

[QA] On the Theoretical Limitations of Embedding-Based Retrieval 01/09/2025
On the Theoretical Limitations of Embedding-Based Retrieval 01/09/2025
[QA] Beyond GPT-5: Making LLMs Cheaper and Better via Performance–Efficiency Optimized Routing 22/08/2025
Beyond GPT-5: Making LLMs Cheaper and Better via Performance–Efficiency Optimized Routing 22/08/2025
[QA] Measuring the environmental impact of delivering AI at Google Scale 22/08/2025
Measuring the environmental impact of delivering AI at Google Scale 22/08/2025
[QA] Deep Think with Confidence 22/08/2025
Deep Think with Confidence 22/08/2025
[QA] Intern-S1: A Scientific     Multimodal Foundation Model   22/08/2025
Intern-S1: A Scientific     Multimodal Foundation Model   22/08/2025
© 2003-2026 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA