Statistical rejection sampling improves preference optimization

Arxiv Papers
14/09/2023 28 min

Listen "Statistical rejection sampling improves preference optimization"

Descargar episodio Ver en sitio original

Episode Synopsis

This paper introduces a new approach called Statistical Rejection Sampling Optimization (RSO) to improve the alignment of language models with human preferences. RSO outperforms existing methods on evaluations from both language models and human raters.

https://arxiv.org/abs//2309.06657

YouTube: https://www.youtube.com/@ArxivPapers

PODCASTS:
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

More episodes of the podcast Arxiv Papers

[QA] On the Theoretical Limitations of Embedding-Based Retrieval 01/09/2025
On the Theoretical Limitations of Embedding-Based Retrieval 01/09/2025
[QA] Beyond GPT-5: Making LLMs Cheaper and Better via Performance–Efficiency Optimized Routing 22/08/2025
Beyond GPT-5: Making LLMs Cheaper and Better via Performance–Efficiency Optimized Routing 22/08/2025
[QA] Measuring the environmental impact of delivering AI at Google Scale 22/08/2025
Measuring the environmental impact of delivering AI at Google Scale 22/08/2025
[QA] Deep Think with Confidence 22/08/2025
Deep Think with Confidence 22/08/2025
[QA] Intern-S1: A Scientific     Multimodal Foundation Model   22/08/2025
Intern-S1: A Scientific     Multimodal Foundation Model   22/08/2025
© 2003-2026 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA