← All episodes
EPISODE 252

How batch sizes sharpen AI reasoning

Learning GenAI via SOTA Papers · June 17, 2026 · 22 min

This paper establishes foundational quality-aware functional scaling laws that provide the first theoretical closed-form solution for scheduling high-quality data during LLM training. The introduced 'Drop-Stable-Rampup' schedule optimizes training dynamics across noise-limited and signal-limited regimes, yielding significant breakthroughs in mathematical reasoning performance.

Short on time? Watch the video overview of this paper.

Listen on: Spotify · Apple Podcasts · Amazon Music · YouTube

Follow the show: YouTube · Medium · X · LinkedIn · Bluesky · Threads · Instagram · TikTok · Facebook · Telegram