← All episodes
EPISODE 281

Restoring plasticity to over-trained AI

Learning GenAI via SOTA Papers · July 2, 2026 · 22 min

This paper identifies and solves the critical 'loss of plasticity' bottleneck in the standard LLM post-training pipeline where excessive SFT inhibits subsequent RL optimization. It introduces 'Rejuvenation', a foundational training primitive that uses model fusion and neuron resets to enable robust reasoning gains during RL while preserving SFT-acquired knowledge.

Short on time? Watch the video overview of this paper.

Listen on: Spotify · Apple Podcasts · Amazon Music · YouTube

Follow the show: YouTube · Medium · X · LinkedIn · Bluesky · Threads · Instagram · TikTok · Facebook · Telegram