This paper proposes a blueprint for LLM-based reasoning systems that integrates visual-temporal rollouts directly into the reasoning trace as inspectable hypotheses. By extending tool-calling into the domain of visual thought experiments, it introduces a novel framework for grounding complex physical and counterfactual reasoning beyond text alone.
Short on time? Watch the video overview of this paper.
Listen on: Spotify · Apple Podcasts · Amazon Music · YouTube
Follow the show: YouTube · Medium · X · LinkedIn · Bluesky · Threads · Instagram · TikTok · Facebook · Telegram