EgoGazeLite: On-Device Egocentric Gaze Prediction for Token-Efficient Multimodal LLM Video Input
This research presents a method for highly efficient, on-device processing of multimodal video input for large language models, leveraging egocentric gaze prediction. It offers a significant efficiency breakthrough by making multimodal inputs more token-efficient, enabling practical real-time perception for GenAI and AI agents.
Short on time? Watch the video overview of this paper.
Listen on: Spotify · Apple Podcasts · Amazon Music · YouTube
Follow the show: YouTube · Medium · X · LinkedIn · Bluesky · Threads · Instagram · TikTok · Facebook · Telegram