RoboTTT: Giving Robot Policies a Long Memory
Yunfan Jiang, Yevgen Chebotar, Ruijie Zheng, Fengyuan Hu, Yunhao Ge, Jimmy Wu, Tianyuan Dai, Scott Reed, Li Fei-Fei, Yuke Zhu, Linxi "Jim" Fan · July 16, 2026
A new approach called RoboTTT dramatically extends the context window of robot policies from a few steps to 8,000 timesteps—three orders of magnitude larger than current state-of-the-art—without increasing inference latency. This long memory enables robots to learn from a single human video demonstration, adapt on the fly, resist perturbations, and succeed at complex multi-stage tasks like a five-minute, ten-stage assembly that no previous method could complete. The key innovation is integrating Test-Time Training into robot foundation models: the robot continuously updates its own parameters via gradient descent during both training and inference, compressing past experiences into its weights and retrieving them as needed. This turns the robot's internal state into a kind of fast-weight memory. The authors also show that longer pretraining context directly improves closed-loop performance, suggesting context length as a new scaling axis for robot AI. In real-world manipulation tests, RoboTTT outperformed single-step baselines by 87% and the 8K-context version beat the 1K version by 62%. This work points toward robots that can learn and adapt in real time from human demonstrations, potentially reducing the need for massive training data and enabling more flexible automation in manufacturing, healthcare, and homes.
Read more: arXiv
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.