Test-Time Training with KV Binding Is Secretly Linear Attention

Junchen Liu1,2,3* Sven Elflein1,2,3 Or Litany1,4 Zan Gojcic1 Ruilong Li1*
1 NVIDIA 2 University of Toronto 3 Vector Institute 4 Technion

* Equal Contribution

ICML 2026
article Paper code Code

TL;DR Test-time training (TTT) with KV binding is not test-time memorization — it's learned linear attention with enhanced representational capacity. (New to TTT?)