Latent Action Models are important to scale world models quickly and cheaply... but they need a careful design to fight the spurious correlations present in your data! Checkout @hazel_heejeong 's latest paper to learn more!
Hazel Nam (@hazel_heejeong)
Can a Latent Action Model really know what the “action” is?
In Super Mario, Mario 👨🦰 moves but so do 🍄, ☁️,🌳, and the view🎥.
TL;DR: under agent ambiguity, don’t force LAMs to find the true action directly. We factorize what changed.
Paper: arxiv.org/abs/2606.30544v1
Video
— https://nitter.net/hazel_heejeong/status/2072339534595924240#m