It is refreshing to have some new arguments pointing at specific distributions (Gaussian) our embeddings must follow! Especially now that we know how to do scalable distribution matching in high dimension with LeJEPA/SIGReg! Another win for Abraham de Moivre and Friedrich Gauss!
David Klindt (@klindt_david)
What does JEPA actually learn? We can finally prove it 🌍
So excited to share our theory of identifiable World Models: LeJEPA recovers the latent variables of the world.
Plan in the learned World Model as if it were real, same shortest path.
📄: klindtlab.github.io/lejepa-i…
Video
— https://nitter.net/klindt_david/status/2059432130946457958#m