Twitter/X

The Malik group released a method that converts human videos into robot…

2026-06-18 · 18:54 UTC ·@JitendraMalikCV ·0 min read

Brief

The Malik group presents Do-As-I-Do, a system that takes human demonstration videos and generates 4D robot hand–object interaction trajectories for robotic imitation and manipulation. The paper (arXiv:2606.19333, 2026-06-18) is accompanied by a project site (do-as-i-do.com) and open-source code on GitHub to reproduce and apply the method.

Why it matters

The Malik group released a method that converts human videos into robot hand–object interaction trajectories represented in 4D (spatial + time); paper on arXiv: 2606.19333 (published 2026-06-18).

Key details

Resources include a project website (do-as-i-do.com) and open-source code on GitHub (github.com/malik-group/do-as…); authors credited: Bhawna Paliwal, Haritheja E, Will J. H. Liang, Pieter Abbeel, Mahi Raghavan (notmahi), and Jitendra Malik.

Source evidence

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy!
Paper: arxiv.org/abs/2606.19333
Website: do-as-i-do.com
Code: github.com/malik-group/do-as…
Authors:@bhawnapaliwal,@HarithejaE,@willjhliang, @pabbeel , @notmahi , @JitendraMalikCV

Video