Twitter/X

Teleoperation began around 1950 to remotely handle radioactive material…

Brief

Jitendra Malik notes that teleoperation dates back to about 1950 (citing early "Mechanical Hands" footage) and argues that using teleoperation today to gather robot trajectories for behavioral cloning is still awkward. He suggests a superior pipeline: learn from human video data and refine policies via reinforcement learning in simulation rather than collecting trajectories via teleoperation.

Why it matters

Teleoperation began around 1950 to remotely handle radioactive material (referenced historic demo: "Mechanical Hands" 1948/early teleoperation footage).

Key details

  • Contemporary use of teleoperation to collect robot trajectories for behavioral cloning (BC) remains clumsy and inefficient.
  • Author proposes a better approach: leverage human video as demonstrations combined with reinforcement learning (RL) in simulation to train robots, instead of relying on teleoperation.
Source evidence

Teleoperation was pioneered ~1950 to remotely handle radioactive material. When we use it today to collect robot trajectories for BC, it is still clumsy. Surely, there is a better way! (Hint: human video, RL in sim).piped.video/watch?v=Iihxzau6…

Link

Mechanical Hands (1948)

New York City, United States of America (USA)A demonstration is...
youtube.com