Inside NVIDIA’s IsaacTeleop: From Hand and Controller Tracking to Robot Actions with the Graph-Based Retargeting Engine
In this tutorial, we work through the retargeting engine at the core of NVIDIA IsaacTeleop, the framework that turns XR hand tracking and motion-controller input into commands for simulated and real robots. Rather than plugging in a headset, we build every input ourselves in NumPy, so each step runs on a plain Colab CPU and prints what it computes. We start with the type system every node speaks, generate synthetic hand and controller data, write our own retargeter with live-tunable parameters,
Get smart on it
The lesson for this story is being written.
Related news
The physical AI race will be won in the patent office
Lightbringer’s co-founders and board members, from left: CTO Markus Andreasson, CEO Dominic Davies, and CCO Ola Wassvik. Source: Lightbringer Developments in AI, machine learning, and automation have given robots capabilities that would have seemed extraordinary a decade ago. As competition intensifies, the physical AI race is becoming less likely to be won by whoever builds the best robot, and more likely to be won by whoever owns the technology that determines its behavior. This is a par
Eli Lilly, Purdue to share field learnings on human robot interaction at RoboBusiness
https://www.therobotreport.com/wp-content/uploads/2026/10/lilly-physical-ai.mp4 Human-robot interaction is one of the biggest unlocks left in industrial automation to enable stronger safety, but most HRI research happens on university campuses that produces data that rarely survives contact with a live production floor. Running studies inside a working manufacturing site is logistically hard enough that most academia–industry partnerships never get past the first meeting. At RoboBusiness 2026, F
