From real observations to learned behavior

Agents for robot learning.

Fan Zhang Michael Gienger

Honda Research Institute Europe

Explore the workflow

Follow the experiment.

Choose a step to see what happens.

Start in the real world

A robot, a vial and a rack.

The real scene and its two camera views define the task we want to learn.

Real observations
External camera
Wrist camera
The task

“Pick up the vial and place it on the rack.”

Codex inspects

Reads the recorded views, identifies the scene and helps turn the task into an experiment.

0:00

Real observations

The 50-second story