Data → adaptation and prediction
Bring the observations into learning.
Adapt a foundation policy and explore a prototype for predicting future motion.
Real data
Rendered observationsReal demonstrations
π0.5Adapt the foundation policyExplore fine-tuning with rendered data and with real demonstrations.
Current observationPredicted video
Future keyframesA visual prediction prototype
Near future
Next
Further ahead
Codex prepares and fine-tunesPrepares the datasets, configures π0.5 fine-tuning and reviews the resulting behavior.