A dual-arm robot performing a long-horizon desk organization task

Riemann-1.0

An Embodied World Action Model for Physical AI

A fully causal autoregressive World Action Model that unifies executable robot policy and action-conditioned world simulation across heterogeneous embodiments.

232K+ Raw source hours
85.0% Real-world SR
99.0% LIBERO
94.3% RoboTwin2.0
62.6% RoboCasa365

From embodied experience to executable robot control.

Riemann-1.0 turns heterogeneous embodied experience into a causal action-video model that follows real robot interaction: history predicts the next action chunk, actions condition future visual dynamics, and new observations refresh the context for closed-loop control.

Fully causal autoregressive WAM

Jointly model embodiment-specific actions, multi-view observations, and robot states in the order used by real robot control.

Progressive embodied pretraining

Progressively acquire embodied knowledge through three stages: unlabeled egocentric video learning, mixed action–trajectory supervision, and robot-specific policy enhancement.

Unified Robot Policy and World Simulator

Use one causal action-video model for both executable action prediction and action-conditioned future video generation.

Riemann-1.0 turns large-scale heterogeneous embodied experience into a generalist closed-loop robot policy, executing complex long-horizon real-world tasks with precise manipulation. The following videos showcase the complete process of Riemann-1.0 autonomously performing complex real-world tasks after post-training with simple data collection, without complex data-engineering pipelines such as DAgger..

Pull the clothes, fold them, and stack them on the right side.
First, stack all yellow blocks, followed by the red cubes, orange cubes, and finally the purple cubes.
Throw the crumpled paper into the trash can, place the spoon and fork into the basket, put the plate on the rack, empty the water from the bowl into the trash can, pull out a tissue and wipe the water off the table, and finally place the bowl on the rack.

Real-World

For real-world evaluation, we fine-tune a generalist model on all demonstration data, enabling a single policy to perform all target tasks. Across the following four manipulation tasks, Riemann-1.0 maintains at least 80.0% success rate (SR) and 91.0% progress success rate (PSR) on every task, while exceeding the strongest open-source baseline by 15 SR points on average.

Desk

Place the stuffed toy, tissue pack, charger, cube, and black tape into the box, then place the pen into the pen holder.

80.0%SR
95.2%PSR

Clothes

Fold this deformable garment on the table through bimanual manipulation.

85.0%SR
92.5%PSR

Cube stacking

Stack the cubes with the right hand in the order of blue, yellow, red, green, and green

85.0%SR
91.6%PSR

Kitchen

Put the spoon and fork into the basket, and place the plate and bowl on the rack.

90.0%SR
98.4%PSR

Generalization beyond post-training tasks

Held-out real-robot evaluations compositional generalization by recombining seen objects into unseen tasks, and OOD zero-shot transfer with unseen objects and unseen tasks without any additional demonstrations.

65.0%Compositional generalization SR
85.0%OOD zero-shot SR
75.0%Overall SR
Compositional GeneralizationPlace both bowls stacked on the plate.
Compositional GeneralizationPlace the fork into the pen holder
Compositional GeneralizationFirst, place the green cube on the red plate, then place the purple cube in the green bowl, and finally place the red cube on the red plate.
Compositional GeneralizationPut the red cube on the yellow plate.
OOD zero-shotPut the white napkins into the trash can.
OOD zero-shotPut the Rubik cube into the basket.
OOD zero-shotPut the towel into the basin.
OOD zero-shotFold the blue towel on the table and place it on the right side

Simulation benchmarks

Riemann-1.0 reaches 99.0% average success rate on LIBERO, 94.3% on RoboTwin 2.0, and 62.6% on RoboCasa365.

LIBERO

  1. 99.0Riemann-1.0
  2. 98.9Being-H0.5
  3. 98.9G0.5
  4. 98.6ABot-M0
  5. 98.5LingBot-VA

RoboTwin 2.0

  1. 94.3Riemann-1.0
  2. 94.1ABot-M0.5
  3. 93.3G0.5
  4. 92.2LingBot-VA
  5. 91.8Fast-WAM

RoboCasa365

  1. 62.6Riemann-1.0
  2. 54.2ABot-M0.5
  3. 45.1LingBot-VA
  4. 43.7GR00T-N1.5
  5. 43.5Fast-WAM

Data Infra

Riemann-1.0 converts 232K+ hours of heterogeneous data into action-level supervision through hierarchical VLM segmentation, instruction and action annotation, quality filtering, 3D hand-action reconstruction, semantic categorization, and scene-skill balancing. Egocentric human videos provide broad interaction priors, while UMI / exoskeleton demonstrations and robot trajectories progressively ground those priors in executable control.

Data infrastructure composition.

Causal video-action architecture

Riemann-1.0 preserves the causal order of interaction with a unified autoregressive factorization over action and visual latents. Multi-view observations, robot states, and embodiment-specific action tokens share an Action/Video DiT with structured causal visibility, preventing future observation leakage while retaining teacher-forced training.

A shared Video/Action DiT learns visual dynamics and executable actions through state/action tokens, embodiment-aware interfaces, coordinate-aware position encoding, and structured causal attention masks.

Three-stage training

The same action-video objective is retained while the action loss weight increases from visual-dynamics-first pretraining to balanced multi-source alignment and finally policy-focused robot enhancement.

Stage 1 · LAM-Action Bootstrap

Frozen LAM pseudo actions supervise unlabeled egocentric video while visual dynamics dominate the objective with λ=0.1.

Stage 2 · Trajectory-Grounded Alignment

3D-hand human data, UMI demonstrations, and robot trajectories align real action spaces under balanced learning with λ=0.5.

Stage 3 · Robot-Policy Enhancement

High-quality robot-only trajectories sharpen state-conditioned executable control with policy-focused supervision at λ=0.9.

Inference

Riemann-1.0 denoises the next action chunk from a growing visual-state cache. After execution, real observations are encoded back into context tokens; long rollouts use a sliding temporal window while preserving the same causal semantics.

Unified Robot Simulator

The same causal model supports two inference modes. Robot Policy maps observed history to executable actions, while World Simulator supports predicting the visual consequences of input action trajectories for rollout inspection and action-plan comparison.

Robot Policy

Riemann-1.0 can act as a robot policy to use observations (images + states) and task prompt to denoise the next action chunk.

Observation + PromptAction

World Simulator

Given the first frame image, prompt, and input future actions, Riemann-1.0 can act as a world simulator to roll out action-consistent future observations.

Context + ActionFuture video

Full-resolution figure