RoboLab Leaderboard

RoboLab-120 Overall

Performance of task generalist models across three levels of language specificity.

Instruction specificity

All policies, including language models, robot foundation models, and task-and-motion planners.

Filters:
Showing all policies
Includes policies declared open source, even when a download link has not yet been published. Shows policies with no reported RoboLab or other simulation data in training or fine-tuning.
# Policy Type N SR% Score EE Speed EE SPARC Size VRAM Obs
1 AMP1 Agentic LM 2579 / 300025 eps/task
86.0% 93.5 8.08 cm/s −5.05 -- -- RGBDP — —
2 SenseNova-RoboRSI Agentic LM 685 / 120010 eps/task
57.1% 69.9 5.48 cm/s −4.04 -- -- RGBPL — —
3 Lakeside LWM 1531 / 300025 eps/task
51.0% 65.3 7.10 cm/s −4.84 5B 27.2 GB RGBP — —
4 BiMind v0.5 VLA 590 / 120010 eps/task
49.2% — 5.42 cm/s −5.07 8B 30 GiB RGBP — —
5 Praxis-1 WAM 555 / 120010 eps/task
46.2% — 6.72 cm/s −4.87 27.3B ~70 GB RGBP — —
6-TIE FLUX 3 Action WAM 515 / 120010 eps/task
42.9% — 7.36 cm/s −5.37 7B 69 GiB RGBP — —
6-TIE Cosmic TAMP+FM 508 / 120010 eps/task
42.3% 59.7 7.87 cm/s −7.20 ~350M 10 GB RGBDP — —
7-TIE HiDream-O1-Embodied VLA 479 / 120010 eps/task
39.9% 50.5 5.32 cm/s −4.95 6B 16 GB RGBP — —
7-TIE Atomic-WAM VLM+WAM 475 / 120010 eps/task
39.6% 55.5 7.69 cm/s −4.77 16.2B 40 GB RGBP — —
7-TIE OASIS WAM VLM+WAM 468 / 120010 eps/task
39.0% 53.7 6.91 cm/s −5.26 16B + VLM 40 GB RGBP — —
8 Cosmos3-Nano-Policy WAM 441 / 120010 eps/task
36.8% 51.9 7.13 cm/s −5.99 16B 40 GB RGBP — —
9 Phoenix TAMP+FM 413 / 120010 eps/task
34.4% 45.9 6.13 cm/s −5.55 ~250M 14 GB RGBDP — —
10 BiMind v0.1 VLA 400 / 120010 eps/task
33.3% 47.2 5.26 cm/s −5.88 7B 14 GiB RGBP — —
11-TIE VoLo Agentic VLA 339 / 120010 eps/task
28.2% 44.1 5.50 cm/s −8.92 — 80 GB RGBDP — —
11-TIE π0.5 VLA 336 / 120010 eps/task
28.0% 43.4 5.35 cm/s −8.34 3.3B >8 GB RGBP — —
12 DreamZero WAM 308 / 120010 eps/task
25.7% 39.8 3.64 cm/s −6.41 14B 2×80 GB RGBP — —
13 Cosmos3-Edge-Policy WAM 275 / 120010 eps/task
22.9% — 7.04 cm/s −5.46 4B 9.20 GB RGBP — —
14 π0-FAST VLA 186 / 120010 eps/task
15.5% 26.9 4.60 cm/s −9.63 3B >8 GB RGBP — —
15 GR00T N1.6 VLA 87 / 120010 eps/task
7.2% 17.1 4.30 cm/s −6.87 3B 24 GB RGBP — —
16 π0 VLA 60 / 120010 eps/task
5.0% 12.2 4.18 cm/s −9.49 3.3B >8 GB RGBP — —
17 paligemma-binning VLA 41 / 120010 eps/task
3.4% 9.9 1.93 cm/s −16.52 3B >8 GB RGBP — —
Verified ◆RoboLab/IsaacSim/IsaacLab data in fine-tuning ◈RoboLab/IsaacSim/IsaacLab data in training ◇Other simulation data in training Closed-source weights

Results by Task Difficulty

Difficulty reflects the number of subtasks and reasoning complexity per task, grouped into 3 difficulty levels.

Simple Moderate Complex
# Policy N SR% Score N SR% Score N SR% Score
1 AMP1 1388 / 1600
86.8% 93.3 855 / 975
87.7% 93.2 336 / 425
79.1% 95.1
2 SenseNova-RoboRSI 380 / 640
59.4% 67.9 219 / 390
56.2% 69.1 86 / 170
50.6% 79.3
3 Lakeside 921 / 1600
57.6% 65.2 430 / 975
44.1% 63.5 180 / 425
42.4% 69.5
4 BiMind v0.5 330 / 640
51.6% — 205 / 390
52.6% — 55 / 170
32.4% —
5 Praxis-1 300 / 640
46.9% — 187 / 390
47.9% — 68 / 170
40.0% —
6 FLUX 3 Action 314 / 640
49.1% — 153 / 390
39.2% — 48 / 170
28.2% —
7 Cosmic 298 / 640
46.6% 57.2 156 / 390
40.0% 59.8 54 / 170
31.8% 69.0
8 HiDream-O1-Embodied 276 / 640
43.1% 47.7 147 / 390
37.7% 54.3 56 / 170
32.9% 52.2
9 Atomic-WAM 284 / 640
44.4% 54.6 158 / 390
40.5% 58.1 33 / 170
19.4% 53.1
10 OASIS WAM 265 / 640
41.4% 50.7 148 / 390
37.9% 55.6 55 / 170
32.4% 60.5
11 Cosmos3-Nano-Policy 260 / 640
40.6% 51.0 138 / 390
35.4% 52.3 43 / 170
25.3% 54.4
12 Phoenix 274 / 640
42.8% 51.9 100 / 390
25.6% 40.0 39 / 170
22.9% 37.0
13 BiMind v0.1 248 / 640
38.8% 46.2 128 / 390
32.8% 50.9 24 / 170
14.1% 42.5
14 VoLo 209 / 640
32.7% 43.7 100 / 390
25.6% 46.7 30 / 170
17.6% 39.8
15 π0.5 190 / 640
29.7% 38.9 123 / 390
31.5% 50.5 23 / 170
13.5% 44.1
16 DreamZero 167 / 640
26.1% 35.5 117 / 390
30.0% 48.4 24 / 170
14.1% 35.9
17 Cosmos3-Edge-Policy 164 / 640
25.6% — 91 / 390
23.3% — 20 / 170
11.8% —
18 π0-FAST 129 / 640
20.2% 26.7 52 / 390
13.3% 29.2 5 / 170
2.9% 21.9
19 GR00T N1.6 56 / 640
8.8% 13.6 31 / 390
7.9% 25.1 0 / 170
0.0% 11.9
20 π0 46 / 640
7.2% 9.6 14 / 390
3.6% 18.1 0 / 170
0.0% 8.7
21 paligemma-binning 22 / 640
3.4% 6.2 19 / 390
4.9% 16.2 0 / 170
0.0% 9.0

Results by Competency Axes

Performance across competency axes: Visual (color, semantics, size), Procedural (action-oriented reasoning across affordances, reorientation, and stacking), and Relational (interpreting conjunctions, counting, and spatial relationships in multi-object instructions).

Relational Visual Procedural
# Policy N SR% Score N SR% Score N SR% Score
1 AMP1 905 / 1050
86.2% 90.0 1703 / 2100
81.1% 91.6 491 / 550
89.3% 95.3
2 SenseNova-RoboRSI 233 / 420
55.5% 64.2 421 / 840
50.1% 67.1 119 / 220
54.1% 66.1
3 Lakeside 564 / 1050
53.7% 67.4 993 / 2100
47.3% 61.8 169 / 550
30.7% 50.2
4 BiMind v0.5 246 / 420
58.6% — 342 / 840
40.7% — 96 / 220
43.6% —
5 Praxis-1 207 / 420
49.3% — 322 / 840
38.3% — 88 / 220
40.0% —
6 FLUX 3 Action 208 / 420
49.5% — 299 / 840
35.6% — 79 / 220
35.9% —
7 Cosmic 164 / 420
39.0% 54.9 334 / 840
39.8% 58.2 71 / 220
32.3% 51.0
8 HiDream-O1-Embodied 202 / 420
48.1% 56.4 224 / 840
26.7% 39.1 65 / 220
29.5% 46.7
9 Atomic-WAM 189 / 420
45.0% 57.9 286 / 840
34.0% 49.9 57 / 220
25.9% 46.1
10 OASIS WAM 196 / 420
46.7% 59.3 248 / 840
29.5% 45.3 67 / 220
30.5% 50.9
11 Cosmos3-Nano-Policy 207 / 420
49.3% 60.9 219 / 840
26.1% 42.9 60 / 220
27.3% 46.8
12 Phoenix 105 / 420
25.0% 37.3 282 / 840
33.6% 45.4 48 / 220
21.8% 30.3
13 BiMind v0.1 150 / 420
35.7% 51.7 247 / 840
29.4% 43.0 47 / 220
21.4% 33.3
14 VoLo 134 / 420
31.9% 44.1 196 / 840
23.3% 39.3 36 / 220
16.4% 40.4
15 π0.5 142 / 420
33.8% 46.8 200 / 840
23.8% 38.8 48 / 220
21.8% 41.6
16 DreamZero 140 / 420
33.3% 45.5 147 / 840
17.5% 31.9 58 / 220
26.4% 42.3
17 Cosmos3-Edge-Policy 112 / 420
26.7% — 141 / 840
16.8% — 33 / 220
15.0% —
18 π0-FAST 98 / 420
23.3% 36.7 74 / 840
8.8% 19.5 14 / 220
6.4% 16.4
19 GR00T N1.6 42 / 420
10.0% 23.2 42 / 840
5.0% 15.1 6 / 220
2.7% 11.1
20 π0 27 / 420
6.4% 18.8 16 / 840
1.9% 8.2 1 / 220
0.5% 6.6
21 paligemma-binning 24 / 420
5.7% 15.6 23 / 840
2.7% 9.3 1 / 220
0.5% 4.0

Sim-Real Correlation

Benchmark-level Correlation with Real World Experiments

Performance ranking correlate strongly with RoboArena Elo scores, an open-source real-world benchmark for generalist robot policies. This means that at a benchmark level, policies rank in our benchmark as they do in the real world.

Spearman ρ —

The RoboLab leaderboard submission process is currently being revised, and submissions are temporarily paused. For inquiries, please contact the organizers.