Abstract
An embodied multi-agent framework uses learned correction codes and a vision-language-action model with motion-aware history and latent world modeling to improve robot control, failure recovery, and training efficiency.
Foundation models increasingly guide robot actions, yet sustained autonomy requires efficient control and failure recovery. We introduce A2-MEAS, an embodied multi-agent framework built around code as a scaling interface. Learned correction codes combine corrective language, spatial evidence, execution history, and action proposals. MetaBrain provides training supervision and runtime guidance. A correction encoder and adapter absorb this knowledge into policy weights during training, while fresh codes adapt behavior with frozen weights at deployment. The action model, A2-WLA, adds motion-aware history and a latent world model to a vision-language-action policy. Surprisingly, this simple design with action pretraining and task specialization reaches 0.5755 Q-score on the 50-task BEHAVIOR 2026 public subset before online correction, 2.21x the 2025 winner's reported 0.2605 across different benchmark editions and training configurations. On all 100 BEHAVIOR 2026 public tasks, A2-MEAS achieves 0.6411 Q-score and 45.40% task success. On RoboTwin 2.0, A2-WLA achieves 93.98% average success, rising to 95.05% with the complete system. Across 12 real-robot tasks in five household settings, A2-WLA achieves 57.92% average success versus 26.67% for pi0.5. In long-horizon pour-over coffee preparation, a history-conditioned adapter raises post-failure completion at two filter-handling steps from 14% to 94% and from 8% to 82%, compared with A2-WLA retries. Our training infrastructure delivers 427.1 samples per second, 4.03x the throughput of a pi0.5 reference implementation on matched hardware. We will release the system, models, training scripts, and infrastructure to support efficient embodied learning.
Community
If a better foundation model came out tomorrow, what would your robot actually do better?
That question drove us to build A²-MEAS. We trained a relatively simple action model on whole tasks. When something goes wrong, a learned correction interface combines the foundation model’s diagnosis with what the robot sees and what it just tried. The action policy uses that feedback to adjust its next move. We took this design from simulation benchmarks to a live pour-over coffee demo. Our A²-MEAS entry placed fourth worldwide in the 2026 BEHAVIOR Challenge.
To see how much the correction interface helped, we kept the action policy frozen and tested it on 12 BEHAVIOR tasks. It completed 50 of 120 runs on its own and 63 of 120 with the interface.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- LAW: Unifying Language, Action, and World Modeling for Agentic Physical Intelligence (2026)
- Beyond Actions: Learning Future Operation Targets for Vision-Language-Action Models (2026)
- Know Your Body: A Harness for Direct and Self-Improving Robot Control with VLMs (2026)
- XPACE: Joint World and Action Modeling from Heterogeneous Experience (2026)
- OmniBrain-0: A Unified Agentic Model for Embodied Intelligence (2026)
- RoboDoctor: Training-Free Recursive Self-Improvement for Robot Policies (2026)
- AR-WAM: A Visual-Conditioned Agent-Ready World Action Model for Robotic Manipulation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.09124 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper
