CaPtain trains Qwen3.5-4B to control a robot in code and beats several frontier-model agents

CaPtain trains Qwen3.5-4B, a small open model that can't move a robot at all, to run one by writing Python. The code, training data and weights are all released.

Slide text

CaPtain trains Qwen3.5-4B to control a robot in code and beats several frontier-model agents

Yijia Fan, Xilin He, Yilei Jiang, Dongming Wu, Jiaxu Wang, Xiangyu Yue · MMLab, The Chinese University of Hong Kong · NovaXBot

Fan et al. · CaPtain · arXiv 2610.40799v1 · submitted 29 Oct 2026 · Figure 1

Code-writing robot agents usually lean on ready-made skills like grasp and place. CaPtain removes them. With 22 low-level calls, the model itself decides where to grasp, how to approach, and when to close the gripper.

The model writes into a Python session that keeps its variables between turns. Each robot call returns a receipt: where the arm stopped, how hard it pushed, how far the gripper closed.

Slide text

01 02 03 The model

Every robot call reports back what physically happened

Fan et al. · CaPtain · arXiv 2610.40799v1 · Figure 7 · Section 3.1

Training copies the coding-agent recipe. Fine-tuning on runs written by GPT-6 Astra gets it through just over half the held-out LIBERO tasks. Reinforcement learning lifts that to about three in four.

A task only says at the end whether it worked. So a critic reads the simulator's exact object positions and credits each turn by how much it moved the odds of success. Most credit lands on moving, grasping and releasing.

Here the objects move, the wording changes, or the scene shifts mid-task. Reinforcement learning still adds about 20 points on each. π0.5, an end-to-end robot model, falls from 97 percent to about 13.

On a real Astrabot arm, it was told to put the cube the color of the sky into the container that isn't round. It chose the light blue cube and the rectangular tray. It was adapted to this arm in simulation only, with no real-world data.

Slide text

01 02 03 What it scores

On a real arm, it finds the sky-colored cube and the tray that isn't round

Adapted in a rough simulated twin of the arm, with no real-world data · two episodes shown, no success rate reported

Fan et al. · CaPtain · arXiv 2610.40799v1 · Figure 5 · Section 4.4

On LIBERO-PRO, the 4B model beats agents built on Gemini 3.7 Flash and Claude Opus 4.6. One on Claude Opus 5 still leads, about 92 percent to 79. CaPtain costs a few cents a task.

Trained on one arm, it struggles when a task needs two. On RoboTwin it finishes about 23 percent of tasks, half the rate of models trained there. On RoboDojo's shorter arms, under one percent.

The critic needs the true position of every object, so training on a physical robot would need a separate way to measure the scene. And motions stop at contact, so it can't wipe a surface.

For a one-arm robot that writes its own code, I'd start from CaPtain-4B before paying a frontier model per step, because it runs locally and every training stage is open. Links are below.