CUA-Master-27B is an open computer-use agent that trails only Claude Opus 5 and GPT-5.6-Sol on Agents' Last Exam
1 hour ago
CUA-Master-27B is an open computer-use agent built on Qwen-3.5-27B that works a desktop with clicks and shell commands in the same task. On Agents' Last Exam it passes 25% of tasks, behind only Claude Opus 5 and GPT-5.6-Sol and level with Kimi K3, and it scores 80.2 on OSWorld Verified at about eight minutes a task. Long OSWorld 2.0 jobs and CAD work remain weak. From arXiv 2611.03126v1 (submitted 2 November 2026), MMLab at CUHK, Tsinghua University, HKUST (Guangzhou) and JD Explore Academy. Paper: https://arxiv.org/abs/2611.03126 Code: https://github.com/xlyu0106/CUA-Master Weights: https://huggingface.co/yxl66666/CUAMaster-27B
Ask about this presentation
Chapters
0:00CUA-Master-27B runs a computer with clicks and shell commands
0:18Only two models pass more of Agents' Last Exam
0:34One task, two ways of acting
0:46Both modes beat either alone
1:00About eight minutes a task
1:12Training tasks start as tutorial videos
1:29Rewind instead of restart
1:45Long jobs and CAD still mostly fail
2:04Rebuilding it takes a lab
2:19Where to get it
Show transcriptHide transcript
CUA-Master-27B runs a computer for you, clicking through apps and typing shell commands in the same task. It's an open model built on Qwen 3.5, and on Agents' Last Exam only Claude Opus 5 and GPT-5.6 Sol finish more tasks.
Agents' Last Exam gives long jobs across desktop apps and the terminal, and counts a task only if every check passes. CUA-Master passes one in four, level with Kimi K3, an open model about a hundred times its size.
Grading a stack of exam papers, it lists the files with a shell command, reads the marked answers on screen, and scores them in Python. Then it types the totals into a Calc spreadsheet.
WeaveBench mixes web, design, data and document jobs. With only clicks or only commands, the model scores about 12 out of 100 at best. Allowed both, it scores about 44.
It averages about eight minutes per OSWorld Verified task, a minute quicker than Claude Opus 5. On Agents' Last Exam it needs about a third less time than the models it ties.
Its training data starts from how-to videos for more than 650 apps. A model cuts each video into tasks and rebuilds the clicks, then recombines those steps into new, checkable tasks across several apps.
When a practice run fails, the pipeline rewinds the virtual machine to its last good state and retries with a hint. On tasks about as hard as Agents' Last Exam, half the runs succeed, against one in seven.
On OSWorld 2.0, with longer tasks, it averages about 37 out of 100 and spends over an hour on each. CAD and design jobs score about 26. And stock Qwen 3.8, the same size, scores a point higher on OSWorld Verified.
Rebuilding the training takes 128 H200 GPUs and a setup built for over 2,000 virtual machines at once. The data is only as good as the model labelling it, and labelling its own data adds little.
For a computer-use agent on my own hardware, I'd try CUA-Master-27B first, in a sandbox, because it ties far larger open models on Agents' Last Exam at a size one server can run. Links are below.
Up next
2:37CaPtain trains Qwen3.5-4B to control a robot in code and beats several frontier-model agents
@ai-papers · 1 day ago
2:45Trajectory2Gym data lifts a 4B Qwen3 agent past the stock 30B model on Tau2
@ai-papers · 1 week ago
2:46“Wait” in reasoning models comes from training data, and RL almost never invents it
@ai-papers · 1 week ago
2:08Looking Ahead makes Wan video models more physically plausible, with generation unchanged
@ai-papers · 1 week ago
2:30OpenVLHarness gives vision models tools and a memory, and seven models each gain about 10 points
@ai-papers · 2 weeks ago
2:413DCodeVerse makes the same model write better 3D code than Claude Code, Codex or Gemini CLI
@ai-papers · 2 weeks ago
2:53Agent-Reflex trains an 8B agent to recover when its MCP tools fail, and it gets derailed half as often
@ai-papers · 2 weeks ago
2:45EmbodiedCLBench: one practice task gives AI agents most of their gain, and more practice doesn’t add to it
@ai-papers · 3 weeks ago
3:11Tool-using agents often act before checking the evidence the action needs
@ai-papers · 3 weeks ago
3:19Given enough tries, base models solve more agent tasks than their post-trained versions
@ai-papers · 4 weeks ago
4:57Coding agents solve fewer SWE-bench issues once a repository's names are changed
@ai-papers · 1 month ago


