Primary Success Rate
Success Rate (%) over the 149-task primary pool.
Notes
- Primary success rate values are reported as percentages on VenusBench-Mobile's 149-task primary pool.
- SPR is the Stability Pass Rate: a base task passes only when all corresponding environment settings pass.
- TT is total output tokens across tasks in thousands. PT is the average per-step output tokens.
- Planner-executor rows use UI-Venus-72B as the grounding executor.
- Rows added after the original manuscript may report only primary task success rate; unavailable fields are marked as N/A.
Citation
@misc{gong2026venusbenchmobile,
title={VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics},
author={Yichen Gong and Zhuohan Cai and Sunhao Dai and Yuqi Zhou and Zhangxuan Gu and Changhua Meng and Shuheng Shen},
year={2026},
url={https://github.com/inclusionAI/UI-Venus/tree/VenusBench-Mobile}
}
Last updated on: May 11, 2026