Grok 4.5 tops Tencent Hunyuan Agent endurance leaderboard, with over 60% of tasks completed without a model

robot
Abstract generation in progress
According to Beating monitoring, Tencent’s Hunyuan team, together with multiple universities, released LHTB, specifically to test whether AI Agents can continuously complete complex tasks in a terminal.

The benchmark includes 46 tasks, covering areas such as software engineering, experiment reproduction, scientific computation, and multimodal analysis. Each task runs for up to 90 minutes and usually requires continuous operation across hundreds of steps.

LHTB doesn’t only look at final success or failure. Completing part of a task also earns points based on the actual progress. Hidden verifiers check files, test results, and program output, and an Agent’s self-claimed completion doesn’t count.

The paper’s first release tested 15 models. GPT-5.5 completed 7 tasks, ranking first. Each model performs one task, averaging about 9.9 million Tokens and taking about 85 minutes.

Current publicly available results have expanded to 20 models. Grok 4.5 topped the list with an average score of 0.505, completing 13 tasks. Out of the 46 tasks, 29 still have no model that meets the completion standard.

Most Agents can complete some steps, but they often run out of the 90-minute limit, or stop early before the task is finished, making it impossible to truly complete complex tasks.
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned