Bonsai 27B: The first 27B-class multimodal model that can run on a mobile phone

robot
Abstract generation in progress
ME AI release, Bonsai 27B is built on Qwen3.6 27B, offering two variants: trinary (1.71 effective bits/weight, 5.9 GB) and 1-bit (1.125 effective bits/weight, 3.9 GB). The latter is the first to fit a 27B-class model into iPhone 17 Pro. The model supports multi-step reasoning, structured tool calling, vision tasks, and a computer-use agent loop, with a 262K token context window. It also supports speculative decoding for acceleration. In 15 benchmark tests, the trinary variant retains 95% of full-precision baseline performance, while the 1-bit variant retains 90%; math and coding capabilities are nearly lossless. It is open-sourced under the Apache 2.0 license. 🔗 Read the original: via AI HOT ·
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned