Qwen 3.6 27B Dense model reaches 40 tok/s on RTX 3090

robot
Abstract generation in progress

AIMPACT News, April 24 (UTC+8), 2026: User @sudoingX released preliminary test results: The Qwen 3.6 27B Dense model passed the 10/10 test at a speed of 40 tokens/sec on a single RTX 3090 24GB graphics card. The result was achieved without using quantization techniques or fused kernels, only employing llama.cpp’s Q4_K_M direct quantization. The user also developed a particle swarm benchmark to evaluate the model. (Source: InFoQ)

View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin