Can a small open model with $3 of fine-tuning beat a production RAG setup?


This is what I tested, and the results were impressive
Based on a 100-question eval set, a fine-tuned version of Qwen3.5-9B outperformed Gemini Flash with RAG and Opus4.8/Sonnet 5 without RAG
Working on a full write-up of the end-to-end flow
post-image
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned