Laguna S is an 118B mixture-of-experts model that activates only 8B parameters per token


This is definitely worth studying because Poolside took it from training start to launch in just eight weeks! Let that sink in
post-image
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned