Meituan LongCat-2.0 concurrently releases inference code for domestic cards.

robot
Abstract generation in progress
Golden Finance reported that on July 9, as the industry's first trillion-parameter model to complete inference on a 50,000-card domestic computing cluster, LongCat-2.0 has been fully open-sourced. Aimed at domestic computing chips with limited memory and bandwidth, we have conducted deep collaborative optimization across model architecture, chip adaptation, and deployment strategies, ensuring that the trillion-parameter model runs stably and quickly on existing cards as well. The open-sourcing of LongCat-2.0 is not only a disclosure of technical pathways but also an invitation to the ecosystem. This open-source release simultaneously provides multi-precision versions including BF16, FP8, and INT8, comprehensively covering deployment needs on different computing platforms. At the same time, we deeply embrace the open-source community by open-sourcing the inference results that have been extremely optimized for domestic computing power. This means that even without the latest computing power, LongCat-2.0 can be stably run based on existing hardware. Through this out-of-the-box inference stack, we hope to enable more domestic cards, including older ones, to smoothly deploy trillion-parameter large model inference services and deliver greater value in real productivity scenarios.
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned