First native adaptation for Ascend: Huawei officially open-sources openPangu-2.0-Flash with 92 billion parameters

robot
Abstract generation in progress
ME News: On June 30 (UTC+8), according to Beating monitoring, Huawei announced the official open-sourcing of the Pangu openPangu-2.0-Flash model, which will soon be launched on GitCode’s Ascend Tribe community. The model has 92 billion (92B) total parameters, adopts a Mixture of Experts (MoE) architecture, and actually activates only 6 billion parameters. It supports a 512K ultra-long context. As Huawei’s open-source AI model brand, openPangu is committed to providing the industry with practical reference for Ascend computing power development through Ascend-native training and inference technologies. According to the open-source roadmap, the first batch of items to be released for the Flash version includes model weights, basic inference code, and training/inference operators; the more powerful openPangu-2.0-Pro weights and inference code will be released in July, and more components will be open-sourced gradually in the second half of the year. (Source: BlockBeats)
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned