"With 1 million GPUs installed, the actual working time is only 10%."


Recently, Kim Jeong-ho, the father of HBM in South Korea, gave such a figure in an interview. "Reading and writing take up almost all the time, and the GPU is just waiting idly." Even with algorithm optimization, GPU utilization is hard to exceed 30%.
He believes that "the core of AI is memory."
Full text:
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned