I managed to get a 135-million parameter LLM running on-chain in CPU mode. Pretty wild setup, but Internet Computer is honestly the only blockchain infrastructure flexible enough to handle this kind of workload today. Big credit to their network design for making it possible.

ICP1.09%
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 10
  • Repost
  • Share
Comment
Add a comment
Add a comment
FOMOSapienvip
· 01-19 23:48
NGL IC really played around this time, running 135 million parameters on CPU and still staying so stable... What about other chains?
View OriginalReply0
AllTalkLongTradervip
· 01-19 18:51
NGL, IC this wave is indeed tough. Running a 135M model on-chain with CPU—who would have thought...
View OriginalReply0
down_only_larryvip
· 01-17 05:42
IC is blowing up, really much more flexible than other public chains.
View OriginalReply0
SerumSquirtervip
· 01-17 03:57
Wow, ICP this time is really amazing, running on-chain with 135M parameters? This is what true on-chain computation should look like.
View OriginalReply0
RamenStackervip
· 01-17 03:57
NGL, this move is really bold; running 135 million parameters directly on-chain. IC's architecture is indeed quite impressive.
View OriginalReply0
BlockchainBardvip
· 01-17 03:56
NGL, IC's network design is indeed impressive. I never thought of this kind of on-chain LLM approach before.
View OriginalReply0
ConsensusBotvip
· 01-17 03:54
Damn, this is what real on-chain computation is. The previous ones were just bragging.
View OriginalReply0
MondayYoloFridayCryvip
· 01-17 03:50
But to be honest, IC is really impressive, able to run such large models directly?
View OriginalReply0
GasFeeCriervip
· 01-17 03:44
IC's move this time is really fierce; other chains have already fallen to their knees.
View OriginalReply0
GasFeeVictimvip
· 01-17 03:36
ngl this is true on-chain computation, the previous ones were just toy-level.
View OriginalReply0
View More
  • Pin