Coin World News: Google's latest Gemma 4 technical report demonstrates how to use a minimalist architecture to make large models run faster on phones and edge devices while saving more memory. The Gemma 4 12B model achieves a "encoder-free" minimalist integration of both visual and audio modalities for the first time, directly cutting the visual translator by 93% and completely eliminating the audio translator, solving the VRAM waste caused by "external translators." In addition, the model reduces memory usage by 37.5% when processing long texts through global attention reuse. Its lightweight edge version's prediction accelerator also reduces the dictionary range from 260k to 4,096, significantly improving decoding speed.

View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 5
  • Repost
  • Share
Comment
Add a comment
Add a comment
MultisigOnRocks
· 3h ago
If the encoder-free architecture really works out, in the future even small models can run multimodal locally.
View OriginalReply0
AirdropTaxPanic
· 7h ago
Google's edge-side optimization is paving the way for mobile AI, and Apple is under pressure.
View OriginalReply0
DepegDaydream
· 7h ago
The 4096 vocabulary's improvement in decoding speed is interesting, but could it come at the cost of multilingual coverage?
View OriginalReply0
GateUser-f78f1f3e
· 7h ago
Cutting 93% of the visual translator and not requiring an audio encoder, this slimming intensity is even more ruthless than mine.
View OriginalReply0
LimitOrderMonk
· 7h ago
Global attention reuse saves 37.5% of VRAM, finally no more memory explosion for long texts.
View OriginalReply0
  • Pinned