This wave of open-source from Google has directly turned a MacBook into a musical instrument—at 200ms latency, you can truly jam on the spot, and musicians are going wild with excitement.

Google DeepMind releases open-source real-time music generation model Magenta RealTime 2 (MRT2), optimized for M series Macs, with low latency locally, under 200 milliseconds. It can perform real-time playing and control via MIDI, text prompts, or audio clips, supporting three modes: MIDI guidance, text-to-synthesis, and audio cloning. Two versions are available: MRT2_small with 230 million parameters and MRT2_base with 2.4 billion parameters. The inference library Magenta-RT and C++ engine Magentart::core are open-sourced on GitHub, with standalone macOS applications and DAW plugins provided.