Google AI Instruments (Magenta RealTime 2) (magenta.withgoogle.com)

Google has announced the release of Magenta RealTime 2 (MRT2), an innovative live music model that allows users to create and manipulate music in real-time on MacBooks equipped with Apple Silicon. This new model includes an open-weights framework accompanied by a suite of instruments and applications that enhance musical creativity. Key features include MIDI steering, text-to-synth capabilities for generating instruments based on descriptions, audio cloning for creating playable versions of sound snippets, and prompt mixing that blends audio and text prompts to explore diverse musical styles. The significance of MRT2 lies in its potential to revolutionize live music performance and composition, making sophisticated music creation accessible to a broader audience, including those without extensive musical training. With low-latency response and dynamic modulation options, musicians can experiment with sound design and real-time composition in ways previously limited to expert producers. The open-source nature of the Magenta RealTime 2 framework encourages developers and creators to build customized applications, fostering innovation within the AI/ML community and potentially reshaping the future landscape of digital music creation.