Show HN: Duetto – pretrained music transformer that plays a piano with you (github.com)

A new project called Duetto has emerged, featuring a pretrained Anticipatory Music Transformer that collaborates with musicians in real-time by playing piano alongside them as they perform. This innovative system listens to the musician's key, chord progressions, pulse, and phrasing, effectively improvising and complementing their playing. Running on a Jetson device, Duetto leverages MIDI input from a laptop to manage sound output and the piano roll, providing a viable platform for interactive music-making. The significance of Duetto lies in its potential to transform the way musicians practice and create music, offering a collaborative AI partner that understands and responds to their playing style. Its technical framework emphasizes real-time processing and interaction, with various presets that allow users to switch between roles, such as the AI improvising while the user plays harmonies. This sophisticated integration of AI into music performance not only enriches the creative process but also allows for extensive customization through control over musical parameters, encouraging exploration and innovation in musical expression.