Boogiebench: LLM Music Composition with Strudel (www.boogiebench.com)

Boogiebench has been introduced as an innovative tool for evaluating large language models' (LLMs) capabilities in music composition. Inspired by the Beach Boys' "Good Vibrations," Boogiebench allows users to compare two AI-generated musical compositions side by side, assessing their quality through a simple voting mechanism. While models like Strudel generate musical outputs, Boogiebench adds an interactive layer, enabling users to engage directly with the AI's creativity in a more entertaining format. This development is significant for the AI/ML community, as it offers a unique platform for benchmarking musical LLMs, providing insights into their strengths and weaknesses. The ability to conduct real-time comparisons fosters collaboration and competition among developers, while enhancing the understanding of AI's role in creative fields like music. With the incorporation of user feedback through the voting system, Boogiebench promises to refine future models, helping them better understand musical structures and improve their compositional skills.