Muse Image and Muse Video (ai.meta.com)

Meta has unveiled Muse Image and previewed Muse Video, two advanced media generation models from its Superintelligence Labs. Muse Image stands out as a versatile image generation tool that accurately follows user prompts, allows precise editing, and can compose images from multiple references while integrating seamlessly with social context from Instagram. Notably, it operates as an agent, leveraging coding and search tools to refine outputs and enhance factual accuracy. The model's self-refinement capabilities emerged organically during training, enabling it to make iterative improvements and produce higher-quality images. Available now across several Meta platforms, it also features a Content Seal watermark system to help users identify AI-generated content. Alongside Muse Image, the preview of Muse Video aims to provide high-quality visual content while addressing current performance issues like audio synchronization. Both models signify significant advancements for the AI/ML community, pushing the boundaries of what's possible in media generation. Muse Image's groundbreaking approaches to editing and multi-reference composition, coupled with the promising functionalities of Muse Video, position Meta at the forefront of AI-driven creative tools. These innovations not only enhance user creativity but also facilitate dynamic content generation across Meta's ecosystem, further integrating AI into everyday use.