Generative AI for Krita (github.com)

A new plugin for Krita has been announced, enabling artists to incorporate generative AI directly into their image painting and editing workflows. This innovative tool allows for greater precision and control by letting users restrict AI-generated content to specific selections and refine existing artwork, thus enhancing the creative process. It seamlessly integrates with Krita's existing functionalities, enabling artists to draw, paint, and generate images without needing to manage complex AI parameters or technical details. This development is significant for the AI/ML community as it promotes an open-source approach, allowing users to run the tool locally and customize it with their own models, or utilize cloud generation for quick starts. The plugin supports advanced features like inpainting, live painting, and upscaling to high resolutions while accommodating a variety of diffusion models and control mechanisms. By providing a robust set of editable options—such as assigning descriptions to specific image regions and managing generation jobs—the plugin empowers artists to enhance their creative workflows by leveraging the latest advancements in generative AI technology.