I tried to build a LitRPG sandbox with on the fly generated sprites (app.productnow.ai)

Kadhir Mani has developed an experimental LitRPG sandbox that generates character sprites on-the-fly, combining advanced machine learning techniques and game development. Inspired by the immersive experiences of LitRPG novels, he utilized a web-based architecture where a NestJS server manages asset generation requests while a front end built with Next.js and Phaser handles rendering and game state. A key challenge was ensuring that the character remained coherent across various animation frames, which was addressed through an innovative approach using a Mastra agent loop paired with the Gemini 2.0 Flash tool. This project is significant for the AI/ML community as it demonstrates the potential of AI in creative applications like game design. By integrating tools for generating and editing sprite sheets, the development includes a unique validation feedback mechanism to refine outputs rather than create new ones from scratch. This reduces computational waste and preserves artistic style. The iterative feedback process ensures quality by checking for inconsistencies, enabling a more efficient sprite generation experience that could potentially be applied to other areas of game development or interactive media.