Show HN: Flipdot display with an AI chat that codes sandboxed animations for it (github.com)

An innovative interactive art installation has been unveiled, featuring a 28×28 flip-dot display that dynamically responds to viewer interactions using advanced AI technologies. This installation, powered by an NVIDIA Jetson Orin Nano, utilizes MediaPipe for pose and face detection via a webcam. As passersby approach, the display transforms their silhouettes into a falling-sand animation or live caricatures of their faces, enhancing user engagement through a unique blend of art and technology. Moreover, users can interact via Bluetooth game controllers, browser consoles, or AI agents, showcasing a versatile interface that reflects real-time responses. This project is significant for the AI/ML community as it highlights the practical application of AI-driven user interfaces and real-time rendering capabilities, opening new avenues for interactive installations. The core technology leverages a custom GPU-enabled MediaPipe implementation for performance boosts, achieving pose detection in approximately 42 milliseconds per frame. The codebase, written primarily in Python, includes a robust event queue system that processes inputs from various sources to manage display modes, demonstrating innovative design patterns such as a sandboxed environment for scripted animations. Overall, this installation represents a fusion of artistic expression and cutting-edge AI technology, potentially inspiring future projects in interactive media and intelligent displays.