JavaScript library for rapid AI and XR prototyping (github.com)

XR Blocks, a new lightweight JavaScript library, has been launched to facilitate rapid prototyping of advanced AI and XR (Extended Reality) experiences. Built on three.js, it targets Chrome version 136 and higher with WebXR support, making it a robust tool for developers working on Android XR devices and desktop simulators. Key features include advanced hand tracking and gesture recognition using TensorFlow Lite and PyTorch, along with capabilities for world understanding and AI integration through Gemini, which enables multimodal interaction and live conversational experiences. This library is significant for the AI/ML community as it simplifies the development of immersive applications across both XR devices and desktop environments with a single codebase. With capabilities like gesture detection and depth sensing, XR Blocks enhances user interaction in virtual environments while promoting collaboration with AI technologies. The open-source nature provides developers with a platform to innovate rapidly, allowing them to create engaging applications that push the boundaries of human-computer interaction in XR settings. As XR Blocks is not an officially supported Google product but will be maintained by the XR Labs team, users can expect ongoing updates and enhancements to this promising tool.