Easily create and view 3D splat files from 2D images with Apple's ML Sharp model (github.com)

Apple has unveiled the ml-sharp-ez package, enabling users to easily transform 2D images into immersive 3D splat files suitable for VR environments. This innovative tool leverages Apple's ml-sharp model to convert still images into .ply format, which can then be explored using WebXR-compatible devices like the Oculus Quest 3 and Apple Vision Pro. The aim is to make the research surrounding 2D to 3D image conversion more accessible, encouraging broader participation in the field. The significance of ml-sharp-ez lies in its potential to democratize 3D content creation, allowing individuals to create and share virtual experiences without the need for specialized skills. The package simplifies the workflow by packaging the conversion process into an easy-to-use application, although users will need to abide by Apple's licensing terms. While the resulting 3D representations are intriguing and offer a unique perspective on the images, they are not high-definition and incorporate intentional resolution reductions for compatibility with devices like the Quest 3. This initiative highlights Apple’s commitment to pushing the boundaries of AI in the creative arts while inviting constructive collaboration from the developer community.