A$AP Rocky Releases Helicopter Music Video Featuring Gaussian Splatting (radiancefields.com)

A$AP Rocky's latest music video for "Helicopter" showcases an innovative use of volumetric capture technology, specifically dynamic Gaussian splatting, transforming traditional filmmaking into an immersive experience. Nearly every performance in the video was recorded using a sophisticated 56-camera RGB-D array, allowing for extraordinary movement and kinetic interactions among dancers, making each action feel both surreal and authentic. The creative team, led by director Dan Strait and technical experts from Evercoast, aimed to harness this dynamic workflow to achieve radical freedom in post-production, enabling real-time adjustments without the extensive costs associated with conventional visual effects. This project is significant for the AI/ML community as it represents one of the most ambitious applications of volumetric performance capture in mainstream media, pushing the boundaries of how human motion can be preserved and manipulated. With over 10 terabytes of data captured, the post-production utilized advanced tools like Houdini and OTOY’s OctaneRender to relight the splat data, resulting in a visually striking outcome that challenges perceptions of reality in film. By blending technology with authentic human performance, this video exemplifies the potential of AI-driven techniques in redefining content creation, making viewers rethink the intersection of digital and real-world artistry.