Speech-Driven Spatial Externalization for Co-Located Collaboration in AR (arxiv.org)

A groundbreaking study introduces AnchorNote, an innovative augmented reality (AR) system designed for enhancing co-located collaboration through speech-driven spatial externalization. This tool allows users to capture and organize spoken ideas into spatially anchored sticky notes using live transcription and large language model (LLM) summarization. The system was evaluated with 20 participants engaged in brainstorming and thematic grouping tasks, revealing that while AnchorNote reduced the effort required for writing, it also introduced new coordination challenges that influenced how collaborators formulated and organized their thoughts. The significance of AnchorNote lies in its potential to reshape collaborative cognition in AR environments. By facilitating a more effortless method of idea externalization, it invites further investigation into the interplay between speech recognition and spatial organization in collaborative settings. The findings could lead to vital design implications for future AR tools, paving the way for enhanced workflows in collective problem-solving and creativity, thereby advancing the potential applications of AI and ML in human-computer interaction.