Microsoft will test a Copilot AI feature that performs work on local files in Windows 11 (www.cnbc.com)

🤖 AI Summary
Microsoft announced it will pilot Copilot Actions in Windows 11 — an AI-powered assistant that can perform tasks on locally stored files and interact with desktop and web apps. The preview is limited to Windows Insiders who also join the Copilot Labs experiment group; the feature is off by default, runs in a contained environment (its own desktop), and lets users watch each step and take control at any time. Early capabilities include resizing photos, assembling playlists and driving apps like Spotify, as well as a File Explorer right‑click action using technology from Singapore’s Manus to “Create website with Manus.” The rollout is deliberately constrained for privacy and reliability: Copilot Actions will initially only access common folders (Desktop, Documents, Downloads, Pictures) and must get explicit approval to use other areas. Microsoft also adds chat-based Copilot Vision (previously voice-only) and a redesigned Copilot shortcut beside the Start button for one-click vision or spoken activation. For the AI/ML community this signals deeper OS-level agent integration, sandboxed autonomous agents interacting with GUIs, and incremental human-in-the-loop testing to surface edge-case failures. The preview will yield real-world telemetry on robustness, UI automation limits and privacy controls — important data for anyone building or evaluating agentic interfaces and desktop automation.
Loading comments...
loading comments...