OpenAI's Codex Can Now Use Your Mac Even When It's Locked (www.macrumors.com)

OpenAI has introduced a groundbreaking feature for its Codex desktop app on macOS, allowing it to operate even when the Mac is locked. This functionality enables users to send tasks to Codex from their phones, which can then interact with applications on the Mac without needing the screen to be unlocked. For this to work, users must install the Computer Use plugin and grant Screen Recording and Accessibility permissions, enabling Codex to perform actions like navigating menus and manipulating the clipboard within designated apps. This development is significant for the AI/ML community as it enhances the versatility and usability of Codex, particularly for tasks that are challenging for command-line tools, such as debugging GUI-only applications or altering app settings remotely. Although the feature is currently unavailable in the European Economic Area, the UK, and Switzerland, it represents a step towards more fluid and automated interactions between users and their devices. With added protections, including permission requests for each new app, Codex offers a streamlined experience while maintaining user control over app access. Additionally, recent updates such as the "Appshots" feature and /goal mode demonstrate OpenAI's commitment to continuously improving Codex's capabilities.