Show HN: Open-source app that lets LLMs control any iPhone app (no Mac required) (github.com)

An innovative open-source application has been launched that enables large language models (LLMs) to control any iPhone app directly from the device itself, eliminating the need for a Mac, additional hardware, or jailbreak. This groundbreaking tool allows users to type commands such as “Open Settings and turn on Dark Mode,” and watch as the AI autonomously performs tasks by navigating within the iPhone’s interface, taking screenshots at each step. Notably, it maintains user privacy, ensuring that all operations occur locally, with only call requests to external LLMs. This development holds significant implications for the AI/ML community by democratizing AI interaction with mobile devices and showcasing the potential for LLMs to operate seamlessly in real-world applications. Technical highlights include the requirement for iOS 26 and Developer Mode, the use of a loopback VPN to facilitate communication within the iPhone, and a focus on user privacy through intrinsic security measures. All interactions are supported by a simple chat interface and the capability to run commands through Siri or shortcuts, marking a pivotal step toward more integrated and user-friendly AI experiences on mobile platforms.