Run a large language model on your iPhone. No internet is needed (github.com)

OwnOwl has launched a groundbreaking app that allows users to run a large language model entirely on their iPhones without requiring an internet connection. This app ensures that conversations remain private, as no data is sent to external servers. Users can interact with the model in multiple languages while enjoying features such as memory recall only upon request, document-specific chats, and an intuitive messenger-style interface. The application is currently available as a time-limited test build for evaluation purposes. This innovation is significant for the AI/ML community as it demonstrates the feasibility of deploying powerful language processing capabilities directly on mobile devices, enhancing privacy and user control. Technical enhancements include faster response times and smoother interactions, with the ability to customize how the model remembers user preferences. Notably, the app requires iOS 17 and a compatible iPhone with at least 6 GB of RAM, underscoring the increasing power of mobile devices to support advanced AI functionalities.