Apple's Foundation Models can now use third-party LLMs (Claude, Gemini) [video] (developer.apple.com)

Apple has announced significant updates to its Foundation Models framework, allowing developers to integrate third-party language models such as Claude and Gemini alongside its own offerings. This expansion aims to foster greater flexibility and creativity within AI applications by providing developers with the tools to leverage a diverse array of models, including an enhanced on-device model and the new Private Cloud Compute option, which features a more substantial context window and advanced reasoning capabilities. The implications for the AI/ML community are profound, as this update not only supports a wider range of applications but also democratizes access to cutting-edge AI technologies by open-sourcing the framework. New features such as dynamic profiles enable developers to create more interactive and adaptable AI experiences, while built-in tools for optical character recognition and barcode reading enhance the framework’s utility. Additionally, the seamless integration of various models and APIs simplifies the development process, allowing for innovative applications that can respond intelligently to visual and contextual information, marking a notable advancement in Apple's approach to AI in consumer technology.