Running the unmodified Linux amdgpu driver on an iPad (github.com)

LemonSeed Studio has introduced an innovative application for iPad that enables on-device inference of large language models (LLMs) using AMD GPUs. This single app integrates the unmodified Linux amdgpu driver and amdkfd, packaged as a PCIDriverKit extension, allowing the iPad to harness the power of a Thunderbolt-connected AMD GPU. The inclusion of the LemonSeed Engine facilitates GPU-based inference through its HSA runtime, making it a significant step towards enhancing mobile computational capabilities for AI tasks. This development is particularly noteworthy for the AI/ML community as it breaks barriers by bringing high-performance computing resources traditionally found in desktops and servers to mobile devices. By leveraging the existing AMD GPU infrastructure, LemonSeed Studio opens opportunities for developers to run complex AI applications directly on iPads. The application also features live GPU telemetry via amdgpu_mtopg, ensuring users can monitor performance metrics effectively. This innovation could lead to new workflows in AI development, particularly in areas needing greater mobility and efficiency.