AMD Boosting AI/LLM Performance for Radeon iGPUs as Much as 18~23% with Linux7.4 (www.phoronix.com)

AMD has announced a significant performance enhancement for its Radeon integrated graphics processors (iGPUs) in the upcoming Linux 7.4 release, with improvements in AI and large language model (LLM) processing capabilities estimated between 18% to 23%. This upgrade is part of the new AMD PerfOpt feature, which leverages the AMD I/O Virtualization Technology to optimize direct memory access by bypassing the IOMMU overhead. As a result, this change is particularly beneficial for users with lower-end AMD Ryzen hardware, making advanced AI functionalities more accessible. The PerfOpt feature will be automatically enabled for integrated graphics setups using the AMDGPU driver in the Linux 7.4 kernel. Preliminary testing has shown promising results using local AI servers with back-ends like Llama.cpp, indicating that the optimization significantly enhances inferencing performance. As Linux 7.4 approaches its stable release by year's end, this advancement positions AMD as a frontrunner in optimizing AI workloads, with expectations that this kernel may become a long-term support (LTS) version due to its robustness and performance improvements. Further benchmarking is anticipated in the lead-up to the official release.