PS5LM: Llama.cpp on a jailbroken PS5, run any GGUF model natively on the console (github.com)

A new project called PS5LM has emerged, enabling users to run GGUF language models natively on a jailbroken PlayStation 5, utilizing its Zen 2 CPU and GPU capabilities. With the initial release, users can download and operate smaller models directly through the console’s browser. The first target is the Qwen 3.8 model, notable for its advanced hybrid Gated DeltaNet attention architecture. This opens up new avenues for hobbyists and researchers to leverage the PS5 for AI experiments, providing a unique platform for testing and development in the AI/ML community. The significance of PS5LM lies in its ability to capitalize on the powerful hardware of the PS5 for machine learning applications, breaking traditional barriers of model deployment. The software supports various architectures and quantizations, accommodating models ranging from 1-bit to 8-bit, albeit with current limitations on memory capacity for larger models. This innovative approach not only broadens access to language model experimentation but also fosters ongoing discussions about the potential of gaming consoles as viable platforms for AI workloads. The project remains independent of Sony but showcases a new method of working with advanced machine learning models on consumer hardware.