Firefly Aibox-K3 – An Edge AI Mini PC Powered by SpacemiT K3 RISC-V SoC (www.cnx-software.com)

Firefly has launched the AIBOX-K3, an industrial-grade Edge AI mini PC built on SpacemiT's K3 RISC-V octa-core processor. Notable for its AI prowess, the device delivers up to 60 TOPS of computing performance, making it well-suited for local large language model (LLM) inference and edge AI applications. The specifications include eight RISC-V X100 cores, eight AI-optimized RISC-V A100 cores, and a robust GPU from Imagination Technologies, ensuring smooth execution of complex tasks and video processing capabilities up to 4K resolution. The AIBOX-K3's significance lies in its capacity for multimodal AI acceleration, enabling it to handle large models with up to 30 billion parameters, including advanced Mixture of Experts configurations. It also implements a three-level security architecture to protect against vulnerabilities like Spectre and Meltdown, alongside integrated encryption functionalities. With a starting price of $349, this device not only democratizes access to powerful edge-computing resources but also supports multiple operating systems, encouraging versatility for developers and researchers in the AI/ML community.