Show HN: GemmaTrans – On-device translation for macOS, built with MLX (github.com)

GemmaTrans has launched an innovative on-device translation tool for macOS, leveraging Apple’s MLX-Swift framework for optimized performance on Apple Silicon. This application supports offline translation using models like Google’s Gemma 4 and Tencent's Hy-MT2, providing users with privacy without needing an internet connection. With features like an easy HTTP API interface for third-party tools, automatic language detection, and multiple model options, it presents a flexible and efficient solution for users needing real-time translation. This development is significant for the AI/ML community, as it demonstrates the growing trend of localized AI solutions that prioritize user data security and performance. The application’s architecture allows for seamless model management, including downloading, switching, and removal, along with real-time performance metrics regarding translation speeds. The use of advanced techniques like token-rate monitoring and stream processing adds to its robustness, indicating a shift towards more interactive and high-performance applications in machine learning translation technologies.