Show HN: SayItFlow – On-device Mac dictation that unloads models when idle (github.com)

SayItFlow has launched a groundbreaking on-device dictation tool for macOS, allowing users to engage in push-to-talk voice dictation without relying on cloud services. By holding a key to speak and releasing it to populate text, SayItFlow utilizes the Desert Ant Voz model optimized for the Apple Neural Engine, providing immediate text outputs in any application. A standout feature is its intelligent model unloading capability; after two minutes of inactivity, it reduces resource usage to a mere 15–30 MB of RAM and consumes 0% CPU/GPU, which preserves battery life and maintains device performance. This innovation is significant for the AI/ML community as it emphasizes privacy and efficiency by keeping all voice data on the device and ensuring minimal resource strain when not in use. SayItFlow supports multilingual dictation in 25 languages and employs advanced processing to enhance the clarity of spoken English, such as removing fillers and correcting punctuation. Designed for macOS 14.0+ and optimized for Apple Silicon, this tool signifies a step forward in accessible, efficient voice interactions, enabling a seamless experience for users who prefer local processing without compromising on speed or privacy.