Show HN: Strudel – Generate commit messages via Apple's on-device LLM (github.com)

A new tool called Strudel has emerged, enabling developers to generate commit messages using Apple's on-device language model. Notably, Strudel operates without the need for API keys or cloud connectivity, ensuring that all data remains securely on the user's Mac. This self-contained approach promotes privacy and data integrity, allowing developers to streamline their workflow without compromising security. This tool is significant for the AI/ML community as it showcases the potential of leveraging on-device machine learning capabilities for practical programming tasks. Strudel incorporates several technical features: it supports different tiers of diff management, such as sending small diffs as-is or compressing medium diffs for improved readability. For larger diffs, a per-file map-reduce approach is utilized. Additionally, developers can generate multiple commit message options and choose the most appropriate one, enhancing customization and efficiency in version control processes. This innovation could greatly improve coding productivity, especially in collaborative environments where clear commit messages are vital.