Measure how engineers and teams work with AI (www.eversynced.com)

Eversynced has launched an open-source AI telemetry tool named Pheebs, designed to measure how engineers and teams interact with AI coding agents like Claude Code, Cursor, and Codex. Pheebs operates discreetly by capturing lightweight interaction signals from AI sessions, without storing the content of prompts. This tool highlights significant concerns, such as the $9,960 spent last month on larger models than necessary, and alarming statistics indicating that 61% of AI-written lines in critical services were deployed without proper verification, leading to potential risks in software quality. The significance of Pheebs lies in its ability to provide teams with insights into their AI usage and performance, turning raw interaction data into actionable metrics. Key features include tracking verification coverage, pushback rates against AI output, and modeling fit rates, helping teams identify inefficiencies and areas needing improvements. By enabling a deeper understanding of AI's role in the engineering process, Pheebs aims to improve the relationship between humans and AI, ensuring that teams can effectively leverage AI capabilities while maintaining high-quality standards in software development.