I built a tool to benchmark my AI agent's API costs (local001.com)

A new tool has been launched by Local 001, dubbed "A levels.fyi for AI agent API spend," aimed at helping users benchmark their API costs associated with AI agents. This platform allows users to submit their spending data in exchange for insights like percentile rankings, comparisons against other agents, and detailed breakdowns of use cases. By encouraging users to share their data, the tool creates a collaborative environment where individuals can better understand their API expenditures and collectively negotiate for more favorable rates. This development is significant for the AI/ML community as it addresses growing concerns around the rising costs associated with using AI APIs from major providers such as OpenAI, Anthropic, and Google. With the ability to estimate and report spending through a simple guide, users can make informed decisions about their AI strategies. The tool not only democratizes access to critical cost data but also fosters a community-driven approach to bulk pricing, ultimately enabling users to capitalize on collective purchasing power in a competitive market.