Show HN: Airena – Client-side arena for comparing AI models across 68 providers (github.com)

Airena has launched an open-source platform that allows users to compare AI models from over 68 providers, including industry giants like OpenAI, Google, and Mistral. With more than 1000 models available, this client-side tool enhances model benchmarking by enabling users to run prompts simultaneously and evaluate performance metrics, speed, and output quality. Airena's unique client-side architecture ensures enhanced privacy as it routes API keys and prompts directly from the user’s browser to the AI providers without involving a backend server. This tool is significant for the AI/ML community as it democratizes access to a wide range of models and facilitates real-time comparisons across various deployment contexts. Users can assess the same model across different providers for latency and token speed or pit different models against each other. The platform also supports local inference servers, offering flexibility for developers and researchers. Built on reliable open-source components like the Vercel AI SDK and models.dev, Airena presents an innovative way for stakeholders to leverage AI technologies while retaining control over their data and usage contexts.