Show HN: AI SRE Arena, an Open Benchmark for AI SRE Agents on Kubernetes (github.com)

A new open benchmark, AI SRE Arena, has been launched to evaluate AI Site Reliability Engineering (SRE) agents on Kubernetes. Designed as a vendor-neutral framework, it enables users to deploy a temporary Kubernetes cluster, inject faults, and analyze investigation results through a configurable judging system. The platform supports Python 3.10+ and works with local clusters created via Docker or AWS EKS, offering flexibility in choosing from a comprehensive suite of investigation scenarios. This initiative is significant for the AI/ML community as it establishes a standardized method to benchmark the efficacy of various AI tools in incident detection and root cause analysis. In testing, Edge Delta's native investigations were able to detect and analyze 85.7% of the scenarios compared to 57.1% for Grafana, showcasing the performance differences among AI tools. The incorporation of AI models for scoring, including GPT-6-Astra, provides a structured way to evaluate SRE responses, thus driving advancements in AI SRE methodologies and improving reliability in Kubernetes environments.