360B tokens, 3M customers, 6 engineers (vercel.com)

Durable, an innovative AI business building platform, has made significant strides by launching new production agents that serve approximately 1.1 billion tokens daily. By consolidating their infrastructure into a unified platform on Vercel, the company has reported a remarkable 3-4x reduction in operational costs compared to self-hosting. This transformation allows Durable to streamline operations for over 3 million businesses while removing traditional barriers that hinder entrepreneurship. The significance of this development lies in Durable’s ability to support a diverse array of entrepreneurial endeavors, from seasonal businesses to tech startups, all managed seamlessly through a multi-tenant, AI-powered environment. The challenges of model orchestration, tenant isolation, and economic visibility for usage-based pricing have been successfully addressed with their new architecture, enabling rapid deployment of features within a single day. This consolidation not only enhances user experience but also empowers a lean team of six engineers to deliver ten times the output, exemplifying a new operational model for tech companies in the AI/ML space.