Otari: Own Your AI Stack (blog.mozilla.ai)

Otari has launched an open-source LLM gateway, designed to bridge the gap between closed-source AI stacks and open-weights models. This platform allows users to harness any AI model—whether frontier or open-source—through a seamless integration that preserves essential developer experiences and capabilities while enhancing privacy and cost-effectiveness. By offering capabilities like user management, provider key handling, real-time usage tracking, and a suite of advanced tools (such as server-side code execution, real-time web search, and multimodal processing), Otari ensures that the transition from a proprietary to an open-source model does not lead to a loss in functionality. The significance of Otari lies in its approach to making open-weight models a genuine competitor to closed-source options, equipping developers with the same operational comfort and integrations they expect from larger providers. The platform supports multi-tenancy and granular budgeting, allowing teams to govern their AI resources effectively, while observability tools provide real-time insights into usage and costs. In summary, Otari represents a pivotal step forward for the AI/ML community by facilitating a robust and flexible ecosystem that prioritizes user control and versatility in model selection.