Show HN: Otari: your open-source LLM control plane (github.com)

Otari, a new open-source platform for managing large language models (LLMs), has been launched, offering users a self-hosted, OpenAI-compatible gateway to over 40 different LLM providers. This innovative control plane allows developers to consolidate API calls through a single endpoint while managing provider credentials, enforcing budgets, and tracking usage in one secure environment. Users can either run Otari locally or utilize a hosted version on otari.ai, ensuring that sensitive data remains under their control. The significance of Otari lies in its potential to simplify the integration and management of multiple LLMs, which is crucial as businesses increasingly adopt AI technologies. By allowing users to set budgets before requests are executed, Otari helps mitigate unforeseen costs. Additionally, built-in tools provide robust usage tracking and guardrails for safeguarding against inappropriate model outputs. This comprehensive management solution aids developers in navigating the complexities of multiple LLM interactions while maintaining compliance and security, making it a valuable resource for the AI/ML community.