Phlox-GW – A new open-source LLM gateway with free enterprise features (robert-mcdermott.medium.com)

The Phlox-GW LLM Gateway has been launched as a new open-source solution designed to deliver enterprise-level features without associated costs. Unlike many existing gateways that lock crucial functionalities behind a paywall, Phlox-GW maintains a fully free model, offering features such as cost tracking for user and departmental budgets, single sign-on (SSO) support, auditing, and privacy controls like PII redaction. This gateway allows organizations to manage shared LLM infrastructure seamlessly across multiple model providers, enabling integration with various clients like Claude Code while maintaining operational control. This development is significant for the AI/ML community, as it democratizes access to advanced LLM capabilities, promoting equitable use across teams and organizations regardless of budget constraints. Phlox-GW supports high availability and scalability through horizontal clustering with PostgreSQL, and it provides a comprehensive dashboard for monitoring metrics, costs, and user activity. Additionally, thanks to its simplified deployment—available as a single binary for macOS, Linux, and Windows—developers can easily implement and experiment with the gateway in various environments, fostering innovation and experimentation within the AI space.