Show HN: Routiium – self-hosted LLM gateway with a tool-result guard (github.com)

Routiium has launched a self-hosted, OpenAI-compatible Language Model (LLM) gateway designed to enhance application security and functionality when interfacing with multiple model providers. This significant development allows developers to manage API keys, enforce policy routing, and implement request-level safety checks without altering their existing client SDKs. Routiium features tools like built-in analytics, a safety judge, strict rate limits, and multiple operational modes, ensuring a robust defense against issues like prompt injections while maintaining ease of use. For the AI/ML community, Routiium's introduction is critical as it streamlines the integration of different LLMs, including OpenAI, AWS Bedrock, and others, providing a centralized point for managing model interactions. It supports features such as safe response guards, automatic routing based on request types, and the ability to define custom policies that enhance compliance and security. Furthermore, Routiium's ability to run in managed or passthrough modes adds flexibility for developers, enabling them to either issue their own API keys or pass tokens directly to upstream service providers, making it an essential tool for building secure AI-driven applications.