Show HN: Portus, A Rust Based API/AI/MCP Gateway (portus-gateway.dev)

Portus has announced the release of their Rust-based API and AI/MCP Gateway (version 1.6.2), designed to streamline connections between Kubernetes routes, large language model (LLM) providers, and microservices. This experimental update utilizes the newly developed gateway-api-bench methodology for performance benchmarking, achieving an impressive error-free testing result with robust failover capabilities. The architecture allows various AI services to coexist under unified policies while effectively managing requests without holding session states, ensuring high availability and low latency. This release is significant for the AI/ML community as it integrates advanced routing and policy management directly into the gateway, allowing developers to efficiently manage resources and access to AI services. Technical innovations include atomic configuration updates via mTLS gRPC, automated route adjustments based on system performance, and dynamic budget checks for AI usage. By improving upon previous gateway frameworks, Portus offers enhanced performance and reduced memory consumption, as benchmark tests indicate substantial gains over existing solutions. This positions Portus as a leading choice for developers looking to optimize their AI integrations within Kubernetes environments.