Show HN: Lightport – open-source AI gateway (www.npmjs.com)

Lightport, a newly announced open-source AI gateway, aims to streamline interaction with various language model (LLM) providers by making them compatible with OpenAI's API. This lightweight tool functions by accepting API requests in the OpenAI format, transforming them for the designated provider, and relaying the responses back. Supported endpoints include standard OpenAI-like routes such as POST /v1/chat/completions and POST /v1/completions. Currently, Lightport is compatible with a diverse array of 77 providers, including OpenAI, Anthropic, Google Gemini, and Azure OpenAI, making it a versatile option for developers. The significance of Lightport lies in its focused approach to bridging the gap between OpenAI-like requests and various LLM providers without adding complex features like caching or retries, which can complicate integration at lower levels. By serving only as a transformation layer, it allows higher-level services, such as Glama, to manage operational concerns while maintaining a lightweight footprint. As a fork of the Portkey AI Gateway, Lightport emphasizes simplicity, along with active maintenance and bug fixes, creating a specialized tool that can drive faster development and deployment of AI applications across multiple platforms.