LiteLLM (YC W23): Founding Reliability Engineer – $200K-$270K and 0.5-1.0% equity (www.ycombinator.com)

LiteLLM, an open-source AI gateway with over 36,000 GitHub stars, is seeking its first dedicated reliability engineer to maintain the stability and performance of its critical infrastructure. The company, which currently supports high-profile clients like NASA, Adobe, and Netflix, processes hundreds of millions of API calls daily and is growing rapidly with an annual revenue of $7 million. This role is crucial; when LiteLLM experiences downtime, the entire AI operations of its clients can be disrupted. The engineer will be responsible for both operational reliability (60%) and performance engineering (40%), tackling complex challenges such as memory management in Python services, optimizing database interactions, and improving the responsiveness of the proxy under heavy load. This position is significant for the AI/ML community due to its impact on the reliability of widely-used AI tools and systems. The engineer will address intricate technical issues like memory leaks and latency degradation, while also enhancing operational practices such as structured logging and automated rollbacks. Given the responsibilities and the potential to shape the reliability framework from scratch, this opportunity offers both visibility in the open-source community and a chance to significantly influence the infrastructure that supports major AI deployments globally.