llms .py – Extensible OSS ChatGPT UI, RAG, Tool Calling, Image/Audio Gen (llmspy.org)

The recent v3 release of llms.py introduces a highly extensible open-source ChatGPT UI that enhances user experience and expands support for over 530 language models from 24 providers. Key features include a redesigned model selector for easier search and filtering, a flexible plugin architecture for custom extensions, and advanced capabilities for RAG (Retrieval-Augmented Generation) workflows, allowing users to manage document uploads and utilize Gemini's File Search Stores seamlessly. Additionally, first-class support for Python function calling enables local environment interactions, making it easier for developers to integrate custom functionalities. This significant update empowers the AI/ML community by providing a robust framework for model discovery and application customization. The emphasis on extensibility allows for rapid feature development and community contributions, paving the way for innovative use cases and tailored solutions. With features like the ability to execute code in various programming languages, support for generating images and audio, and a streamlined SQLite database for effective data management, llms.py v3 positions itself as a comprehensive tool for developers looking to leverage AI technologies efficiently and creatively.