LM Studio 0.4.0 (lmstudio.ai)

LM Studio has announced the release of LM Studio 0.4.0, a significant update featuring several enhancements aimed at improving performance and usability in AI model deployment. Key highlights include the introduction of "llmster," a server-native daemon that allows headless deployments without a GUI, which can run independently on various platforms like Linux, cloud servers, or even in Google Colab. Additionally, the update offers a new stateful REST API that supports simultaneous inference requests, greatly enhancing throughput and efficiency in handling multiple requests concurrently. The updated system enables developers to utilize models via a new chat endpoint, `/v1/chat`, which supports ongoing conversations through response identifiers, promoting multi-step workflows. Alongside technical upgrades, LM Studio's interface has received a complete overhaul, enhancing user experience, and features new functionalities for exporting chats and a refined command-line interface for improved interaction. This release aims to streamline the development process for AI applications, providing greater flexibility and robust performance for developers working with machine learning models.