Murati's Thinking Machines Releases Open-Weights 975B Parameter LLM (thinkingmachines.ai)

Murati's Thinking Machines has unveiled an impressive new open-weight language model, Inkling, boasting 975 billion parameters—41 billion of which are actively engaged. This cutting-edge model is designed to operate across multiple modalities, handling text, images, and audio input, and features a context window capable of processing up to 1 million tokens. The model's architecture, based on a Mixture of Experts approach, enables it to deliver strong performance in general intelligence tasks, including knowledge, mathematics, and science, while also excelling at coding and utilizing various tools. The significance of Inkling lies in its openness and flexibility, allowing users to fine-tune the model for specific domains via the Tinker training platform. Moreover, its ability to provide well-calibrated predictions and confidently follow complex, multi-step instructions positions it as a versatile tool for researchers and developers in the AI/ML community. With controllable processing effort to balance speed and performance, Inkling represents a substantial advancement in the development of generalist AI models, promoting broader accessibility and experimentation in machine learning applications.