JetBrains's KotlinLLM is going open source (blog.jetbrains.com)

JetBrains has announced that KotlinLLM, an innovative IntelliJ IDEA plugin, is now open source, designed to enhance Kotlin/JVM projects by allowing direct delegation of runtime logic to a large language model (LLM). By introducing "Smart macros," developers can write explicit Kotlin calls that generate source code tailored to the application's runtime conditions, rather than relying on external LLM calls for every invocation, which can be slow, costly, and complicate testing. The inclusion of two primary macros—`asLlm<F, T>` and `mockLlm<T>()`—enables effective parsing of unstructured data and the creation of mock implementations without manual coding. This move is significant for the AI/ML community as it shifts the paradigm of using LLMs from a development-only tool to a viable option for runtime application logic in a compiled, statically typed environment. KotlinLLM addresses previous limitations found in similar frameworks targeted at interpreted languages like Python, promising a persistent and portable approach to integrating AI features within Kotlin applications. With practical testing confirming its efficacy in real-world scenarios—handling GitHub issue data and evolving application logic seamlessly—KotlinLLM opens new avenues for AI-driven software development, inviting community feedback and contributions as it evolves.