What Is Software, and Will LLMs Replace It? (tomassetti.me)

Recent discussions around the role of Large Language Models (LLMs) in software raise an intriguing question: will LLMs replace traditional software? While LLMs have proven their utility in generating content and providing flexible interfaces, experts argue that they cannot fully replace the structured, reliable functions of traditional software. Key software systems, like CRMs, excel by organizing data, enforcing consistency, enabling visualizations, and guiding processes through well-defined rules. These elements ensure data integrity and allow for complex queries, which LLMs alone cannot replicate due to their lack of structured data management and schema enforcement. Significantly, the emergence of protocols like the Model Context Protocol (MCP) indicates a new trend where software is not being replaced but rather enhanced by LLM capabilities. Companies are integrating LLMs into existing databases to maintain the necessary structure while providing a more user-friendly interface for non-technical users. This hybrid approach acknowledges that while LLMs provide valuable flexibility, the underlying deterministic software remains essential for maintaining data accuracy and processes. Ultimately, software will evolve to front LLMs, creating systems where structured data and conversational interfaces coexist, enhancing accessibility while ensuring reliability.