StrongDM's AI team build serious software without even looking at the code (simonwillison.net)

StrongDM's AI team has unveiled an innovative approach to software development that relies entirely on coding agents, allowing the creation of functional software without human oversight. This "Dark Factory" model eliminates human-written code and reviews, instead utilizing specifications and scenarios to guide agents in writing, testing, and refining code autonomously. This paradigm shift is significant for the AI/ML community as it represents a radical step away from traditional coding practices, raising questions about the validity and reliability of software generated without human intervention, especially given the known weaknesses of large language models (LLMs). Key to StrongDM's strategy is the concept of a "Digital Twin Universe," where they replicate APIs of existing services, allowing extensive testing without the limitations of live environments. By using scenario testing to validate performance—rather than relying solely on passed tests—they aim to measure how well the software meets real-world requirements. This approach not only enhances testing efficiency but also demonstrates the potential of AI-driven coding tools to disrupt conventional software development methods. With notable tools like Attractor and CXDB being released, StrongDM is at the forefront of a future where software engineers devolve from coding to overseeing complex automated systems that generate code.