AI Engineering from Scratch (aiengineeringfromscratch.com)

A new educational initiative called "AI Engineering from Scratch" has been launched, featuring a comprehensive curriculum with 416 lessons across 20 phases. This program emphasizes a deep understanding of AI algorithms by building them from fundamental mathematical concepts before any frameworks like PyTorch are introduced. This approach aims to address the fragmented learning typical in AI education, allowing students to grasp not only how to implement models but also the underlying theories, enhancing their ability to explain aspects like loss curves and attention mechanisms. Significantly, this open-source curriculum is entirely free and designed to be run on personal machines, making it accessible to a wide audience. It encompasses a range of programming languages, including Python, TypeScript, Rust, and Julia, and covers topics from linear algebra to autonomous swarms. The structure of the lessons encourages hands-on learning through a clear methodology: problem identification, mathematical derivation, coding, testing, and artifact preservation. Additionally, the curriculum supports the development of AI agents with persistent memory and reasoning capabilities through three linked repositories that facilitate the creation of a robust agent architecture.