How does AI impact skill formation? (www.seangoedecke.com)

The Anthropic Fellows program recently published a paper titled "How AI Impacts Skill Formation," which investigates the effects of AI on learning new skills, specifically in coding with the Python Trio library. The study divided participants into two groups: one using AI tools and the other coding without AI assistance. Surprisingly, researchers found that while AI users did not complete the tasks faster, they scored lower on retention quizzes, leading some to speculate that reliance on AI could impair cognitive engagement and skill acquisition. However, analysis revealed that many AI users wasted time retyping AI-generated code, skewing results. When excluding these participants, AI users were actually 25% faster, suggesting that improper use of AI tools rather than AI itself might hinder learning. This research is significant for the AI/ML community as it prompts a reevaluation of how AI assists in skill development, especially in professional settings like software engineering. While AI can enhance task completion speed, it raises questions about long-term skill retention and practical knowledge. The findings imply that engineers might need to balance AI use with deliberate practice to prevent skill atrophy. As the AI landscape evolves with new models continuously emerging, understanding these dynamics will be crucial for the future of tech education and professional development.