Study shows AI is as good as human tutoring for GRE learning gains (arxiv.org)

A recent study has demonstrated that artificial intelligence (AI) can deliver learning gains comparable to those achieved through human tutoring, specifically in the context of GRE preparation. Utilizing the newly developed platform, StudentBench, researchers analyzed over 175,000 messages between students and AI tutors, involving 2,383 participants. They found that AI tutoring provided statistically equivalent results to expert human tutoring on GRE performance, with one AI model outperforming humans in five of seven tested domains. Notably, AI tutoring achieved these results at a fraction of the cost—around $0.0052 per percentage point gained, compared to $4.81 for human tutors. This study is significant for the AI/ML community as it not only validates AI's potential in educational contexts but also provides a robust framework for evaluating AI teaching effectiveness. The StudentBench platform enables large-scale data collection, offering insights into AI's capabilities in lesson planning, problem creation, and engagement techniques. The correlation between faster AI responses and improved student engagement further highlights the nuanced advantages AI can provide. This research suggests a promising future for AI in personalized education, making quality tutoring more accessible and affordable.