Show HN: Human Benchmark – Compare your reasoning skills against AI models (robinshields.github.io)

A new app called Human Benchmark has been launched, allowing users to compare their reasoning skills against AI models. This innovative tool employs a Rasch model to generate a percentage score from a small set of questions, providing results with a 95% confidence range that narrows as users answer more questions. While the app is designed to illustrate how large language models (LLMs) can be benchmarked in a human context, it is emphasized that this is a proof of concept rather than a definitive evaluation of reasoning or intelligence, with limited psychometric validity. The significance of this tool for the AI/ML community lies in its potential to explore the comparative reasoning abilities between humans and AI systems in an interactive setting. By presenting an approachable framework for understanding LLM performance against human benchmarks, it invites further discussions on the development and evaluation of cognitive capabilities in artificial intelligence. However, users should approach the results with caution, recognizing the preliminary nature of the app and the margins of error indicated by overlapping confidence ranges.