Promises Are Cheap (garymarcus.substack.com)

Microsoft's AI CEO has recently made sweeping promises about advancements in AI, following a trend set by industry leaders like Elon Musk. However, this enthusiasm overlooks ongoing challenges with large language models (LLMs), particularly their propensity for "hallucinations," which are serious errors in reasoning. A recent report highlights a troubling increase in documented cases of these hallucinations, particularly among legal professionals, growing from 112 to 914 in under a year. This raises significant questions about the reliability of AI in critical fields, such as law and accounting, where accurate reasoning is paramount. The article criticizes the tech industry's culture of overpromising and underdelivering, emphasizing that such proclamations often thrive in media narratives without sufficient skepticism. This trend can mislead the public and stakeholders about the capabilities of AI technology, potentially leading to disillusionment if expectations are not met. The piece calls for greater accountability and independent scrutiny of these inflated claims, suggesting that the unchecked enthusiasm for AI may result in a significant collapse in public trust if the technology fails to fulfill its lofty promises.