KPMG pulls report on AI usage due to apparent hallucinations (techcrunch.com)

KPMG has retracted its report titled “Redefining excellence in the age of agentic AI” due to widespread inaccuracies regarding the AI usage claims made about several organizations. This decision follows findings from research group GPTZero, which indicated that the discrepancies resulted from AI hallucinations—errors produced when AI generates content that is not factually accurate. Major entities like UBS, the UK’s National Health Service, Swiss Federal Railways, and Transport for London contested the report's assertions, describing them as misleading or entirely false. This incident is significant for the AI/ML community, highlighting the potential pitfalls of relying on AI-generated content without sufficient human oversight. KPMG emphasized the importance of adhering to guidelines for responsible AI use, stating the need for human validation of AI outputs. The occurrence mirrors similar issues faced by other firms, such as EY, which recently withdrew a report due to fabricated references. This trend underlines the ongoing challenges in ensuring the accuracy and reliability of AI-generated materials.