Terms of (Ab)Use: An Analysis of GenAI Services [pdf] (arxiv.org)

A recent paper titled "Terms of (Ab)Use: An Analysis of GenAI Services" highlights significant concerns regarding the terms of service associated with generative AI platforms like ChatGPT and Gemini. The study evaluates the terms of six major generative AI services from the perspective of EU consumers, revealing that users often face unclear legal agreements that carry potential risks. Key findings indicate that these terms often disregard assurances about service quality and place sole responsibility for compliance on users, despite them lacking insight into the underlying model operation. This results in a considerable power imbalance and imposes responsibilities on consumers that are nearly impossible to fulfill without violating the terms. The implications of these findings are profound for the AI/ML community, as they underscore critical issues surrounding user data use, accountability, and consumer rights. The researchers argue for urgent updates to consumer protection laws to address these challenges, advocating for greater transparency and fairness in generative AI services. As generative AI technologies continue to proliferate, ensuring that users are adequately informed and protected becomes a crucial priority for both service providers and policymakers alike.