Former Uber self-driving chief says crashing his Tesla in FSD exposed this big risk with AI (www.businessinsider.com)

Raffi Krikorian, former head of Uber's self-driving division, shared a cautionary tale in The Atlantic after his Tesla crashed while in Full Self-Driving (FSD) mode, ultimately leading to the vehicle being totaled. Despite his extensive experience with autonomous vehicle technology, Krikorian found himself overtrusting the AI capabilities, resulting in a jarring lesson on the dangers of this reliance. He emphasized that while modern driver-assist systems like Tesla's FSD can navigate numerous driving scenarios effectively, they are not foolproof, requiring constant human oversight. This incident is significant for the AI and machine learning community, shedding light on the psychological and technical challenges of human-AI interaction. Krikorian's experience underscores the reality that while AI systems may appear to operate nearly perfectly, the boundary between safety and failure is perilously thin. As incidents involving FSD and other automated driving technologies continue to surface, the discourse around the responsible deployment of such systems and the inherent risks of complacency becomes increasingly urgent, echoing broader concerns about AI oversight in everyday applications.