„We all leave digital footprints on the internet" (www.mpg.de)

In a recent interview, Prof. Carmela Troncoso raised concerns about the use of AI surveillance technology in the U.S. and Germany, specifically highlighting the Palantir software known as Eclipse, employed by U.S. Immigration and Customs Enforcement (ICE). The app utilizes a vast array of public and private data to generate a probability score indicating whether individuals might be undocumented migrants. This method diverges from traditional law enforcement practices by allowing targeted surveillance without prior identification of suspects, posing significant risks of wrongful targeting driven by opaque algorithms. Troncoso points out that this lack of transparency raises ethical questions about the decisions made by such AI systems, particularly when human lives are at stake. While the implementation of a similar system in Germany would face legal hurdles due to stricter data protection laws, the potential for damaging applications remains. Troncoso warns that even if less comprehensive data is used, digital footprints could still be misused for profiling individuals. She contrasts Eclipse with Vera, another Palantir product used by German police, noting that while Vera relies on police records, both systems suffer from potential biases and privacy concerns. Troncoso argues for stronger data protection measures to counter both governmental and corporate misuse, emphasizing the urgent need to address these issues as AI technologies evolve.