AI Can Be Used for Cognitive Warfare (thecarrierwave.substack.com)

The Chinese government has expressed significant concern over the potential use of artificial intelligence (AI) in "cognitive warfare," fearing that adversaries could exploit generative AI technologies like deepfakes and AI-generated content to manipulate public opinion and undermine the Communist Party's control. State security minister Chen Yixin highlighted the threat posed by hostile entities using AI to fabricate political narratives, disseminate disinformation, and incite societal division, which could jeopardize national stability and ideological security. This acknowledgment of AI's role in cognitive warfare is significant for the AI/ML community as it underscores the need for ethical considerations and countermeasures in the deployment of AI technologies. The concept of "Repeater Bias," which asserts that repeated exposure to false statements can alter public perception, raises alarm about the implications of deploying AI bots to perpetuate misleading information at scale. As states leverage AI to amplify narratives, the risk increases that public trust in social media and digital platforms could deteriorate, leading to challenges in discerning fact from fiction. This evolving landscape highlights the urgency for robust frameworks to identify and combat disinformation while maintaining the integrity of online discourse.