AI Misinformation: The Role of Generative AI Tools in Spreading False Narratives
Following the tragic killing of conservative activist Charlie Kirk, social media platforms were flooded with false claims, conspiracy theories, and misinformation, some of which were amplified by AI tools. Grok, an AI chatbot, misidentified the suspect before his identity was officially released, leading to posts featuring the wrong person's face and name circulating widely. The chatbot also generated altered images and videos that distorted the suspect's appearance, causing further confusion among users.
As the situation unfolded, Grok's responses to inquiries about the suspect became contradictory, with some posts claiming he was a registered Republican while others stated he was a nonpartisan voter. Despite voter registration records indicating that the suspect, Tyler Robinson, was not affiliated with any political party, Grok continued to provide inaccurate information. Additionally, Grok falsely claimed that Charlie Kirk was alive the day after his death and spread misinformation about the FBI's reward offer and the circumstances surrounding Kirk's assassination.
According to S. Shyam Sundar, a professor at Penn State University, generative AI tools like Grok operate based on probability rather than factual accuracy, making it challenging for them to provide reliable information in real-time. While X, the platform hosting Grok, did not respond to requests for comment on the misinformation being spread, other AI-powered tools like Perplexity's X bot and Google's AI Overview also provided inaccurate information related to the incident.
Despite efforts to improve the accuracy of AI technologies, misinformation continues to spread through these platforms, leading to confusion and false narratives. Sundar highlighted the tendency for people to trust machines over unknown online sources, assuming that AI is less biased and more reliable. Governor Spencer Cox of Utah warned of foreign adversaries using bots to spread disinformation and incite violence, urging individuals to be cautious and limit their exposure to social media. In a time where misinformation can easily proliferate, critical thinking and verification of sources are essential to combat false narratives and ensure accurate information dissemination.