What if I told you that the next viral story you see online could be completely fake—created by AI, spreading like wildfire, and designed to manipulate public opinion? AI-generated misinformation is already infiltrating social media, blurring the line between fact and fiction.
Welcome to The AI Six Podcast. Today, I’m breaking down how AI is fuelling the misinformation crisis, the dangers it poses, and what we can do about it.
If we thought we had a problem with fake news before, well we have a big problem now with fake news created by AI.
AI-generated misinformation is a growing threat, spreading quickly, appearing highly convincing, and influencing everything from politics to public trust.
- Speed & Scale – AI rapidly creates deepfakes, synthetic news, and misleading images, shaping narratives before fact-checkers intervene.
- Convincing & Hard to Detect – AI mimics human language, generates realistic voices, and produces deepfakes indistinguishable from reality.
- Political & Social Manipulation – AI-driven misinformation is already influencing elections and fuelling societal divisions.
- Public Distrust – Widespread AI misinformation erodes trust in legitimate sources, weakening institutions and decision-making.
- Financial & Reputational Damage – Businesses and individuals face risks from fake endorsements, AI-generated scandals, and manipulated financial news.
- Regulation & Ethics Gap – AI evolves faster than regulations, leaving platforms struggling to moderate misinformation effectively.
An article by Jieun Shin, Assistant Professor of Media Production, Management, and Technology at the College of Journalism and Communications at the University of Florida makes for fascinating reading.
Five takeaways from her AI and Misinformation Report
- AI exacerbates misinformation: AI tools make it easier to create fake images and news that are hard to distinguish from accurate information. This can be used to spread propaganda in various contexts, from elections to wars.
- Increase in AI-enabled fake news sites: NewsGuard reported a tenfold increase in AI-enabled fake news sites in 2023, often operating with little to no human supervision.
- Fighting back with AI and media literacy: Researchers, tech companies, and governments are collaborating to fight AI-powered misinformation using AI technology. This includes partnerships with fact-checkers and content moderators to tag fake information.
- Importance of media literacy: Media literacy is increasingly important, emphasizing critical skills and mindsets for navigating the digital space. It helps people spot fake imagery and track down the original source of questionable information.
- Efficacy of media literacy skills: Research shows that media literacy skills are effective in helping Internet users process information critically and make informed decisions. Journalists and news media play a significant role in bridging the gap between the digitally literate and illiterate.
But what are the main sources of AI misinformation?
- Generative AI Tools – Chatbots and LLMs produce synthetic content, from deepfakes to counterfeit news.
- AI-Generated Fake News Sites – These operate with minimal human oversight, making false information look credible.
- AI Hallucinations – When AI models generate incorrect information by piecing together unrelated data.
- Malicious Actors – AI makes it easier for bad actors to spread disinformation without technical expertise.
AI misinformation is no longer a future concern—it’s happening now. Combatting it requires a mix of regulation, technology, and education.
f you want to stay ahead in AI marketing then why not check out my Professional Diploma in AI for Marketers or hire me to deliver an in-company workshop. Use code AISIX10 for an exclusive discount!
About the Podcast Host
Joanne Sweeney is a specialist in public-sector marketing and digital communications. She’s the author of Public Sector Marketing Pro and the creator of the Professional Diploma in AI for Public Sector Marketing. With years of experience training, consulting, and advocating for digital transformation, Joanne provides insight and guidance for government agencies navigating the digital landscape. She is also the host of the award-winning Public Sector Marketing Show podcast.
