What makes knowledge valuable when AI can generate polished content in seconds? In this episode, I explore the four levels of knowledge in the AI age and why not all AI-generated information carries equal weight. Provenance, expertise and original evidence matter more than ever.
Why the Four Levels of Knowledge Matter Right Now
AI can draft an article, summarise a report or write a policy brief faster than any human. But speed and polish are not the same as reliability. Here is how I break down the four levels of knowledge in the AI age — and why the distinctions matter for public sector communicators.
Level 1: Generated Content
This is where generative AI truly excels. Give it a prompt and it delivers an article, an email or a social post in seconds. The value is speed, scale and low cost. But fluency is not evidence. Something can sound completely informed without being accurate, original or properly sourced.
Level 2: Aggregated Content
This is AI collecting from multiple sources to produce a summary or synthesis — and honestly, it is something I use regularly myself. But aggregation inherits the strengths and weaknesses of its sources. If those sources are inaccurate or misleading, AI aggregates those problems just as efficiently. Researchers affiliated with Swedish universities examined questionable research papers on Google Scholar, retrieving 227 papers and classifying 139 as showing suspected deceptive or undeclared use of generative AI. That is a striking finding. Papers can have formal titles, citations and the language of scholarship while still containing unreliable material.
Level 3: Authoritative Editorial Content
This is content that has been evaluated, checked and placed in context by people with identifiable expertise and accountability. Think edited news investigations, official statistical publications or properly reviewed research. The value is not just in the words — it comes from the process behind them:
- Who wrote it?
- What evidence did they examine?
- Who reviewed it?
- How were conflicts of interest managed?
- Is the information kept up to date?
UpToDate Expert AI is a useful example here. Doctors can ask clinical questions in natural language, but the system is grounded in a knowledge base developed with contributions from more than 7,600 clinicians. The AI interface does not create the authority — the clinical evidence and editorial accountability that existed before the chatbot was added does.
Level 4: Original Knowledge
This is the most valuable level, because it establishes something that was not previously known or understood. It might come from a journalist running an investigation, a scientist conducting an experiment, or a professional documenting insight from direct experience. AI can support this work — analysing data, identifying patterns — but it cannot interview someone it has not spoken to, observe an event it did not witness, or produce reliable experimental findings without an actual experiment. Original evidence is irreplaceable.
What This Means for Public Sector Organisations
The appearance of authority is becoming easier to manufacture. One documented case involved computer scientist Diomidis Spinellis, who discovered an article had been published under his name and university affiliation without his knowledge. A later study of the journal involved found widespread signs of AI-generated material and false authorship attribution. We need to look beyond the AI interface and invest in the research, evidence, experience and accountable editorial processes that make answers worth trusting.
Â
If you want to build your AI literacy and skills, I can help
Grab AI Playbook on Amazon, the perfect podcast companion.
Subscribe to Human in the Loop, my LinkedIn Newsletter
Take the CPD Accredited AI Playbook Diploma
Book a call at digitaltraining.ie
Key Statistics
– Researchers retrieved 227 questionable research papers from Google Scholar and classified 139 as showing suspected deceptive or undeclared use of generative AI.
– UpToDate Expert AI is grounded in a clinical knowledge base developed with contributions from more than 7,600 clinicians.
Citations and Further Reading
- GPT-fabricated scientific papers on Google Scholar, Harvard Kennedy School Misinformation Review.
- Case study of a fabricated AI-generated scientific paper, International Journal for Educational Integrity.
- Wolters Kluwer: UpToDate Expert AI, official product information.
- Inside Higher Ed: Threats to academic freedom and university autonomy.
- UNESCO: The dangers of science decoupling.
- Reuters: WikiHow sues OpenAI over alleged use of instructional content.
About the Podcast Host
AI and Communications Specialist | Author | Podcaster | International Speaker
Joanne Sweeney is a recognised leader in digital marketing and digital transformation, specialising in the practical application of AI to enhance communication strategies. The founder of Digital Training Institute, Joanne, empowers leaders and communications professionals to leverage AI responsibly and effectively, ensuring transparency, trust, and tangible results.
She completed the Harvard Kennedy School Executive Programme in AI and Public Policy this summer before launching her fourth book AI Playbook, in September. Joanne has also published two editions of Public Sector Marketing Pro, which were preceded by her first title, Social Media Under Investigation Law Enforcement and the Social Web.
Her books have become go-to resources for governments, public sector and policing agencies, as well as marketing and communications professionals, all navigating the challenges of the changing Internet.
Joanne is the host of the AI SIX Podcast, a daily six-minute podcast that provides actionable insights, expert interviews, and practical advice to help professionals navigate the new world of work.
