The Rise of AI-Fueled Disinformation: New Zealand as a Case Study
A surge of fake news pages, powered by artificial intelligence, is flooding social media platforms and New Zealand is rapidly becoming a focal point. These pages aren’t simply sharing inaccurate information; they’re actively generating misleading images and videos, often exploiting tragic events like the recent Mount Maunganui landslide. The problem isn’t limited to fabricated news stories – it includes the disturbing manipulation of real-life imagery, causing further distress to victims and their families.
AI-Generated Content: A New Level of Deception
The core issue lies in the accessibility of AI tools. Previously, creating convincing fake media required significant technical skill. Now, almost anyone can establish a “fake news workshop” and churn out deceptive content. A Facebook page calling itself “NZ News Hub,” unconnected to the legitimate Newshub news organization, exemplifies this trend. It routinely publishes dozens of posts weekly, taking reporting from established news sources like RNZ, the New Zealand Herald, and Stuff, and adding AI-generated images and videos.
One particularly egregious example involved animating a still photo of a 15-year-old victim of the Mount Maunganui landslide, making her appear to dance. This insensitive act highlights the ethical implications of this technology and the potential for causing immense harm. Another instance saw AI used to create a fabricated video of Prime Minister Christopher Luxon at Waitangi Day celebrations.
The Mechanics of Disinformation: Engagement and Profit
According to Andrew Lensen, a senior lecturer in AI and program development at Victoria University of Wellington, these pages are driven by a simple motive: maximizing engagement. Likes, comments, and shares translate into increased visibility and potential advertising revenue. The pages often lack original reporting, relying instead on repurposing existing content with misleading AI enhancements.
The tactic isn’t unique to New Zealand. Similar patterns have been observed globally, with fake news spreading rapidly after events like shark attacks in Australia, the arrest of a Venezuelan president, and even historical events like the assassination of Charlie Kirk. Many of these pages originate outside of New Zealand, with operators based in countries like Vietnam and Malaysia.
Spotting the Fakes: What to Look For
While AI-generated images are becoming increasingly sophisticated, telltale signs often remain. These include:
- Visual Anomalies: Distorted faces, blurry details, or inconsistencies in lighting.
- Textual Errors: AI often struggles with accurate text rendering, resulting in misspelled words or nonsensical phrases.
- Incorrect Uniforms or Details: As seen in examples of fabricated police images, details like uniforms or geographical features may be inaccurate.
- Watermarks: Some AI-generated images contain “SynthID” watermarks, though these are often subtle and require knowledge to identify.
Even when images appear realistic, it’s crucial to verify the source and cross-reference information with reputable news organizations.
The Broader Implications: A Crisis of Trust
The proliferation of AI-generated disinformation poses a significant threat to public trust in media. As Lensen points out, this exacerbates an existing crisis of confidence in traditional news sources. If even established media outlets commence to rely on AI, the line between fact and fiction becomes increasingly blurred.
This phenomenon is part of a larger trend described by writer Cory Doctorow as “enshittification” of social media platforms – a decline in quality and trustworthiness as platforms prioritize profit over user experience and accurate information.
What’s Being Done?
RNZ has established a set of principles for the application of artificial intelligence and generally avoids publishing or broadcasting content created by generative AI. However, despite reports to Facebook’s parent company, Meta, much of the deceptive content remains online. The ease with which new, similar pages can be created presents a constant challenge.
Frequently Asked Questions
Q: How can I notify if an image is AI-generated?
A: Look for visual anomalies, textual errors, and inconsistencies in details. Cross-reference the information with reputable news sources.
Q: Is this problem limited to Facebook?
A: No, fake photos and videos are spreading across platforms like TikTok, Instagram, and X (formerly Twitter).
Q: What can social media platforms do to combat this?
A: Platforms demand to invest in better detection tools and implement stricter policies to remove fake accounts and content.
Q: What role do traditional media outlets play?
A: Traditional media must be cautious when using AI and prioritize accuracy and transparency to maintain public trust.
The fight against AI-fueled disinformation is ongoing. Staying informed, being critical of the content we consume, and supporting trustworthy news sources are essential steps in navigating this increasingly complex information landscape.
Explore further: Read more about the ethical implications of AI on RNZ’s website.