The rapid rise of AI-generated content since the launch of OpenAI’s ChatGPT in late 2022 has created significant challenges for online communities trying to maintain human authenticity and trust. On platforms like Reddit and Wikipedia, volunteer moderators play a crucial role in curating content to protect knowledge quality and foster genuine interactions. However, these moderators face an increasingly difficult task managing the surge of AI-produced posts, working to prevent the erosion of community trust and the crowding out of high-quality human contributions.
What Happened
Since November 30, 2022, when ChatGPT was launched, the internet has seen a substantial growth in AI-generated content. This surge has led some platforms to experience up to 40% AI-produced posts, with LinkedIn being a notable example, while others such as Reddit and Wikipedia have maintained much lower levels, around 5%. This disparity largely owes to volunteer moderators who actively monitor and remove non-human content and misinformation. Moderators on Reddit communities like AskHistorians have consistently battled the influx of AI-generated material to uphold standards of trustworthy, expert-reviewed information.
Key Facts
The moderation effort occurs primarily on platforms governed by volunteer caretakers rather than automated systems, with Reddit cited as a key example. These volunteers undertake content review to identify and remove AI-generated posts that are low quality, misleading, or hateful. Reddit uses an upvoting system that can favor early posts regardless of quality, complicating moderators’ efforts. The platform generates approximately $200 million annually by selling data to AI developers such as OpenAI and Google, raising questions about the sustainability and fairness of relying on unpaid moderation labor. Despite existing appeals processes for flagged content, moderators face the challenge of false positives, sometimes mistakenly sanctioning genuine users.
What This Means
The vulnerability of online spaces to AI-generated content poses a dual crisis: a crisis of knowledge and of community. On one hand, AI content floods out human-generated expert knowledge, reducing the reliability of information available online. On the other, it undermines the ability of users to trust other participants as genuine humans, which weakens social connections vital for healthy communities. Since moderators must also mediate disputes over suspected AI use—sometimes accusing real experts wrongly—this creates additional tensions that can drive contributors away.
As AI continues to become more sophisticated and prolific, the responsibility placed on volunteer moderators grows increasingly unsustainable without institutional support. This conflict highlights the need for platforms to recognize and support their moderation workforce and reconsider the ethics of selling user data that feeds AI systems. Public engagement through reporting suspected AI content also becomes critical in helping moderators maintain the integrity of digital communities.
Background
Prior to AI-generated content becoming widespread, moderators on sites like AskHistorians focused primarily on verifying expertise and maintaining quality. Their efforts have long involved removing short or frivolous posts to elevate comprehensive, in-depth answers. However, the emergence of generative AI introduced a new dimension by producing voluminous, often lower-quality content capable of overwhelming these curated spaces. This problem expands across social media ecosystems worldwide, with Pew Research indicating that most Americans wish to distinguish AI content but lack confidence in doing so effectively.
What Remains Unclear
Many questions remain unresolved around how precisely to define, detect, and handle AI-generated content fairly without unfairly penalizing human users. The efficacy of available AI detection tools is still developing, and research funding cuts in the moderation domain slow progress toward sustainable solutions. The long-term effects of platforms’ data-sharing practices with AI companies also remain uncertain in terms of impact on volunteer labor and Internet ecology.
What Comes Next
As of now, volunteer moderation continues as the primary defense against AI content dilution. More investment in research on moderation labor and AI detection tools is necessary, alongside increased platform responsibility in supporting these volunteers. Meanwhile, users are encouraged to participate in flagging suspicious AI-generated posts to aid community efforts. The evolution of content moderation policies and technology will likely shape how human authenticity and trust can be preserved online.
Sources
This article is based on reporting and publicly available information from the following sources:
Read more Digital Policy stories on Goka World News.