What Happened

On June 14, 2024, Meta Platforms Inc. agreed to a historic $17 billion settlement addressing allegations that it knowingly addicted an entire generation of teenagers to its social media products, including Facebook, Instagram, and Snapchat. The lawsuit accused Meta of using misleading advertising and deliberately maintaining addictive features despite internal research confirming the mental health harms caused to young users. This agreement is the largest of its kind, underscoring mounting legal and regulatory pressure on Big Tech firms to address social media’s impact beyond mere content moderation.

Key Facts

The settlement applies within the United States under consumer protection and child safety laws, specifically targeting harm to minors caused by social media addiction. It reflects confirmed internal Meta research revealing harmful mental health effects such as body dysmorphia, eating disorders, suicidal ideation, and increased exposure to dangerous content like self-harm and substance abuse. The deal requires Meta to implement enhanced safety features, though detailed terms about user opt-out mechanisms or appeals are not publicly confirmed. It remains in the process of regulatory approval and is positioned as a first major step toward platform-level accountability for addictive algorithmic design and data-driven targeting practices.

What This Means

This settlement signifies a pivotal moment in the ongoing debate over the responsibilities of social media companies to safeguard user mental health, particularly among young people. By confronting Meta’s business model that profits from attention-maximizing algorithms and extensive personal data harvesting, the case highlights the urgent need for robust digital policy reform that moves beyond voluntary safety measures. For users and parents, it underscores the risks embedded in popular platforms and the limitations of current protections focused primarily on content removal rather than design ethics.

Moreover, this deal amplifies calls for a broader “duty of care” framework where platforms must proactively mitigate harm, not just react to it. As digital social environments grow increasingly immersive and intertwined with identity and community, consequences such as mental health crises and suicide contagion illuminated by this settlement reveal deep structural flaws demanding coordinated legislative and regulatory intervention across all social media companies. The public and policymakers alike will watch closely to see whether this financial penalty prompts real reform or serves merely as a costly but insufficient reputational safeguard.

Background

Meta’s internal studies had long indicated risks of addiction and psychological distress among teen users, but the company continued to deploy features designed to maximize user engagement and data collection. Previous congressional hearings, investigative journalism, and advocacy efforts exposed these practices and fueled public concern and legal action. This settlement follows increasing scrutiny from U.S. lawmakers and regulators exploring platform responsibility in the wake of rising youth mental health issues linked to social media.

What Remains Unclear

Details about the precise safety improvements Meta must adopt remain undisclosed, as does whether these measures will effectively curb the underlying addictive algorithmic mechanisms. The extent of Meta’s ongoing compliance obligations or enforcement oversight is yet to be finalized. Additionally, how the settlement will influence future regulation of other social platforms beyond Meta is uncertain, raising questions about consistent industry-wide standards and enforcement.

What Comes Next

The settlement awaits judicial approval expected before the end of 2024, after which implementation of mandated changes will begin. Digital rights advocates and policymakers have called for complementary legislation to establish clear legal duties for all social media companies to protect users from addictive design and related harms. Continued public pressure and potential follow-on litigation may further define the contours of platform accountability.

Read more Digital Policy stories on Goka World News.

The post Meta’s $17 Billion Settlement Highlights Social Media’s Mental Health Impact appeared first on Goka World News.

What Happened

The legal battle revolved around Facebook’s failure to protect data from a third-party personality quiz that harvested personal information from approximately 87 million user profiles. This data was subsequently sold to Cambridge Analytica, a political consulting firm known for its role in President Trump’s 2016 campaign advertising strategy. After a two-week trial, the jury found Facebook deceptive in not only allowing this massive breach but also misleading the public about its internal investigations into data brokers following the scandal.

Jurors concluded that Facebook’s actions impacted New Mexico’s population of over two million people. The company was found liable for more than two million violations, with the judge now tasked to decide the precise financial penalties.

Key Facts

The court’s findings included:

• Facebook’s data breach involved roughly 87 million profiles affected by the personality quiz app data harvesting.
• More than two million privacy violations were identified by the jury in the state of New Mexico.
• The state has requested penalties of up to $5,000 per violation, potentially amounting to billions in fines.
• Meta (Facebook’s parent company) previously agreed to an $18 billion multistate settlement addressing child safety, excluding New Mexico’s claims on Cambridge Analytica.
• New Mexico secured earlier legal judgments totaling $942 million against Meta related to safety protections for minors.

What This Means

This verdict underscores growing legal and regulatory scrutiny over how major tech companies manage user data and privacy protections. For consumers, it highlights the ongoing risks of personal information misuse on social media platforms despite corporate promises for security. The ruling in New Mexico, distinct from other states that settled with Meta, signals a willingness among some jurisdictions to enforce accountability more rigorously.

From a business perspective, Facebook and its parent Meta face not only potential financial liability but also pressure to enhance transparency and compliance related to data privacy. This case may encourage stricter oversight in other states and increase demands for improvements in how tech giants govern user data, potentially raising operational costs and influencing market behavior across the industry.

For the broader market, such rulings can affect investor confidence, regulatory environments, and the relationship between technology companies and governments on privacy standards, with implications extending beyond New Mexico.

Background

The Cambridge Analytica scandal erupted in 2018, revealing that political consulting firm Cambridge Analytica improperly collected Facebook user data for targeted political advertising. While Meta settled with most states over child safety issues earlier this year, New Mexico stood alone in continuing to pursue claims tied directly to this historic privacy breach. The state’s Attorney General, Raúl Torrez, has emphasized that this verdict is a warning to technology companies regarding honesty about data use.

What Remains Unclear

The exact financial penalties Facebook will face remain to be determined by the judge, including how maximum per-violation fines will be applied. Meta disputes the verdict and plans to appeal, maintaining it managed platforms to protect both free speech and user data. Details on how this ruling will shape forthcoming regulatory measures or Meta’s operational adjustments are still pending.

Read more Digital Policy stories on Goka World News.

The post Facebook Found Liable for Privacy Deception in New Mexico Over Cambridge Analytica appeared first on Goka World News.

What Happened

The settlement was announced ahead of a trial scheduled to begin in Alabama, where the state had sued TikTok in 2025. Alabama’s lawsuit alleged that TikTok’s algorithm engineered content that fosters addiction and is detrimental to children’s mental health, and that the company was aware of these negative effects. Under the deal, TikTok will put in place new features such as non-personalized content options for teens, a time limit of two hours daily, and a ban on nighttime usage from midnight to 6 a.m. Additionally, young users in Alabama will receive prompts to take breaks after 15 minutes of consecutive use as well as at 60 and 90 minutes. Cosmetic procedure filters will be removed for teen accounts, which will also be set to private by default.

Key Facts

Alabama will receive a guaranteed minimum of $100 million from TikTok, with potential to earn up to $300 million if other states secure qualifying settlements within a set timeframe. The state plans to use these funds for youth mental health programs and remediation efforts. The settlement mirrors changes Meta recently agreed to impose across its platforms following similar lawsuits by nearly every state. TikTok also agreed to strengthen parental controls, improve age verification methods, and enhance content moderation policies for teens. This settlement would have marked Alabama as the first state to pursue a jury trial against TikTok over these claims before the case was resolved.

What This Means

This settlement represents a significant legal development in how social media companies are held accountable for protecting the mental health of underage users. For Alabama families, it means more robust safeguards to limit exposure to potentially addictive and harmful content. The time restrictions and content controls could reduce addictive usage patterns and allow parents more oversight into what their children are exposed to online. More broadly, the agreement signals growing pressure on digital platforms to prioritize youth safety and respond proactively to state-level legal challenges. It may also inspire other states to pursue similar settlements or regulatory frameworks designed to combat social media-related harms to young people.

Background

The Alabama lawsuit was part of a wave of legal actions focusing on social media’s impact on youth mental health, pointing to features that amplify engagement even at the cost of well-being. TikTok had faced multiple lawsuits and regulatory scrutiny on similar issues, including a $400 million settlement with the U.S. Justice Department last year over alleged violations of children’s privacy laws. Earlier this year, TikTok settled several lawsuits before trial, while a key trial in Los Angeles found that competitors YouTube and Meta deliberately designed platforms to addict younger users.

What Comes Next

With the settlement in place, Alabama will move to oversee TikTok’s compliance with the agreed safety features and how settlement funds are allocated toward youth mental health initiatives. Other states are expected to negotiate or finalize their own agreements with TikTok, which could trigger Alabama’s receipt of additional funds under the settlement’s terms.

Read more Digital Policy stories on Goka World News.

The post TikTok Agrees to $100 Million Settlement Over Alabama Youth Safety Lawsuit appeared first on Goka World News.

What Happened

During the UNGA session, policymakers and digital governance stakeholders highlighted new insights from the International Telecommunication Union (ITU) and the International Cable Protection Committee’s International Advisory Body on Submarine Cable Resilience. On July 10, the Advisory Body published a comprehensive report outlining 39 recommendations aimed at strengthening the deployment, operation, security, and rapid repair of undersea cables. These guidelines are designed to reduce the risk and impact of cable disruptions, which have been shown to significantly affect AI data flows and services.

This development comes amid rising global incidents of undersea cable damage, including natural events and suspected deliberate interference in strategic regions. Notable examples cited include a 2024 underwater landslide off Côte d’Ivoire that damaged four West African cables, causing multi-day internet outages across 13 countries. The situation was exacerbated by the limited regional repair capacity, with Africa’s only permanently stationed cable repair vessel, the Léon Thévenin, arriving weeks later.

Key Facts

The ITU Advisory Body’s report, although non-binding, sets out preventive and responsive measures covering streamlined permitting processes, enhanced coordination among stakeholders, and expanded access to repair resources. Its focus spans risk identification, monitoring, mitigation, and fostering geographic diversity to improve network redundancy.

Undersea cables are governed internationally by the United Nations Convention on the Law of the Sea (UNCLOS), which requires national legislation to penalize cable damage—a framework many affected countries have yet to fully implement. Nigeria serves as a notable example with its 2024 Critical National Information Infrastructure Order that designates cables as critical infrastructure and prescribes penalties for damage.

The vulnerability of these cables has geopolitical implications. The U.S. government cites the strategic risks posed by adversarial efforts to compromise undersea infrastructure, while Europe has intensified protections following suspected sabotage linked to Chinese-flagged ships in the Baltic Sea.

What This Means

The report underscores that safeguarding undersea cables is not merely a telecommunications issue but a fundamental element of AI governance and digital sovereignty. Disruptions to these cables can abruptly halt AI data exchange, interrupt training, and degrade service performance worldwide, with disproportionate impacts on regions with limited redundancy.

For ordinary internet users and AI-dependent services, this means that without robust protection and improved repair frameworks, outages caused by physical cable damage could become more frequent and prolonged. Moreover, increasing geopolitical tensions risk intentional disruptions becoming a new front in digital conflict, making undersea cable resilience a priority for national security as well as economic stability.

Addressing these challenges requires formal recognition of undersea cables as critical infrastructure across jurisdictions, implementation of legal protections aligned with UNCLOS, investment in repair capacities especially in underserved regions like Africa, and international cooperation to monitor and mitigate emerging threats.

Background

Undersea cables have long been the backbone of global telecommunications, but their susceptibility to damage from fishing, natural disasters, and potentially hostile acts has garnered renewed concern amid the exponential growth of AI and cloud computing. Industry and governments have recognized the need for coordinated resilience measures, with the ITU playing a central role in convening expert stakeholders and framing global best practices.

The July report by the International Advisory Body builds on a series of UN-related initiatives addressing digital infrastructure security and aims to provide a harmonized reference for countries seeking to bolster their national and regional cable networks.

What Remains Unclear

As the ITU report’s recommendations are non-binding, the extent to which governments, particularly in vulnerable regions, will adopt and implement these measures remains uncertain. The capacity of repair infrastructures, funding availability, and political will to enforce and update relevant national legislation, especially in developing countries, are still open questions.

What Comes Next

Key implementation milestones are pending as countries prepare to discuss digital infrastructure resilience more prominently during and after the UNGA 81 session. Progress will depend on follow-up actions by national governments and international bodies, and the continued diplomatic emphasis on integrating undersea cable protection into AI and cybersecurity policies.

Read more Digital Policy stories on Goka World News.

The post UN General Assembly Urged to Prioritize Undersea Cable Protection in AI Era appeared first on Goka World News.

What Happened

Earlier this month, Meta announced the launch of Community Notes testing in sixteen Latin American countries, including Argentina, Bolivia, Chile, Colombia, Costa Rica, Ecuador, El Salvador, Guatemala, Honduras, Mexico, Nicaragua, Panama, Paraguay, Peru, Uruguay, and Venezuela. While Meta has allowed users in these countries to sign up as contributors, the company confirmed that no Community Notes will be publicly visible during the test phase, and independent fact-checking will continue alongside the trial.

Meta has also provided few key data points from its U.S. experience with Community Notes—over 1.4 million contributors producing more than 50,000 published notes across platforms like Facebook, Instagram, and Threads—but stops short of explaining how these numbers translate to measurable success or standards for expanding or replacing existing fact-checking programs.

Key Facts

• The Community Notes program is active in 16 Latin American countries during the testing phase.
• Over 1.4 million contributors have joined Community Notes in the U.S. since its inception, resulting in about 50,000 published notes across Meta platforms.
• In comparison, Meta’s prior EU fact-checking program applied labeling to nearly 50 million pieces of content in 2025 alone, highlighting the much smaller scale of Community Notes.
• Community Notes require bipartisan agreement among contributors to get published, resulting in a low publication rate for submitted notes; data from Meta’s X platform suggests only about 10% of notes are published.
• Meta confirmed that content receiving Community Notes does not face reach penalties, unlike prior fact-check labels that reduced the visibility of false content.
• The test includes continuous independent fact-checking, as the company has not committed to replacing professional fact-checking with Community Notes.
• The specific thresholds for success—such as adequate publication rates, response times, or coverage of viral misinformation—have not been disclosed by Meta.

What This Means

Meta’s cautious rollout of Community Notes in Latin America without publicly defining benchmarks such as minimum publication rates or timely note visibility obscures how the platform intends to gauge effectiveness or hold itself accountable. This opacity undermines public trust in a system that Meta has positioned to be integral in addressing misinformation across its social networks.

Moreover, replacing professional fact-checking with a volunteer-driven annotation approach carries inherent challenges. Community Notes requires a consensus mechanism that can suppress accurate but politically uncomfortable corrections, as evidenced by findings on other platforms like X, where partisan veto power has limited note visibility. The absence of a distribution penalty for flagged content further weakens the ability of Community Notes alone to prevent misinformation spread.

For ordinary users and stakeholders, this development may mean continued exposure to misleading content that is insufficiently challenged in a timely manner. The fact that Meta’s notes are US-centric, and often do not address content from other countries, especially in a globalized information environment, compounds the issue. Unless Meta commits to transparency around operational metrics and the relationship between Community Notes and professional fact-checking, the program risks being perceived as a weak or partial solution.

Background

Meta’s Community Notes emerged as a successor to its fact-checking program in the U.S., developed to crowdsource context to flagged content via user contributions requiring cross-partisan consensus. While it has attracted millions of contributors, the system has faced criticism for low publication rates of submitted notes and the inability to penalize posts algorithmically. Independent research highlighted that only a small portion of fact-checked posts receive contextual corrections through Community Notes.

The European Fact-Checking Standards Network and Meta’s own Oversight Board have both cautioned against treating Community Notes as a direct substitute for professional fact-checking, emphasizing the complementary roles these mechanisms play in combating misinformation.

What Remains Unclear

Meta has yet to clarify several key points: what specific performance metrics or thresholds will be used to evaluate the Community Notes pilot in Latin America; the timeline and conditions under which professional fact-checking could be phased out in countries where Community Notes is introduced; how the consensus and moderation processes will handle partisan bias or coordinated manipulation; and what safeguards exist to maintain transparency and public accountability regarding the program’s effectiveness.

What Comes Next

Meta stated that it will monitor the pilot results “country by country, taking local needs into account,” before considering full rollout and migration away from independent verification programs. However, no concrete timeline or public review process for this evaluation has been shared. Independent fact-checking agencies remain active in the tested countries during the trial period.

Read more Digital Policy stories on Goka World News.

The post Meta Expands Community Notes to Latin America Without Defining Success Metrics appeared first on Goka World News.

What Happened

The Global Digital Compact was unanimously adopted during the UN General Assembly in New York City on September 23, 2024. This compact established broad principles for international cooperation on digital governance topics, including connectivity, data use, cyber security, public digital infrastructure, and AI. A mandated review, scheduled for 2027, will assess the Compact’s relevance and impact. The review’s procedural design—decided by co-facilitators appointed by the President of the General Assembly—will determine whether it is narrowly confined to evaluating the Compact’s existing provisions or broadly scoped to encompass the fragmented global landscape of digital governance mechanisms.

Key Facts

• The Global Digital Compact was adopted unanimously by UN member states in 2024.
• The Compact covers areas such as AI governance, data management, cybersecurity, and digital infrastructure.
• The review of the Compact is set for 2027 under the incoming UN Secretary-General.
• The review process will be influenced by co-facilitators appointed by the President of the UN General Assembly.
• Current global digital governance is fragmented, featuring diverse initiatives like the China-led World AI Cooperation Organization, US-led resource coordination efforts, and regional frameworks in OECD, G7, and ASEAN.
• Many governance initiatives exclude states lacking technological or resource leverage, often leaving developing countries marginalized.
• The Group of 77 and China have emphasized the risk that the next global divide will center on the capacity to shape technology.

What This Means

The 2027 review of the Global Digital Compact represents a unique opportunity for the United Nations to reclaim a universal and inclusive role in digital governance. Should the scope of the review extend beyond the Compact’s text, it could enable an assessment and potential harmonization of the myriad overlapping and often exclusive governance bodies related to AI, data standards, cybersecurity, and infrastructure. This inclusivity is critical because existing frameworks tend to favor powerful states and tech-rich nations, often requiring developing countries to accept externally set standards and conditions.

This dynamic risks deepening a “digital divide” where states that currently lack technological capability or resources are excluded from negotiations that define future technology norms and governance structures. As such, the review’s breadth will directly influence whether developing countries can have a substantive voice in shaping AI policies, data governance rules, and digital infrastructure standards, or whether they remain dependent actors on terms set elsewhere.

Moreover, the review process could enable the UN to coordinate capacity-building support for less technologically developed countries, ensuring their delegations have the expertise and resources necessary to engage effectively in the negotiations. This would mark a substantial shift from the current landscape, where the complexity and technicality of digital governance often preclude equitable participation.

Background

Prior to the Global Digital Compact’s adoption, the international governance of digital technology was highly fragmented. Various regional and thematic initiatives, such as the World AI Cooperation Organization and OECD AI principles, operated along different lines of membership and regulatory focus. While these efforts advanced governance in their own ways, they collectively posed challenges for universal inclusion, leaving many developing states outside formal rule-making processes.

The Bigger Picture

The debate over the Compact’s review occurs against a backdrop of intensifying geopolitical competition over technology leadership and control. The early establishment of digital standards often locks in advantages for the first movers, perpetuating inequalities. The UN is uniquely positioned as a global convening institution to foster consensus and ensure that governance mechanisms are interoperable and inclusive, rather than creating additional exclusionary frameworks.

What Remains Unclear

It is not yet determined how the co-facilitators will scope the 2027 review or what modalities for participation will be adopted. The degree to which the review will critically evaluate the existing mosaic of governance frameworks, or merely reaffirm the Compact’s own provisions, remains an open question. Furthermore, the extent of capacity-building funding and support available to less-resourced delegations is undecided.

What Comes Next

The primary upcoming milestone is the initiation of the 2027 review process under the new UN Secretary-General. This will involve setting the procedural rules and participation criteria, which will shape how broadly the current challenges in global digital governance can be addressed through this mechanism. Observers and stakeholders are closely monitoring these developments as they have long-term implications for global digital equity.

Read more Digital Policy stories on Goka World News.

The post UN’s 2027 Review of Global Digital Compact Could Marginalize Developing Nations appeared first on Goka World News.

What Happened

In the wake of Meta’s historic $17 billion settlement over its role in fostering social media addiction, the company agreed to stop showing minors their “like” counts on Facebook and Instagram. This feature, developed early in the company’s history, became emblematic of economic misalignment where platforms prioritize engagement and advertising revenue over user well-being. Drawing from this experience, the engineer, now a digital policy advocate, warns that AI will amplify these economic misalignments unless proactively regulated and aligned with broader societal interests.

Key Facts

The settlement, finalized last month, covers Facebook and Instagram usage in the United States and addresses concerns over the mental health impact on minors. The platforms will cease publicly displaying the number of “likes” for users under 18 as part of the agreement.

The engineer argues that AI regulation must go beyond technical safeguards to include economic alignment—adapting the economic system to reward human-centric outcomes instead of pure profit. Examples of economic democracy cited include participatory budgeting in U.S. cities like Boston and Fort Collins and environmental policies such as Costa Rica’s fossil fuel taxation used to fund conservation.

These initiatives illustrate ways communities can influence resource allocation and create incentives aligned with public health, environmental stewardship, and social equity.

What This Means

The move to hide like counts for minors signals a growing regulatory focus on mitigating the addictive design features of social media that profit from user attention yet harm mental health and social fabric. The engineer’s insights push this further by emphasizing AI’s potential to act as a force multiplier of existing economic incentives.

This shift reveals the risk that AI could deepen societal problems—such as resource exhaustion, economic inequality, and harmful corporate behaviors—if regulatory frameworks do not incorporate economic democracy principles that enable public control over economic goals.

For users, this means a future where digital technologies are expected not merely to function correctly but to serve authentic human needs as defined through democratic processes. For regulators, it underscores the importance of integrating economic policies with technology governance to effectively curb negative externalities and promote inclusive digital economies.

Background

Social media addiction and mental health concerns have long tracked back to the economic models of platforms like Facebook, which monetize attention through advertising-driven engagement metrics such as likes. The striking $17 billion settlement is one of the largest remedies addressing these harms.

The broader economic misalignment problem is evident in sectors ranging from healthcare—where treatment is more profitable than prevention—to agriculture—where unhealthy processed foods dominate because of profitability over nutrition.

The Bigger Picture

Economic democracy and alignment are emerging as frameworks that move beyond traditional regulation by embedding community decision-making into economic and digital governance. This approach contrasts with markets and corporate governance systems often driven solely by shareholder profit maximization.

By harnessing AI itself to enable scalable public participation in policymaking, advocates believe technology can help distribute power more equitably and ensure AI development serves collective rather than corporate interests.

Read more Digital Policy stories on Goka World News.

The post Former Facebook Engineer Calls for Economic Alignment to Regulate AI and Social Media appeared first on Goka World News.

What Happened

Since November 30, 2022, when ChatGPT was launched, the internet has seen a substantial growth in AI-generated content. This surge has led some platforms to experience up to 40% AI-produced posts, with LinkedIn being a notable example, while others such as Reddit and Wikipedia have maintained much lower levels, around 5%. This disparity largely owes to volunteer moderators who actively monitor and remove non-human content and misinformation. Moderators on Reddit communities like AskHistorians have consistently battled the influx of AI-generated material to uphold standards of trustworthy, expert-reviewed information.

Key Facts

The moderation effort occurs primarily on platforms governed by volunteer caretakers rather than automated systems, with Reddit cited as a key example. These volunteers undertake content review to identify and remove AI-generated posts that are low quality, misleading, or hateful. Reddit uses an upvoting system that can favor early posts regardless of quality, complicating moderators’ efforts. The platform generates approximately $200 million annually by selling data to AI developers such as OpenAI and Google, raising questions about the sustainability and fairness of relying on unpaid moderation labor. Despite existing appeals processes for flagged content, moderators face the challenge of false positives, sometimes mistakenly sanctioning genuine users.

What This Means

The vulnerability of online spaces to AI-generated content poses a dual crisis: a crisis of knowledge and of community. On one hand, AI content floods out human-generated expert knowledge, reducing the reliability of information available online. On the other, it undermines the ability of users to trust other participants as genuine humans, which weakens social connections vital for healthy communities. Since moderators must also mediate disputes over suspected AI use—sometimes accusing real experts wrongly—this creates additional tensions that can drive contributors away.

As AI continues to become more sophisticated and prolific, the responsibility placed on volunteer moderators grows increasingly unsustainable without institutional support. This conflict highlights the need for platforms to recognize and support their moderation workforce and reconsider the ethics of selling user data that feeds AI systems. Public engagement through reporting suspected AI content also becomes critical in helping moderators maintain the integrity of digital communities.

Background

Prior to AI-generated content becoming widespread, moderators on sites like AskHistorians focused primarily on verifying expertise and maintaining quality. Their efforts have long involved removing short or frivolous posts to elevate comprehensive, in-depth answers. However, the emergence of generative AI introduced a new dimension by producing voluminous, often lower-quality content capable of overwhelming these curated spaces. This problem expands across social media ecosystems worldwide, with Pew Research indicating that most Americans wish to distinguish AI content but lack confidence in doing so effectively.

What Remains Unclear

Many questions remain unresolved around how precisely to define, detect, and handle AI-generated content fairly without unfairly penalizing human users. The efficacy of available AI detection tools is still developing, and research funding cuts in the moderation domain slow progress toward sustainable solutions. The long-term effects of platforms’ data-sharing practices with AI companies also remain uncertain in terms of impact on volunteer labor and Internet ecology.

What Comes Next

As of now, volunteer moderation continues as the primary defense against AI content dilution. More investment in research on moderation labor and AI detection tools is necessary, alongside increased platform responsibility in supporting these volunteers. Meanwhile, users are encouraged to participate in flagging suspicious AI-generated posts to aid community efforts. The evolution of content moderation policies and technology will likely shape how human authenticity and trust can be preserved online.

Read more Digital Policy stories on Goka World News.

The post Volunteer Moderators Battle AI-Driven Content to Preserve Online Communities appeared first on Goka World News.

What Happened

In what is described as one of the largest-ever legal actions against harmful deepfake sites, the Manhattan DA’s office executed seizure warrants to take control of a dozen domains hosting explicit synthetic media. These websites, active since as early as 2018, contained manipulated videos that placed the faces of various women—many prominent public figures—onto pornographic content without their consent. The seizures followed an ongoing investigation into the operators and uploaders of these videos. The seized domains now display official takedown notices issued by a New York State Supreme Court.

Key Facts

• The sites hosted manipulated sexual videos of about 1,200 individuals, overwhelmingly women.
• The victims include social media influencers, actors, musicians, athletes, activists, and politicians.
• The websites used provocative domain names including terms like “sex celebrity” and “real deepfakes.”
• Videos often showed face swaps of celebrities onto pornographic footage, with some videos viewed tens of thousands of times.
• Two seized websites contained profiles of elected officials, featuring manipulated videos and personal details.
• The takedown was carried out under New York’s criminal procedure laws and supervised by Manhattan District Attorney Alvin Bragg.
• Investigations continue into those responsible for running the sites and uploading content.

What This Means

This enforcement action represents a crucial step in combating the pervasive abuse enabled by synthetic media technologies, particularly focusing on nonconsensual intimate imagery (NCII). The seizure of these websites interrupts access to millions of harmful videos and sends a clear message that distributing such content can lead to serious legal consequences. For victims—many of whom suffer severe emotional and psychological distress—the takedowns may offer some relief, though the broader challenge of deepfake abuse remains significant.

Moreover, this case illustrates how state-level legal tools can be effectively used to target the infrastructure behind these illicit deepfake operations. While AI-driven synthetic media technologies advance rapidly, the enforcement against sites hosting nonconsensual deepfakes shows progress in legal accountability and digital rights protection. Nevertheless, experts highlight that to fully address the problem, coordinated actions must also focus on creation tools, content promotion, hosting, and monetization systems that enable this underground ecosystem.

Background

Deepfake technology, which first became widely known in late 2017, has evolved into a potent tool for generating highly realistic but fabricated pornographic images and videos, often used without consent. Previous platforms notorious for hosting such content, like MrDeepFakes, were shut down after investigative journalism exposed their creators. These synthetic intimate images frequently target both non-famous individuals and high-profile persons, causing widespread concern over privacy violations.

Analysis

Leonie Oehmig, a researcher at the Institute for Strategic Dialogue who studies the deepfake ecosystem, described the takedowns as a notable victory in the fight against synthetic NCII and emphasized that coordinated law enforcement efforts can be effective even amid fragmented regulatory environments. Benjamin Shultz, lead researcher at the American Sunlight Project, noted that the seized websites often reposted previously shared deepfake videos, including profiles of political figures, thereby amplifying their harmful reach.

What Remains Unclear

The full scope of the victim list and the identities of the website operators remain confidential as investigations are ongoing. It is also unclear what proportion of the total nonconsensual deepfake websites worldwide have been impacted by this action or what percentage of affected victims have been formally notified.

What Comes Next

The Manhattan District Attorney’s office has invited victims to come forward to aid ongoing investigations and threatened further legal action against individuals responsible for creating or distributing harmful synthetic content. Additional enforcement efforts targeting the broader deepfake ecosystem are expected as digital forensic and legal tools evolve.

Read more Digital Policy stories on Goka World News.

The post New York Seizes 12 Websites Distributing Celebrity Deepfake Pornography appeared first on Goka World News.

What Happened

On September 17, the European Commission is scheduled to formally introduce the EU Kids Act, a proposal that sets a continent-wide ban on children under 15 creating accounts on social media, video-sharing platforms, AI chatbots, and online gaming services. This initiative represents a comprehensive effort to harmonize regulations across the 27-member states, replacing fragmented national attempts, and comes after recommendations from a panel established by the Commission. The draft of the proposal, leaked prior to the announcement, outlined a staged access regime, including a strict moratorium on accounts for children under 3 years, parent-controlled accounts for those between 3 and 12, and controlled access for children aged 13 to 14. Full access would only be permitted from age 15 onwards.

Key Facts

The EU Kids Act proposal specifically targets digital platforms accessible by minors, including social media, video-sharing services, online gaming, and AI-driven chatbots and companions. Age verification measures will be mandated for all relevant accounts to prevent circumvention by minors, though details on privacy-compliant implementation remain under discussion. Operators of these platforms will bear the responsibility of proving compliance. The regulation excludes education-specific platforms and services operated by public authorities. Additionally, the proposal contemplates design changes to reduce addictive features and mitigate exposure to harmful content in children’s digital feeds. Platforms are also expected to pay supervisory fees to fund enforcement. Although integral to digital safety, the proposals must still undergo approval processes by both the European Parliament and EU member states, with implementation unlikely before 2028, consistent with typical EU legislative timelines.

What This Means

The EU Kids Act underscores the European Union’s growing ambition to set stringent rules surrounding children’s online safety, reflecting rising public and political pressure. By establishing an EU-wide age limit, this proposal aims to curtail access and exposure to risky online content and protect minors from potentially harmful interactions with AI-driven platforms and services. For platform operators, this means significant compliance obligations, including implementing robust age verification processes and redesigning user interfaces to minimize addictive or harmful content. The cost and technical challenges of balancing effective age verification with rigorous EU data protection standards represent a notable regulatory hurdle.

For families and children, the measure promises tighter protection online, potentially reducing early exposure to social media and AI chatbots that many experts associate with mental health risks and privacy concerns. However, debates remain about balancing child protection with fundamental rights, such as access to information, especially since some member states set voting age at 16. The staged access framework attempts to navigate these issues by differentiating access levels by age.

Beyond immediate protections, the proposal could influence global digital regulation trends, positioning the EU once again as a leader in setting online safety and AI oversight standards, following initiatives like the Digital Services Act and the AI Act.

Background

The EU Kids Act builds on the EU’s existing comprehensive digital regulatory architecture, including the Digital Services Act (DSA), which currently governs platform liabilities and online safety obligations. National governments within the EU, including France, Greece, and Denmark, have already pursued their own social media bans or restrictions aimed at children, which created a fragmented regulatory environment. The European Commission recognized the need for a unified approach to avoid competing regulatory frameworks that complicate compliance for digital service providers. The proposal also follows international trends, such as similar moves in Australia, the United Kingdom, and certain U.S. states addressing minors’ access to social media.

What Remains Unclear

The EU Commission has not yet finalized the precise mechanisms for age verification, with privacy considerations posing significant challenges given the bloc’s strict data protection rules. Additionally, how legacy platforms or services like YouTube Kids, WhatsApp, or education-focused platforms will be classified and regulated under the proposal remains unsettled. The timeline for legislative negotiation and potential amendments is still to be determined, with no fixed deadlines for parliamentary or member state approval beyond the anticipated introduction date.

What Comes Next

Following the public announcement on September 17, the proposal will enter the co-decision process requiring approval by both the European Parliament and the Council of the European Union. Legislative negotiations could take several years, with the earliest implementation possible around 2028, following precedent for digital legislation within the EU. Stakeholder consultations and further draft revisions are expected during this period.

Read more Digital Policy stories on Goka World News.

The post EU Proposes Continent-Wide Social Media Ban for Under-15s appeared first on Goka World News.