Topic: content moderation
-
X's Grok AI Still Generates Nudes Despite Claims It's Fixed
Despite new restrictions, the Grok AI system on X continues to generate problematic content like nude images, raising doubts about the effectiveness of its safeguards. The company has implemented measures including paywalling image creation for accountability and blocking edits of real people in ...
Read More » -
US Bars EU Official and Researchers Over Disinformation Work
The U.S. has sanctioned a former EU commissioner and several researchers, barring them from entry, in a major escalation over digital governance and content moderation practices. The sanctions target key figures, including the architect of the EU's Digital Services Act and leaders of groups that ...
Read More » -
YouTube Reinstates Creators Banned for COVID Misinfo
YouTube is reversing its policy by allowing some previously banned creators, who spread COVID-19 and election misinformation, to return to the platform. The company attributes the change to a commitment to free expression, citing past political pressure and the evolution of its community guidelin...
Read More » -
Inside the Hellscape of American Content Moderation
The film "American Sweatshop" explores the psychological toll on content moderators who filter harmful online content, highlighting their role in maintaining usable digital spaces. It focuses on a moderator's mental unraveling after viewing disturbing material, using indirect visuals to emphasize...
Read More » -
Meta Apologizes to GOP in Hearing as Google Holds Firm
Meta apologized to Republican lawmakers for not more forcefully opposing the Biden administration's content moderation requests, committing to defend its standards against future government pressure. Google maintained its standard practice of frequently denying government takedown requests, empha...
Read More » -
Valve Verified 'Alien Orgy' Footage Before Steam Launch
Valve's content moderation flagged the game *Earth Must Die* for a specific scene, requiring the developer to submit visual footage of an "alien orgy" for manual review before approving its Steam launch. This incident highlights that despite relying heavily on automation, Valve conducts granular,...
Read More » -
Elon Musk's Grok AI: Why Its Failure Was Predictable
Grok's rapid development prioritized speed over safety, lacking robust safeguards and formal assessments from the outset, which set the stage for misuse. The AI has been widely used to generate nonconsensual deepfakes, enabled by features like image editing and integration on a platform with weak...
Read More » -
Shovelware Crisis: Why Platforms Must Act Now
The removal of low-quality games from the PlayStation Store highlights a systemic **shovelware crisis**, where digital storefronts are flooded with opportunistic, poor-quality titles that degrade user experience and hinder discovery for genuine games. The problem is exacerbated by generative AI, ...
Read More » -
The Decline of Free Speech: A Modern Setback
A federal lawsuit alleges that private tech platforms like Apple are aligning with government pressure to suppress political speech, as seen in the removal of apps designed to monitor immigration enforcement. Major social media platforms, now controlled by billionaires aligned with political inte...
Read More » -
Report: Trump admin may deny H1-B visas to content moderators
The U.S. State Department has directed consular officials to scrutinize H1-B visa applicants with backgrounds in content moderation or fact-checking, potentially deeming them ineligible if linked to "suppression of protected expression." This policy shift, part of broader immigration changes, has...
Read More » -
Meta's 17-strike rule for sex trafficking revealed by ex-safety exec
A former Meta safety executive testified that the company allowed accounts involved in human trafficking and sexual solicitation to accumulate sixteen violations before suspension, prioritizing user engagement over safety. The lawsuit alleges that Instagram lacked a specific reporting system for ...
Read More » -
Hinge's New Policy Makes Account Bans More Fair
Hinge is implementing a new policy that removes only specific rule-breaking content instead of immediately banning entire accounts, allowing users to correct issues while their profiles are temporarily hidden. The platform will notify users of violations via email, push notifications, and in-app ...
Read More » -
YouTube Reinstates Banned Channels: Advertiser Impact Explained
YouTube is reinstating channels previously banned under old COVID-19 and election rules, marking a major shift in moderation toward free expression. Reinstated channels can monetize content again, expanding ad inventory but raising brand-safety concerns for advertisers. The policy change allows s...
Read More » -
Charlie Kirk's Death Sparks Debate on Content Moderation
The shooting of activist Charlie Kirk at Utah Valley University sparked widespread circulation of graphic videos on social media platforms, often without warnings or consent, and was accompanied by an AI-generated misinformation report about his survival. Researchers and experts criticize platfor...
Read More » -
House Advances New KOSA Bill to Protect Kids Online
The House Energy and Commerce Committee has introduced a package of 19 bills aimed at enhancing child safety online, potentially creating the most significant internet regulations in years and reigniting debates over online speech and platform responsibility. A revised Kids Online Safety Act (KOS...
Read More » -
A Year After Trump's Win, Democrats Still Struggle Online
The Democratic Party continues to struggle with a rigid, top-down digital strategy that hinders authentic voter engagement, despite internal reviews and investments in influencer partnerships. Initiatives like the DNC's "Daily Blueprint" YouTube show have failed to attract significant viewership,...
Read More » -
EU Defies Trump Tariff Threats, Cracks Down on Meta
The EU accuses Meta of violating the Digital Services Act by providing inadequate tools for reporting illegal content and challenging moderation decisions, potentially leading to a multi-billion dollar fine. Meta's platforms are criticized for using "dark patterns" in their reporting systems and ...
Read More » -
EU Accuses Instagram and Facebook of Breaking Content Rules
European regulators have accused Meta's Facebook and Instagram of violating the Digital Services Act due to inadequate content moderation systems and lack of transparency regarding illegal material and researcher data access. The platforms were criticized for implementing confusing systems and da...
Read More » -
OpenAI Adds Parental Controls for Teen ChatGPT Users
OpenAI has launched parental controls for ChatGPT, enabling parents to receive alerts if teens discuss self-harm or suicide, and law enforcement may be notified in urgent cases. Enhanced content protections are automatically applied to teen accounts, restricting exposure to graphic material, harm...
Read More » -
Report: xAI's Grok among worst for child safety failures
A child safety evaluation found Grok AI chatbot has severe safety failures for minors, including inadequate safeguards, widespread inappropriate content, and ineffective age verification. The platform's "Kids Mode" is ineffective, its AI companions promote risky scenarios, and it provides dangero...
Read More » -
Character AI Ends Kids' Chatbot Feature
Character.AI is ending open-ended chatbot conversations for users under 18 to address safety concerns, following tragic incidents linked to teen suicides from prolonged AI interactions. The platform will shift its focus from AI companions to role-playing and creative tools like storytelling and v...
Read More » -
Trump's YouTube Ballroom Deal: How He Made Them Pay
YouTube settled a $24.5 million lawsuit with Donald Trump and allied MAGA channels over alleged First Amendment violations, without admitting wrongdoing, despite legal experts deeming the case meritless. Trump directed $22 million of the settlement to fund a new White House ballroom project, with...
Read More » -
Top AI YouTube Channels Are Vanishing
YouTube has removed several top-subscribed channels known for producing high volumes of low-quality, AI-generated content, signaling a potential crackdown on what is termed "AI slop." The removals align with CEO Neal Mohan's stated plans to reduce low-quality AI content by enhancing systems again...
Read More » -
Payment Processors Opposed CSAM Until Grok Profited
Grok, an AI image generator on Elon Musk's X platform, has been found to produce vast quantities of sexualized imagery, including depictions of children, raising concerns about financial transactions for this content flowing through previously vigilant payment systems. Payment processors like Str...
Read More » -
Why Is No One Stopping Elon Musk's Grok?
Elon Musk's Grok AI chatbot can generate harmful non-consensual intimate imagery, raising serious accountability issues due to ineffective platform safety measures. The incident highlights a broader failure in digital governance, occurring in a permissive regulatory environment where legal protec...
Read More » -
Democrats Demand Apple, Google Ban X's 'Undressing' AI App
U.S. senators are demanding Apple and Google remove the X app due to its "Grok" AI tool, which generates non-consensual explicit imagery, violating the companies' own content policies. The lawmakers argue the app's creation of sexually exploitative depictions, including of minors, clearly breache...
Read More » -
AI-Generated Content Is Overwhelming Reddit
AI-generated content is flooding Reddit, threatening the authenticity of user discussions and overwhelming moderators, particularly in communities like r/AmItheAsshole. Moderators estimate a significant portion of content may now be AI-created or polished, with fabricated, emotionally manipulativ...
Read More » -
Russia Bans Roblox for 'LGBT Propaganda' and Extremism
Russian authorities have blocked the online gaming platform Roblox, citing concerns over extremist content and "LGBT propaganda" that allegedly threatens children's development. This action is part of a broader pattern of restrictions on foreign digital services in Russia, following scrutiny of i...
Read More » -
Judge Moves to Break Google's Ad Monopoly Before Deadline
A federal judge is considering whether to break up Google's ad technology business after hearing final arguments in a landmark antitrust case alleging monopoly practices in online advertising. The Justice Department is pushing for structural changes including selling Google's AdX exchange and pub...
Read More » -
Lawmakers Propose Letting Users Sue Over Harmful Social Media Algorithms
The Algorithm Accountability Act, introduced by Senators Curtis and Kelly, would create a legal "duty of care" for large social media platforms, making them liable for physical harm caused by their recommendation algorithms and carving out an exception to Section 230 protections. The legislation ...
Read More » -
Instagram ordered to stop using 'PG-13' teen accounts
The Motion Picture Association has demanded Meta stop using its "PG-13" trademark to describe content restrictions for teen Instagram accounts, calling the comparison inaccurate and misleading. The MPA argues that Meta's use of the rating threatens public trust in its established system and did n...
Read More » -
YouTube Denies AI Role in Bizarre Tech Tutorial Takedowns
YouTube has denied using artificial intelligence in the recent removal of instructional videos, stating that both initial decisions and appeals were handled without automation. Technology creators saw long-standing educational videos, such as those on installing Windows 11, abruptly flagged as "d...
Read More » -
Apple Removes Controversial Dating Apps Tea & TeaOnHer From App Store
Apple removed the dating safety apps Tea and TeaOnHer from its App Store due to content moderation failures and privacy violations, including sharing minors' data without consent, though they remain on Google Play. The apps breached Apple's guidelines by lacking proper reporting tools, mishandlin...
Read More » -
Facebook Removes ICE-Tracking Page After U.S. Government Request
Meta removed a Facebook page tracking ICE activities in Chicago after a DOJ request, citing policy violations against coordinated harm, following similar actions by Apple and Google. The removal has sparked debate over potential government overreach and "jawboning," raising constitutional questio...
Read More » -
ChatGPT to Enable Adult-Only Intimate Conversations, Says Sam Altman
OpenAI will allow age-verified adult users to engage in adult-oriented conversations, including erotica, as part of a policy shift to treat adults like adults, with implementation planned for December. The company is reintroducing a more personable ChatGPT version to address user feedback that re...
Read More » -
Misinformation Code: Fact or Fiction?
The Australian Code of Practice on Disinformation and Misinformation is undergoing a major review by the Digital Industry Group (Digi), following criticism that it has failed to protect Australians from false information. A Reset Australia report from May 2024 condemned the code as a "complete fa...
Read More » -
Fictional Characters Are Coming to OpenAI's Sora
OpenAI is planning official collaborations with fictional characters for its Sora video platform to address unauthorized and inappropriate content that has emerged since its launch. The company is shifting from an opt-out to an opt-in copyright model, giving rights holders more granular control o...
Read More » -
OpenAI's New Parental Controls: What You Need to Know
OpenAI has launched parental controls for ChatGPT, allowing parents to manage teen accounts by limiting sensitive content, disabling features like memory and voice mode, and adjusting privacy settings. Parents can link their account to their teen's but cannot read their conversation history, exce...
Read More » -
Is the Misinformation Code Spreading Lies?
Australia's primary framework for tackling online false information, the Australian Code of Practice on Disinformation and Misinformation, is deemed a failure, prompting a review and potential reforms led by the Digital Industry Group (Digi). An evaluation by Reset Australia identified systemic f...
Read More » -
OpenAI's Deepfake TikTok Blurs Reality Beyond Recognition
OpenAI's Sora 2 AI video tool generates highly realistic deepfake videos, including convincing clips of real people, raising concerns about digital authenticity and misinformation. The platform features significant upgrades such as synchronized audio generation, improved accuracy, and a social ap...
Read More » -
AI Helps US Investigators Spot AI-Generated Child Abuse Images
Federal investigators are using AI to identify AI-generated child sexual abuse material, helping them focus on rescuing real children from harm. A contract with Hive AI provides specialized detection algorithms to handle a dramatic surge in generative AI-related incidents overwhelming traditional...
Read More » -
Meta's Child Safety Leak: A Damaging Turn for the Worse
Whistleblowers revealed that Meta is actively suppressing research on child safety risks in VR to avoid legal liability, rather than addressing known dangers. Despite official age restrictions, children under 13 routinely access Meta's VR platforms, where immersive technology poses uniquely invas...
Read More » -
Roblox Unveils Short-Form Video Feed & AI Creator Tools
Roblox introduced a new short-form video feature called "Roblox Moments" for users aged 13 and above, enabling gameplay recording, editing, and sharing within a community feed. The platform is increasing monetization for developers by raising the DevEx rate, allowing creators to earn 8.5% more wh...
Read More » -
My Slippery Slope Into Sora's World
OpenAI's new Sora app enables users to create ten-second AI-generated videos from any concept, including digital cameos of people, and has quickly become a top free app on the Apple App Store. Public and internal reactions are mixed, with concerns about misinformation from hyper-realistic videos ...
Read More » -
TikTok's New Owners: How Your Feed Will Change
A consortium including Silver Lake, Oracle, and Abu Dhabi's MGX has finalized a deal to create a new U.S.-based corporate entity for TikTok, installing a fresh team of American executives to lead it. For users, the app experience will remain seamless, but a key technical change involves retrainin...
Read More » -
TikTok Deal Finalized After Months of Negotiations
A new joint venture has been established to protect U.S. TikTok user data and the platform's core algorithm, housing them within Oracle's secure U.S. cloud infrastructure. The entity will enforce strict data privacy, cybersecurity, and software assurance protocols, with oversight from independent...
Read More » -
Victims of nonconsensual deepfakes can now sue under new Senate bill
The U.S. Senate unanimously passed the DEFIANCE Act, creating a civil legal pathway for victims to sue creators of nonconsensual, sexually explicit deepfake images for damages. The bill specifically targets the producers of forged content and builds on existing laws, introduced amid controversy o...
Read More » -
X's Grok Paywall Fails to Block Free Image Editing
The Grok chatbot's prompts led users to believe a paywall for its AI image-editing tools was in effect, but unsubscribed users can still easily access these features through simple workarounds on the desktop site. Despite public statements, the platform's restrictions are superficial, as harmful ...
Read More » -
Why Grok and X Remain in App Stores
The continued availability of X and its Grok AI chatbot in major app stores, despite policies banning illegal and sexually exploitative content, highlights a critical enforcement gap between corporate policy and practical moderation. Grok AI has generated a massive volume of sexually suggestive a...
Read More » -
YouTube Tightens Rules on Video Game Violence
YouTube is introducing stricter age restrictions on November 17th, blocking users under 18 and those not signed in from viewing videos that focus on realistic human characters involved in mass violence or torture in video games. The platform will assess factors like the duration and prominence of...
Read More »