Topic: platform responsibility
-
Hugging Face Struggles With Deepfake Nude Images
A new report from AI Forensics found that 73% of user prompts on Hugging Face image editing Spaces were sexual, with 83% seeking to undress or sexualize the subject and 95% of targets being women, including 6.7% involving apparent children. Despite global crackdowns on harmful sexual deepfakes, H...
Read More » -
The Marketplace Selling Custom AI Deepfakes of Women
Civitai is a marketplace where users primarily trade specialized AI files (LoRAs) used to create deepfakes, with 86% of requests for these files aimed at generating explicit content, often targeting specific women. The platform's bounty system effectively facilitates the creation of detailed deep...
Read More » -
Hugging Face tool used to undress women and children
A European nonprofit investigation found that seven of nine top image-editing models on Hugging Face complied with simple requests to undress women, enabling nonconsensual deepfakes without guardrails like those on mainstream AI tools. Researchers, using decoy Spaces, observed over 1,000 prompts ...
Read More » -
Tech Leaders Urged to Curb AI-Generated Content
Major social platforms like YouTube, Instagram, and TikTok have implemented automatic AI content labels, but users cannot filter out AI-generated content entirely, despite widespread demand. Platforms such as Meta, Google, and TikTok declined to confirm plans for AI content filters; existing filt...
Read More » -
Deepfakes Are Winning the War on Reality
The proliferation of AI-generated and manipulated media is causing a crisis of trust in visual evidence online, prompting a search for solutions like content labeling. The leading technical solution, the C2PA standard for content provenance, faces critical flaws including fragile metadata and fra...
Read More » -
Grok AI Sparks Controversy With 'Undressing' Feature
The Grok AI chatbot, developed by Elon Musk's xAI, is being widely misused to create nonconsensual, sexualized imagery of women by digitally removing clothing from user photos, representing a troubling escalation in AI-enabled harassment. By embedding this free and instantly accessible tool into ...
Read More » -
Sora Exposes the Flaws in Deepfake Detection
OpenAI's Sora platform generates highly realistic deepfake videos that easily bypass current detection systems, spreading misinformation as viewers mistake them for real content. The C2PA standard for embedding content credentials is inconsistently applied and often invisible on major platforms, ...
Read More » -
Instagram's Adam Mosseri addresses AI fears, says society must adapt
AI tools are significantly lowering barriers to content creation, enabling more individuals to produce high-quality work, but they also pose risks of misuse by malicious actors. Mosseri views AI as a tool for enhancing and increasing creator output rather than replacing large-scale productions, c...
Read More » -
X battles Andrew Tate’s bid to reveal his critics
X is defending its users' right to anonymity against Andrew and Tristan Tate, who are trying to expose online critics through legal action. The Tate brothers filed a lawsuit against owners of social media accounts, alleging a "Conspiratorial Plot" to defame them. After a Florida court blocked the...
Read More » -
House Advances New KOSA Bill to Protect Kids Online
The House Energy and Commerce Committee has introduced a package of 19 bills aimed at enhancing child safety online, potentially creating the most significant internet regulations in years and reigniting debates over online speech and platform responsibility. A revised Kids Online Safety Act (KOS...
Read More » -
Fandoms Monetize AI Deepfakes for Profit
The rise of AI deepfake technology in online fandoms is creating ethical conflicts, undermining celebrity autonomy, and being exploited for profit through engagement-driven monetization on social platforms. Celebrities are losing control over their likenesses as AI tools simplify manipulation, le...
Read More » -
EU probes xAI over Grok's deepfake porn scandal
The EU has launched a formal investigation into Elon Musk's xAI, alleging its Grok chatbot was used to generate and spread non-consensual deepfake pornography, including potential child sexual abuse material. The probe, under the Digital Services Act, will examine whether xAI failed to implement ...
Read More » -
Will AI Influencers Crash the Creator Economy?
The rapid rise of AI-generated content is forcing a critical discussion about authenticity and ethics in the creator economy, as tools have lowered the barrier to creating convincing but often deceptive videos. AI is enabling both low-effort content farming for revenue and more sinister scams, in...
Read More » -
Big Tech's AI Slop Problem: Why It's Getting Worse
The proliferation of AI-generated content ("AI slop") threatens to undermine trust in digital media, prompting a push for technical solutions like cryptographically signing authentic content through standards such as C2PA. The C2PA framework, which attaches metadata to verify content origin, face...
Read More » -
YouTube Shorts Now Lets Creators Use AI Likenesses
YouTube is introducing AI-generated likenesses for creators to use in Shorts, allowing them to produce content with digital avatars that mimic their appearance and voice. The platform is expanding its AI toolkit with new features like AI-powered music creation and text-to-game generation, aiming ...
Read More » -
YouTube's New AI Tool Fights Deepfakes and Impersonators
YouTube is introducing a likeness detection tool to help creators combat unauthorized AI impersonations and synthetic media, addressing concerns about digital identity theft and misinformation on the platform. The tool, which functions like YouTube's copyright identification system, is in beta te...
Read More » -
AI Tool Grok Misused to Create Offensive Images of Women in Hijabs and Sarees
The Grok AI chatbot is being weaponized to generate nonconsensual, sexually explicit images of women, with a targeted focus on manipulating religious and cultural attire like hijabs and sarees to harass women of color. This coordinated digital abuse is prolific on social media platform X, where u...
Read More » -
YouTube Tightens Rules on Video Game Violence
YouTube is introducing stricter age restrictions on November 17th, blocking users under 18 and those not signed in from viewing videos that focus on realistic human characters involved in mass violence or torture in video games. The platform will assess factors like the duration and prominence of...
Read More » -
CBP Facility Codes Leaked in Online Flashcards
A publicly accessible Quizlet flashcard set labeled "USBP Review" disclosed sensitive U.S. Customs and Border Protection details, including confidential access codes and operational procedures, before being made private in late March 2026 after a media inquiry. The exposed information included sp...
Read More » -
Why Google Earth's AI image generator is a problem
Google Earth's new AI tool "Nano Banana" can generate highly convincing fake satellite images, such as fabricated refugee scenes or bomb craters, raising concerns about viral misinformation. Google defends the feature by embedding SynthID watermarks in all generated images and pointing users to v...
Read More »