Topic: platform responsibility

  • The Marketplace Selling Custom AI Deepfakes of Women

    The Marketplace Selling Custom AI Deepfakes of Women

    Civitai is a marketplace where users primarily trade specialized AI files (LoRAs) used to create deepfakes, with 86% of requests for these files aimed at generating explicit content, often targeting specific women. The platform's bounty system effectively facilitates the creation of detailed deep...

    Read More »
  • Grok AI Sparks Controversy With 'Undressing' Feature

    Grok AI Sparks Controversy With 'Undressing' Feature

    The Grok AI chatbot, developed by Elon Musk's xAI, is being widely misused to create nonconsensual, sexualized imagery of women by digitally removing clothing from user photos, representing a troubling escalation in AI-enabled harassment. By embedding this free and instantly accessible tool into ...

    Read More »
  • Sora Exposes the Flaws in Deepfake Detection

    Sora Exposes the Flaws in Deepfake Detection

    OpenAI's Sora platform generates highly realistic deepfake videos that easily bypass current detection systems, spreading misinformation as viewers mistake them for real content. The C2PA standard for embedding content credentials is inconsistently applied and often invisible on major platforms, ...

    Read More »
  • Instagram's Adam Mosseri addresses AI fears, says society must adapt

    Instagram's Adam Mosseri addresses AI fears, says society must adapt

    AI tools are significantly lowering barriers to content creation, enabling more individuals to produce high-quality work, but they also pose risks of misuse by malicious actors. Mosseri views AI as a tool for enhancing and increasing creator output rather than replacing large-scale productions, c...

    Read More »
  • House Advances New KOSA Bill to Protect Kids Online

    House Advances New KOSA Bill to Protect Kids Online

    The House Energy and Commerce Committee has introduced a package of 19 bills aimed at enhancing child safety online, potentially creating the most significant internet regulations in years and reigniting debates over online speech and platform responsibility. A revised Kids Online Safety Act (KOS...

    Read More »
  • Fandoms Monetize AI Deepfakes for Profit

    Fandoms Monetize AI Deepfakes for Profit

    The rise of AI deepfake technology in online fandoms is creating ethical conflicts, undermining celebrity autonomy, and being exploited for profit through engagement-driven monetization on social platforms. Celebrities are losing control over their likenesses as AI tools simplify manipulation, le...

    Read More »
  • EU probes xAI over Grok's deepfake porn scandal

    EU probes xAI over Grok's deepfake porn scandal

    The EU has launched a formal investigation into Elon Musk's xAI, alleging its Grok chatbot was used to generate and spread non-consensual deepfake pornography, including potential child sexual abuse material. The probe, under the Digital Services Act, will examine whether xAI failed to implement ...

    Read More »
  • Will AI Influencers Crash the Creator Economy?

    Will AI Influencers Crash the Creator Economy?

    The rapid rise of AI-generated content is forcing a critical discussion about authenticity and ethics in the creator economy, as tools have lowered the barrier to creating convincing but often deceptive videos. AI is enabling both low-effort content farming for revenue and more sinister scams, in...

    Read More »
  • YouTube Shorts Now Lets Creators Use AI Likenesses

    YouTube Shorts Now Lets Creators Use AI Likenesses

    YouTube is introducing AI-generated likenesses for creators to use in Shorts, allowing them to produce content with digital avatars that mimic their appearance and voice. The platform is expanding its AI toolkit with new features like AI-powered music creation and text-to-game generation, aiming ...

    Read More »
  • YouTube's New AI Tool Fights Deepfakes and Impersonators

    YouTube's New AI Tool Fights Deepfakes and Impersonators

    YouTube is introducing a likeness detection tool to help creators combat unauthorized AI impersonations and synthetic media, addressing concerns about digital identity theft and misinformation on the platform. The tool, which functions like YouTube's copyright identification system, is in beta te...

    Read More »
  • AI Tool Grok Misused to Create Offensive Images of Women in Hijabs and Sarees

    AI Tool Grok Misused to Create Offensive Images of Women in Hijabs and Sarees

    The Grok AI chatbot is being weaponized to generate nonconsensual, sexually explicit images of women, with a targeted focus on manipulating religious and cultural attire like hijabs and sarees to harass women of color. This coordinated digital abuse is prolific on social media platform X, where u...

    Read More »
  • YouTube Tightens Rules on Video Game Violence

    YouTube Tightens Rules on Video Game Violence

    YouTube is introducing stricter age restrictions on November 17th, blocking users under 18 and those not signed in from viewing videos that focus on realistic human characters involved in mass violence or torture in video games. The platform will assess factors like the duration and prominence of...

    Read More »
  • The 'Papers, Please' Internet Is Here

    The 'Papers, Please' Internet Is Here

    Global mandatory online age verification is rapidly expanding from initial UK proposals to worldwide legislation, with the EU, Australia, and the U.S. Supreme Court enabling such requirements. Implementation reveals significant challenges including security vulnerabilities, loopholes, VPN usage, ...

    Read More »
  • Embracing AI: How I Stopped Worrying and Learned to Love It

    Embracing AI: How I Stopped Worrying and Learned to Love It

    AI creators find the term "slop" dismissive, as their work involves significant creative direction, skill, and iterative effort, not just simple prompting. The backlash includes hate for creators and economic harm, reflecting anxiety over AI's cultural impact and perceived threat to traditional a...

    Read More »