Topic: platform safety

  • Character AI Ends Kids' Chatbot Feature

    Character AI Ends Kids' Chatbot Feature

    Character.AI is ending open-ended chatbot conversations for users under 18 to address safety concerns, following tragic incidents linked to teen suicides from prolonged AI interactions. The platform will shift its focus from AI companions to role-playing and creative tools like storytelling and v...

    Read More »
  • New Mexico Sues Meta Over Child Predator Facilitation

    New Mexico Sues Meta Over Child Predator Facilitation

    New Mexico's lawsuit alleges Meta knowingly misled the public about platform safety, prioritizing profits and free expression over protecting young users, while internal research highlighted risks like millions of underage accounts. The trial includes a unique undercover investigation by the stat...

    Read More »
  • Roblox's AI Age Verification System Faces Major Issues

    Roblox's AI Age Verification System Faces Major Issues

    Roblox's new AI age verification system is failing technically, incorrectly classifying user ages and creating a black market for pre-verified child accounts, undermining its core safety goal. The verification process, which uses video analysis or ID uploads, raises privacy concerns and locks out...

    Read More »
  • Hollywood's Roblox & Fortnite Strategy: What's Working?

    Hollywood's Roblox & Fortnite Strategy: What's Working?

    Modern gaming platforms like Roblox and Fortnite, with massive daily user bases, have become essential new frontiers for entertainment brands seeking to build immersive, interactive experiences for a deeply online generation. Brands are creating elaborate digital experiences, such as Netflix inte...

    Read More »
  • Master Your AI Video Presence with Sora

    Master Your AI Video Presence with Sora

    OpenAI has introduced new user controls for Sora, its AI video platform, allowing individuals to restrict how their digital likenesses are used, such as blocking appearances in political content or with specific language. The platform, often compared to a "TikTok for deepfakes," enables the creat...

    Read More »
  • Google Simplifies Creating Your Own Deepfake

    Google Simplifies Creating Your Own Deepfake

    YouTube is releasing a new AI feature for Shorts that lets creators generate a digital avatar mimicking their appearance and voice for use in videos. The tool is presented as a more secure, authenticated alternative to unauthorized deepfakes, aiming to provide a controlled way for creators to use...

    Read More »
  • Protect Your OnlyFans Content from DMCA Takedowns

    Protect Your OnlyFans Content from DMCA Takedowns

    OnlyFans provides a platform for creators to build a business and connect with their audience, but protecting exclusive content from leaks is crucial for maintaining income and privacy. The DMCA takedown system offers a legal mechanism for creators to remove pirated content, as copyright protecti...

    Read More »
  • Meta misled users on safety, jury finds

    Meta misled users on safety, jury finds

    A New Mexico jury found Meta deliberately misled the public about platform safety, willfully violating state consumer protection law as an unconscionable trade practice. The verdict resulted in a $375 million penalty, the maximum fine for the violations, though it was less than the $2 billion the...

    Read More »
  • Roblox Bans User Who Hunted Alleged Groomers

    Roblox Bans User Who Hunted Alleged Groomers

    Roblox banned a prominent user known for "predator hunting" after issuing a cease-and-desist, citing his disruptive methods that bypassed official safety channels despite his goal of protecting children. The case underscores escalating legal and public scrutiny, with multiple states suing Roblox ...

    Read More »
  • Dubai's SureSpace App Aims to End Doomscrolling with Social Revolution

    Dubai's SureSpace App Aims to End Doomscrolling with Social Revolution

    SureSpace is a new social platform from Dubai designed to combat mental health issues by offering a verified, algorithm-free environment that promotes genuine human connections. The platform features a zero-tolerance policy for toxic behavior, using AI and human moderation to ensure a secure and ...

    Read More »
  • Meta Faces Lawsuit Over Scam Ads on Facebook, Instagram

    Meta Faces Lawsuit Over Scam Ads on Facebook, Instagram

    The Consumer Federation of America has sued Meta, alleging it deceived the public by failing to implement adequate safeguards against fraudulent ads on Facebook and Instagram. The complaint states these scam ads, which often target vulnerable users, have caused significant consumer financial harm...

    Read More »
  • Facebook Insider Designs AI Content Moderation

    Facebook Insider Designs AI Content Moderation

    The proliferation of generative AI has intensified the content moderation crisis, as traditional, slow, and inaccurate human review processes are unsustainable against the speed and volume of AI-generated problematic material. Brett Levenson's company, Moonbounce, addresses this by using a propri...

    Read More »
  • Grok and xAI Face Government Crackdown

    Grok and xAI Face Government Crackdown

    A bipartisan coalition of 35 state attorneys general is demanding action from xAI, the company behind Grok, following reports it generated millions of non-consensual intimate images, disproportionately targeting women and girls. An investigation revealed Grok produced millions of photorealistic s...

    Read More »
  • Hinge's New Policy Makes Account Bans More Fair

    Hinge's New Policy Makes Account Bans More Fair

    Hinge is implementing a new policy that removes only specific rule-breaking content instead of immediately banning entire accounts, allowing users to correct issues while their profiles are temporarily hidden. The platform will notify users of violations via email, push notifications, and in-app ...

    Read More »
  • Get Paid to Chat: Rent a Cyber Friend at TechCrunch Disrupt 2025

    Get Paid to Chat: Rent a Cyber Friend at TechCrunch Disrupt 2025

    Francesco Vitali initially doubted the idea of paying for conversation but trusted his partner's vision, leading to the creation of Rent a Cyber Friend, a video chat platform where users pay per minute for verified companions or specialized discussions. The platform has grown organically to three...

    Read More »
  • Create Deepfakes of Friends with OpenAI's New Video App

    Create Deepfakes of Friends with OpenAI's New Video App

    OpenAI's new Sora app enables users to create AI-generated deepfakes of friends with explicit consent, currently available on an invite-only basis in the U.S. and Canada. The app features "cameos" where users can grant permission for others to produce videos using their likeness, with co-ownershi...

    Read More »
  • AI Chatbots Can Digitally Undress Women in Photos, Study Finds

    AI Chatbots Can Digitally Undress Women in Photos, Study Finds

    Individuals are exploiting AI chatbots to create nonconsensual, sexually explicit deepfakes, digitally stripping clothing from photos of women, which constitutes a significant form of digital harassment and abuse. Despite built-in safeguards, users are circumventing AI platform guardrails to gene...

    Read More »
  • Roblox daily user decline continues as age-checks hinder growth

    Roblox daily user decline continues as age-checks hinder growth

    Roblox reported 132 million daily active users in Q1, down from 144 million at the end of last year, largely due to age verification measures slowing new user acquisition and Russia's December 2025 ban. Despite the user decline, revenue rose to $1.4 billion, but the company lowered its 2026 growt...

    Read More »