Roblox’s AI Age Verification System Faces Major Issues
▼ Summary
– Roblox’s new AI-powered age verification system, which scans faces to estimate age for chat access, has launched globally but is facing significant problems and user backlash.
– The system is reportedly misclassifying users’ ages and has not effectively addressed the core issue of predators using the platform to groom children.
– Age-verified accounts for minors are being illicitly sold online for low prices, undermining the system’s security goals.
– Roblox’s safety officer acknowledges the system’s rollout challenges on a massive platform but defends its adoption, while the company is working on fixes for issues like parents incorrectly verifying for children.
– The verification process, which uses video or ID uploads, is optional but required for chat functions, raising privacy concerns and restricting communication between age groups.
Roblox’s new AI-powered age verification system, designed to create safer chat environments by grouping users with peers of similar age, has encountered significant technical and practical problems shortly after its global rollout. Players are reporting widespread inaccuracies, with the system incorrectly classifying minors as adults and adults as minors, leading to frustration and disrupted social interactions. This core failure undermines the very safety goal the feature was meant to achieve. Beyond simple glitches, a more serious issue has emerged: the system appears ineffective at stopping the predatory behavior it was intended to prevent, with evidence showing that age-verified accounts for young children are being sold online.
The verification process requires users to submit a short video via their device’s camera, which is analyzed by a third-party service to estimate age, or to upload a government ID for those over 13. While the platform states that personal data is deleted after processing, many users remain hesitant due to privacy concerns. The feature, though technically optional, locks out chat functions for those who decline, a major deterrent since social interaction is a primary draw of the platform.
Company leadership acknowledges the challenges. Roblox’s chief safety officer noted that deploying such a large-scale, novel system to over 150 million daily users is a complex undertaking that cannot be perfected instantly. He pointed to “tens of millions” of completed verifications as a sign of community support for a safer environment. However, the platform has also admitted to a specific flaw where parents verifying on behalf of their children can result in those kids being incorrectly flagged as over 21, a problem they are actively working to resolve.
The push for age verification comes amid intense legal and regulatory scrutiny. Roblox faces multiple lawsuits from states alleging the platform failed to protect young users and enabled predators. These legal actions claim the company’s environments have been used to groom children, prompting the introduction of new safety features. The stated aim of the age-gated chat is to prevent adults from freely interacting with unfamiliar children, but early evidence suggests loopholes persist.
Critically, the system’s vulnerabilities are already being exploited. Investigations have found listings on major e-commerce sites where individuals advertise and sell pre-verified accounts for children as young as nine years old. This black market for accounts, available for just a few dollars, demonstrates how easily the new safeguards can be circumvented, raising serious questions about the system’s overall effectiveness in creating a genuinely safer space for its youngest users.
(Source: Wired)
