AI & TechArtificial IntelligenceBusinessNewswireTechnology

California’s New AI Law: Bots Must Reveal Their Identity

▼ Summary

California Governor Gavin Newsom signed Senate Bill 243 into law on October 13th, establishing the nation’s first AI chatbot safeguards.
– The law requires companion chatbot developers to clearly notify users when a reasonable person might be misled into believing they are interacting with a human.
– Starting next year, companion chatbot operators must submit annual reports to the Office of Suicide Prevention about safeguards for detecting and responding to suicidal ideation.
– Newsom emphasized that while technology can connect and educate, guardrails are needed to protect children from exploitation and danger.
– This legislation follows the recent signing of Senate Bill 53, a landmark AI transparency bill that had previously divided AI companies.

California has enacted a groundbreaking new law that mandates companion AI chatbots must clearly disclose their non-human identity to users. This legislation, signed by Governor Gavin Newsom, establishes the nation’s first regulatory framework specifically designed for artificial intelligence companions. The law addresses growing concerns that individuals might form emotional attachments to AI systems under false pretenses.

Senate Bill 243, championed by state senator Anthony Padilla, compels developers to integrate specific safeguards into their products. A central provision requires that whenever a user might reasonably mistake the chatbot for a human, the system must provide an unmistakable notification clarifying its artificial nature. This transparency measure aims to prevent deceptive interactions and ensure people understand they are engaging with software, not a person.

Beyond identity disclosure, the law introduces significant mental health protections. Starting next year, operators of certain companion chatbots will need to submit yearly reports to the Office of Suicide Prevention. These documents must detail the specific mechanisms implemented to identify, address, and manage instances where users express suicidal thoughts. The collected data will subsequently be published on the office’s public website, promoting accountability and oversight.

Governor Newsom emphasized the dual nature of emerging technologies in his signing statement. He acknowledged that tools like chatbots and social media platforms offer tremendous potential for connection and learning. However, he stressed that without proper regulations, they also pose serious risks, particularly to young people. “We can continue to lead in AI and technology, but we must do it responsibly , protecting our children every step of the way,” Newsom declared. The chatbot bill was part of a larger legislative package focused on enhancing online safety for minors, which also included new age-verification requirements for hardware devices.

This development follows the governor’s recent approval of another significant piece of AI legislation, Senate Bill 53. That bill, which generated extensive debate within the tech industry, established broader transparency standards for artificial intelligence systems operating in the state. Together, these laws signal California’s intent to take a proactive and cautious approach to governing the rapidly advancing field of artificial intelligence.

(Source: The Verge)

Topics

ai regulation 95% chatbot safeguards 90% california legislation 88% AI Transparency 85% child safety 82% suicide prevention 80% companion chatbots 78% technology guardrails 75% online safety 72% ai industry 70%