What is AB 1064?
AB 1064 establishes the LEAD for Kids Act, designed to protect children from harmful AI technologies in order to encourage safe, ethical AI development.
The bill prevents children's use of AI companion chatbots that exhibit harmful features that have been linked to depression, isolation, disordered eating, self-harm, and suicide.
The Problem
AI is increasingly integrated into children's lives without understanding risks. Children are ever more exposed to rapidly advancing technologies that were developed for profit rather than children's well-being.
Known Risks
- Mental health impacts (depression, anxiety)
- Risk of self-harm/suicide
- Body image issues/ disordered eating
Emerging Risks: Companion AI Can
- Simulate friendships or romantic relationships
- Manipulate behavior and emotions
- Create addictive or harmful attachments
Reports have shown AI chatbots encouraging dangerous behaviors, including self-harm.
What Are Companion Chatbots?
The bill targets GenAI systems with natural language interfaces that:
- Provide adaptive, human-like responses
- Are intended to fulfill, or foreseeably will fulfill, a child's need for human connection through artificial means
- Exhibit anthropomorphic features and maintain ongoing relationships across interactions
Specifically Included
Chatbots that:
- Manipulate a child into harmful behavior
- Attempt to provide mental health therapy
- Cause a harmful emotional attachment
These chatbots have already caused devastating harm to children and families.
The Balance: Benefits vs. Risks
At Their Best, AI Chatbots Can:
- Support learning
- Teach new skills
AB 1064 is not going after these learning benefits—simply the harmful use cases.
But Without Regulation, These Systems Can:
- Expose children to harmful or inappropriate content
- Isolate children from family and friends
- Reinforce biased viewpoints
- Manipulate a child’s emotional state
To Learn more, check out Common Sense Media's Report on AI Companions
