New York Senate tech committee advances bill restricting unsafe AI chatbot features for minors statewide

Legislation targets “unsafe” AI chatbot design features when used by minors

A bill aimed at limiting minors’ exposure to certain artificial intelligence chatbot features is moving through the New York State Senate, placing a spotlight on how lawmakers are trying to regulate rapidly evolving generative-AI products used by young people.

The measure, Senate Bill S9051, would amend New York’s General Business Law by creating a new article titled “Prohibition on unsafe chatbot features for minors.” It is sponsored by Sen. Kristen Gonzalez and is listed as active in the Senate Internet and Technology Committee. The bill was introduced on Jan. 27, 2026, and referred to that committee the same day.

What the bill would restrict

S9051 focuses on “advanced chatbots,” defined as generative AI systems with a natural-language interface that provide ongoing, adaptive responses. The bill would make it unlawful for a chatbot operator to provide “unsafe chatbot features” to a covered user unless the operator has determined the user is not a covered minor.

The proposal outlines categories of design features it defines as unsafe when interacting with users, including features that simulate companionship or an interpersonal relationship. Examples listed in the bill text include outputs suggesting the chatbot is a real or fictional individual with a relationship role such as a romantic partner, friend, family member, coach, or counselor, as well as outputs implying the chatbot is human or experiences human emotions.

The bill also describes other restricted output types, including content that endorses or facilitates suicide or self-harm, promotes substantial harm to others, encourages secrecy about chatbot interactions, or facilitates sexually explicit conduct or child sexual abuse material.

• Defines “unsafe chatbot features” by reference to specific outputs and interaction patterns.
• Creates an enforcement framework combining state action and private lawsuits.
• Authorizes rulemaking to refine definitions and compliance expectations.

How age determination is addressed

The bill’s sponsor memo states the legislation would require chatbot operators to offer a way to determine whether a covered user is a covered minor without using government-issued identification. In the bill text, a “covered minor” is defined as a covered user when the operator has actual knowledge the user is a minor.

Enforcement and timing

The measure contemplates enforcement by the state attorney general and through private rights of action. It also grants rulemaking authority to support implementation. If enacted, the sponsor memo states the law would take effect on the 180th day after becoming law, while authorizing preparatory rulemaking immediately.

Broader legislative context

The New York proposal arrives amid growing legislative activity across the U.S. focused on minors’ interactions with AI systems, including discussions around age assurance, harmful-content guardrails, and the degree to which conversational systems should be allowed to simulate friendship or counseling roles. S9051’s approach centers on restricting specific chatbot features and outputs rather than banning access to all chatbots for minors.

The bill’s framework draws a regulatory line around defined interaction patterns—particularly companionship simulation, secrecy prompts, self-harm facilitation, and sexually explicit content—when minors are involved.