New York considers bill that would ban chatbots from giving legal, medical advice

by Chief Editor

New York Set to Rein In AI Chatbots: A Sign of Things to Come?

New York state is poised to become a battleground for regulating artificial intelligence, specifically concerning the rapidly evolving world of chatbots. A bill, Senate Bill S7263, recently passed the Internet and Technology Committee and aims to prevent these AI systems from dispensing legal or medical advice. This move isn’t just a New York story; it signals a growing national concern about the potential risks of unchecked AI and foreshadows stricter regulations across the US.

The Core of the Proposed Law

The bill focuses on preventing AI chatbots from impersonating licensed professionals. It specifically prohibits them from providing “substantive response, information, or advice” that would violate professional licensing laws or constitute the unauthorized practice of law. Crucially, the legislation mandates “clear, conspicuous and explicit” notice to users that they are interacting with an AI, not a human. Yet, this disclosure doesn’t shield chatbot owners from liability if the AI provides harmful or incorrect advice.

A key component of the bill is the provision for a private right of action, allowing users to sue chatbot owners for damages and attorney’s fees. This enforcement mechanism is considered vital, as laws governing data and AI can be less effective without it.

Beyond Chatbots: A Broader AI Regulatory Push

This chatbot bill is part of a larger legislative package in New York aimed at protecting consumers, particularly minors, from the potential harms of AI. Other measures include protecting children from unsafe chatbot features, regulating platforms like Roblox with weak privacy protections, mandating notices on generative AI systems, and establishing new rules for biometric data and “synthetic content creations.”

Recent Events Fueling the Debate

The push for regulation gained momentum following settlements in lawsuits involving Character.AI and Google. These cases pertained to the role their chatbots played in the suicides of several minors. State Senator Kristen Gonzalez, the bill’s author, emphasized the necessitate to ensure AI innovation doesn’t compromise public safety, especially for young people.

What In other words for AI Providers

The New York bill, if enacted, could set a precedent for other states. AI providers may face increased scrutiny and legal challenges if their chatbots offer advice in regulated fields. This could lead to:

  • Increased Development Costs: Implementing robust disclaimers and safeguards will require significant investment.
  • Limited Functionality: Providers might restrict the types of questions their chatbots can answer to avoid legal risks.
  • Greater Transparency: Companies will need to be more open about the limitations of their AI systems.

The Rise of AI-Related Litigation

The lawsuits against Character.AI and Google highlight a growing trend: AI-related litigation. As AI becomes more integrated into daily life, People can expect to see more cases involving issues like misinformation, bias, and harm caused by AI-generated content. The private right of action in the New York bill empowers individuals to seek redress, potentially deterring irresponsible AI development.

FAQ

What does this bill mean for users of AI chatbots?

Users will be clearly informed when they are interacting with an AI, and they will have legal recourse if the chatbot provides harmful or incorrect advice.

Will this bill stifle AI innovation?

Proponents argue that it will encourage responsible AI development by prioritizing safety and transparency.

What other states are considering similar legislation?

Even as New York is leading the way, several other states are exploring regulations for AI, particularly concerning data privacy and consumer protection.

Does this apply to all AI systems?

This specific bill focuses on chatbots providing advice in regulated fields like law and medicine.

When will this law take effect?

If signed by the governor, the law will take effect 90 days after enactment.

Did you know? Maine Attorney General Aaron Frey has stated that a private right of action in data privacy laws provides a “significant deterrent effect.”

Pro Tip: Always verify information provided by AI chatbots with a qualified professional, especially when it comes to legal or medical matters.

Stay informed about the evolving landscape of AI regulation. Explore our other articles on technology and law to learn more about the challenges and opportunities presented by this transformative technology.

You may also like

Leave a Comment