Google Faces Lawsuit Over AI on School Laptops
Google is facing a challenge over the use of artificial intelligence on school‑issued laptops after the parents of a 13‑year‑old girl alleged that prolonged interactions with Google AI Mode contributed to a serious mental health crisis. The lawsuit, filed in California Superior Court raises concerns about how artificial intelligence‑powered tools are introduced to young users particularly in schools and whether parents are adequately informed about the potential risks. School‑issued laptops are at the heart of this dispute. This case shows that schools must be careful, about how they bring AI tools to students. I think this case is important.
According to a report by a famous publication, this case might be the first time someone is taking Google to court over how it added AI tools to apps on school Chromebooks. The lawsuit is asking if the company has protections, in place and if it’s okay for kids to use chat-like AI on the devices they use at school.
Google has said it is reviewing the claims and highlighted the safety measures it has developed in consultation with health experts. Responding to the allegations, Google spokesperson José Castañeda said, “For years, we’ve shown hotline information directly in search when someone may be experiencing a mental health crisis. We’ve built those same protections into search A.I. features, connecting people with real-world support.”
The legal action comes amid Google's plans to change how AI services operate on school devices. The company has announced that certain AI features, including Gemini and Search, will be switched off by default in K-12 schools from early 2027. Schools wishing to restore Search will have to enable its existing AI features or opt for a newer AI experience designed to support academic work. There will be no option to bring back Search without AI. A Google executive reportedly attributed this approach to the integration of the two technologies.
What the lawsuit claims
The complaint identifies the student as Emma, a seventh grader from Charlotte, North Carolina. It alleges that she began using AI Mode, Google's conversational feature within Search, while browsing on her school-issued laptop. Her initial searches reportedly led her to the feature, eventually resulting in thousands of exchanges, some taking place late at night.
According to the lawsuit, the AI interactions led Emma to believe she had multiple mental health conditions, weakened her trust in her parents and counsellors, and contributed to thoughts and plans of ending her life. These claims are allegations and have not been established in court.
The situation came to light in mid-March when a school monitoring service flagged concerning writing in Google Docs and alerted the school. Her parents subsequently arranged an emergency psychiatric evaluation. Emma is now attending weekly therapy sessions.
Concerns over parental oversight
The lawsuit also questions the level of control schools and parents have over AI features on educational devices. While school administrators can restrict access to services such as Gemini and YouTube, they have reportedly raised concerns about being unable to separately disable AI Mode and AI Overviews within Google Search.
The complaint further alleges that Google's systems failed to alert Emma's parents or school about warning signs in her searches and conversations. Instead, the family was informed through an independent monitoring service used by the school.
The case brings renewed attention to the responsibility of technology companies to make AI safer for children, while ensuring parents and schools have meaningful control over the digital tools young students use.