London, United Kingdom — New regulations targeting artificial intelligence chatbots that may jeopardize children’s safety are set to be introduced by Keir Starmer, leader of the Labour Party. The proposed measures could result in significant fines or even the suspension of services for companies that fail to comply, reflecting the government’s growing concern over the risks posed by these technologies.

The push for stricter regulations comes on the heels of public outcry following Elon Musk’s decision to suspend the Grok AI tool from generating explicit images in the UK. In response, government officials are determined to prevent what they describe as “vile illegal content created by AI.” The need for urgent legislative action is amplified by the increasing reliance of children on chatbots, whether for homework assistance or mental health support.

Starmer indicated that the government plans to eliminate existing loopholes in the Online Safety Act, making it mandatory for AI chatbot providers to adhere to regulations regarding illegal content. This could compel companies to act swiftly or face dire consequences. Additionally, new constraints on social media usage among children could be established as early as this summer, depending on the outcome of a public consultation that might lead to a ban on children under 16 accessing such platforms.

Critics, particularly from the Conservative Party, argue that the timeline presented by the government is misleading. Laura Trott, shadow education secretary, emphasized that claiming to take “immediate action” is disingenuous if the consultation has not yet commenced. She called for decisive measures to prevent children under 16 from using social media.

The urgency of these proposed changes was underscored by the recent admission from Ofcom, the UK’s online regulator, that it lacks the authority to regulate chatbots like Grok, especially when they generate content independently. The government expects to move quickly to amend the law in response to this regulatory gap, which has been known for over two years.

Starmer stressed the importance of adapting legislation to keep pace with rapidly evolving technology. He asserted that the government’s decisive action regarding Grok serves as a clear warning that no platform will escape scrutiny. Closing these loopholes is a priority, especially given the potential dangers to children.

Companies that fail to comply with the Online Safety Act face fines up to 10% of their global revenue, and regulators can seek legal avenues to block their operations within the UK. Currently, while AI chatbots used as search engines or in user-to-user contexts are within the law’s purview, they can still produce harmful content, such as material that promotes self-harm or child exploitation, without facing sanctions.

Chris Sherwood, CEO of the NSPCC, remarked on the growing alarms raised by young users about the adverse effects of AI chatbots. He cited troubling instances, including a 14-year-old girl receiving harmful advice about body image from a chatbot, which illustrates the urgent need for better safety measures.

Sherwood highlighted the double-edged sword of social media, which offers both benefits and significant risks for young users. If not vigilantly managed, he warned, the ramifications of AI could exacerbate these dangers.

OpenAI, the organization behind the popular chatbot ChatGPT, and the makers of Grok, have been approached for their input as these legislative changes unfold. Following a tragic event linked to misuse of ChatGPT, where a young person reportedly faced significant distress from interactions on the platform, OpenAI has initiated measures like parental controls and age-verification technology.

The government is also considering stricter rules to prevent the circulation of nude images of minors on social media, reinforcing existing laws against such practices. Technology Secretary Liz Kendall assured that the administration will act without delay to safeguard families while setting the stage for swift responses to the findings of upcoming consultations regarding youth interactions with social media.

The Molly Rose Foundation, formed after the suicide of a young girl who faced harmful online content, welcomed these preliminary moves but urged for more robust legislation to ensure that tech companies prioritize child safety as part of their operational mandates.