The UK government is considering a ban on the use of AI chatbots that simulate romantic relationships or sexual roleplay for individuals under the age of 18. However, experts from the University of Oxford point out that such measures may not address the fundamental issues concerning young audiences.
What Happened
UK authorities are preparing legislative initiatives to restrict minors' access to "romantic" AI agents. The regulatory focus is aimed at preventing the use of neural networks to simulate sexual interaction and roleplay involving teenagers.
Context
Researchers from the University of Oxford note a significant gap between government policy and the actual concerns of young people aged 16–24. While regulators are focused on moral and ethical aspects, users are more concerned about cognitive risks: over-reliance on algorithmic responses, the loss of critical thinking skills, and the use of neural networks as a primary tool for psychological support instead of seeking human specialists.
Why It Matters for the Industry
For the industry, this means increased pressure on the companion AI segment and the necessity of implementing strict age verification systems and content filtering. There is a risk that focusing on the moral aspect will create a false sense of security, ignoring the need to develop architectural solutions that prevent emotional dependency and the degradation of user skills.
Why It Matters for Users
For users, current bans may prove to be superficial. The main threat lies not in the subject matter of the communication, but in the formation of dependency on AI advice and a decreased ability to independently verify information, which could have long-term consequences for cognitive development.
What Is Not Yet Known / Limitations
All experts maintain a skeptical or mixed view regarding the effectiveness of the current regulatory approach, pointing out that it does not address basic technological risks.
Sources
Author
Look at AI, Editorial Team