Majority of UK Children Express Fear Over AI-Generated Inappropriate Content
A comprehensive new study has revealed that over three out of five young people in Britain are deeply concerned about artificial intelligence being exploited to create inappropriate images of them. The research, conducted by the UK Safer Internet Centre in partnership with Nominet for Safer Internet Day, surveyed 2,000 parents alongside 2,000 children and teenagers aged between eight and seventeen years old.
Widespread Anxiety Among Young People and Parents
The findings show that 60% of children and adolescents voiced significant concern about someone utilising AI technology to generate inappropriate pictures of them. This anxiety is mirrored among parents, with nearly two-thirds (65%) of those surveyed expressing worry about AI being weaponised to create such content targeting their offspring.
Perhaps more alarmingly, the research indicates that these fears are grounded in reality. More than one in ten (12%) teenagers aged between thirteen and seventeen reported having already witnessed peers their age deploying AI to generate sexual images and videos of others without consent.
High AI Adoption Despite Concerns
Despite these significant anxieties, the study reveals that artificial intelligence has become deeply embedded in young people's lives. An overwhelming 97% of the 2,000 youngsters surveyed confirmed they are actively using AI technologies, with more than half (58%) believing that AI enhances their daily lives.
Over two in five (41%) young respondents indicated that AI can provide emotional support, while more than a third (34%) stated specifically that it assists with their mental health and overall wellbeing. This reliance on technology for emotional support has raised additional concerns among educators and child protection experts.
Educational Implications and Parental Awareness Gap
The research uncovered significant discrepancies between parental awareness and children's actual AI usage for academic purposes. While only 31% of parents believed their children were using AI for homework assistance, more than half (54%) of young people admitted to employing the technology for their school assignments.
Furthermore, half of the young respondents reported seeing their peers use AI to complete school or home assignments, highlighting how widespread this practice has become in educational settings.
Expert Concerns and Government Response
Daniel Kebede, general secretary of the National Education Union, expressed serious concern about the findings, particularly emphasising the extensive use of AI among young people. He stated: "Young people are already using AI at an unprecedented rate, including for their homework and studying. Yet the evidence is clear that the risks of AI use in education, particularly for young people's learning and development, overshadow the benefits."
Mr Kebede highlighted the number of young individuals relying on AI for emotional support and those anxious about AI being used to generate inappropriate images, urging: "These findings must serve as a clarion call for Government to act urgently to ensure that children have the information, support and resources they need to make informed, safe and ethical decisions about AI."
Regulatory Investigations and Policy Developments
The research emerges against a backdrop of increasing regulatory scrutiny. The UK's data watchdog has launched a formal investigation into X and xAI regarding their adherence to British law, following incidents where the chatbot Grok was exploited to produce sexual deepfake images without permission.
Communications regulator Ofcom has also opened an inquiry into X and its chatbot, prompting the platform to introduce new safeguards to address the concerns highlighted by researchers and child protection advocates.
Government Initiatives and Educational Technology Plans
Despite growing opposition to social media for children and mobile phones in schools, the Government continues to advocate for the advantages of AI learning tools in educational settings. The Department for Education has revealed ambitious plans to recruit over 1,000 schools and colleges to trial cutting-edge technologies designed to enhance learning.
AI-powered tutoring is set to be rolled out to disadvantaged pupils across all schools by the close of 2027, representing a significant investment in educational technology infrastructure.
Ministerial Statements on AI Safety
Technology Secretary Liz Kendall commented on the research findings, stating: "This research shows that young people are embracing AI in remarkable ways; using it to learn and save time. This is exactly how we want technology to support people of all ages. But its true benefits won't be realised until AI is both safe and accessible to everyone."
The minister continued: "We are investing in safe AI tutors for disadvantaged children and upskilling millions of people across the country, while launching a national conversation on how we build a safer, fairer and more empowering digital future for every child."
She concluded firmly: "We are also clear that no-one should be victim to AI being weaponised to create abhorrent explicit content without their consent. That's why we brought forward a new criminal offence to ban it."
Broader Implications and Future Challenges
The research highlights the complex relationship young people have with artificial intelligence, simultaneously embracing its benefits while fearing its potential misuse. A third of parents (33%) expressed anxiety about AI's effect on their child's cognitive abilities and educational development, while a comparable proportion (35%) of young people admitted that AI has diminished their personal creativity.
Despite these concerns, the schools regulator Ofsted has discovered that teachers are predominantly optimistic about AI's ability to reduce administrative burdens and enhance teaching quality, suggesting that the technology's educational potential remains significant if properly regulated and implemented.
