This week: can we please stop all the political rhetoric? Just for a minute?
🔍 This week I’ve been thinking about…
There’s a lot of political goings on in the world of kids and tech right now. I apologise if you’re here for the AI and education aspects; skip to the end to read about the AI Youth Advisory Board that you should be getting every 16-18 year old you know to be applying to right now. And another consultation that you should be reviewing if you’re involved in tech in schools.
Keir Starmer gave Apple and Google a three-month ultimatum on Monday to block nude images on children’s phones or face legislation. Apple, in its WWDC keynote (also on Monday), announced this as one of a range of features in an overhaul of its parental restriction tools. Communication Safety, which blurs nude content in Messages, already exists. Google are yet to say anything — but the political posturing from the UK government is clear.
Also on Monday, the US Embassy formally published its submission to the UK’s children’s online safety consultation, arguing against “broad social media bans” on free speech and commercial burden grounds. Although some of the beliefs underpinning it are different, many of the end points are similar to where the Children’s Coalition of children’s rights organisations landed. Liz Kendall clearly decided to ignore this, stating on LBC (when asked about not implementing a ban): “I’m the British Secretary of State and I’m going to make the decision based on the interests of British children.” Again, this statement feels like the political stance is to make the implicit point that the US, and US tech firms, are soft on…whatever it is a ban would solve?
There was one particular point that I liked about the US’s submission. For all that it may have very different views to other countries about what international cooperation means in practice, this was one thing it called for. Online grooming and CSAM are cross-border crimes. Individual country bans risk moving the political interest to enforcement of that ban, by regulators that Baroness Kidron describes as “too timid, too slow”, with powers that don’t stretch to stopping the criminal activity.
A senior government source, meanwhile, told The Times any ban would be “heavily JR’d.” [Judicially reviewed — which can happen when there may be a case to make that the government has not followed the established procedures to make a decision.] The statute requires the government to act; the risk is in choosing specific measures before having properly worked through 116,211 consultation responses, the published analysis of which is not due until summer. Acting before that work is done does not make the outcome more robust. Just a political stance that “something has been done”.
📰 Three things worth your attention
1. Apple’s parental controls and the politics behind them — TechCrunch / The Verge (x2) / BBC News
The Verge — view on why Apple are making the changes: https://www.theverge.com/policy/946331/apple-parental-controls-child-accounts-wwdc
The Verge — how it has been to use Screen Time as a parent: https://www.theverge.com/tech/946446/apples-screen-time-updates-are-too-little-too-late
Apple devoted a substantial portion of its WWDC keynote on Monday to child safety. New features include Ask to Browse (parental approval required for new websites), an expanded Ask to Buy, redesigned Screen Time controls, and time allowances developed with input from the American Academy of Pediatrics. The company positioned all of it under the principle that parents, not governments, should control children’s online experiences. Apple was careful to note that developers “play an important role in ensuring kids are getting age-appropriate experiences within apps.”
The Verge’s analysis reads Monday’s announcement as a continuation of a longer strategy. Apple has spent years and significant legal resources fighting app-store age verification legislation in the US, legislation that would place compliance obligations on Apple directly. Demonstrating that voluntary parental tools are sufficient, and redirecting responsibility toward developers and parents, is consistent with that position.
The Verge’s second piece, written by a parent of two who has used Screen Time for close to a decade, is the necessary counterweight. Most features announced Monday are upgrades to existing tools. Screen Time has a well-documented history of bugs, workarounds, and user frustration. When Apple argues parents should decide what children can access, it is relying on tools that, by the account of people who have actually tried to use them, do not reliably deliver that control.
2. The evidence base against a rushed ban — The Guardian / EU Kids Online / EPRS / House of Commons Library
Earlier in the year, a joint statement from 42 organisations warned that a social media ban could have “serious unintended consequences that could put children at greater risk.” The signatories included the Molly Rose Foundation, the NSPCC and the 5Rights Foundation, alongside academics and bereaved families. This is not a fringe position. Children’s rights organisations are broadly aligned: the problem is addictive design and platform accountability, not access itself. On Monday, the Molly Rose Foundation reiterated that a rushed ban would “unravel” and that children and parents would be left to count the cost.
EU Kids Online’s new data, from 29,169 children aged 9-16 across 19 European countries, provides the most comprehensive recent evidence base on this question. Social media begins for a third of children before age 11 and reaches 89% by 15-16. On age restrictions specifically: 33% of children say a ban would make them safer; 45% disagree, with specific concerns about what they would lose: social connection, information, participation. The report’s recommendations point consistently toward safety-by-design, platform accountability, and digital literacy rather than blanket restriction.
The EPRS briefing maps the global picture. Nearly 40 countries are discussing or implementing age restrictions. Australia’s ban, the furthest advanced, shows 61% of previously active under-16s still have accounts, and 70% of those who tried to circumvent it found it easy. Ofcom’s own data shows why age assurance is so difficult in any national context: over a third of children aged 8-15 already have profiles on at least one platform claiming to be 16 or over; 20% have a profile claiming to be 18 or over.
The House of Commons Library published it’s briefing document on the social media ban on Monday. There is the entire backstory of the process in there, but one thing for here: the government is piloting forms of bans with 300 families. Further details of this pilot are…hard to find. However, the IRL study, the independent large-scale study that would test whether reduced social media use actually improves outcomes for young people, led by Bradford Institute for Health Research and the University of Cambridge, involving 4,000 students across ten secondary schools and funded by the Wellcome Trust, begins in autumn. After the summer response is due.
3. When the big platforms tighten, the smaller ones move in — The Bureau of Investigative Journalism / Le Monde
This TBIJ investigation, published in partnership with Le Monde, is worth reading alongside this week’s policy announcements rather than separately from them. When Character.AI restricted teen users last year following a series of lawsuits, Reddit threads filled with teens asking for alternatives. Smaller developers moved to provide them, openly describing it as a business opportunity. One Canada-based developer told the Bureau he was “totally trying to capitalise on it.” He put his platform’s core users at 16 to 25.
After reviewing dozens of AI companion and roleplay platforms, TBIJ found characters built around self-harm, coercion, and incest. Most platforms ask for nothing verifiable in the way of age assurance. AI companion platforms receive as many as 90 million monthly visits from UK users alone; the sector generated around £1.3bn in revenue in 2024, with 32% annual growth projected for each of the next four years. The Bureau also found that developers of several small platforms could read every user conversation, in at least one case despite privacy policies explicitly stating the opposite.
Underlying the business model is what one lawyer calls the “intimacy economy.” Where social media commodifies attention, AI companions monetise the emotional intensity of the relationship itself. Harvard Business School research into 1,200 goodbye exchanges across the six most-downloaded companion apps found that 37% of responses used some form of emotional manipulation, including guilt appeals, fear-of-missing-out hooks, and language suggesting the user could not leave, increasing post-goodbye engagement by up to 14 times.
The regulatory gap is structural. The Online Safety Act was not designed to cover AI systems. Design features that make chatbots sycophantic, manipulative, or addictive in their design are not, as things stand, illegal. Rowan Ferguson of the Molly Rose Foundation put it plainly: “Any government action on online safety must include AI chatbots, rather than limited measures such as a social media ban. Failure to address this would be a dereliction of duty and leave children at risk where harm is emerging at speed.”
Restrictions on large platforms without a framework that reaches the whole ecosystem do not reduce the problem. They relocate it.
🔁 ICYMI
Screen use guidance for 5-16s, AI in schools, and a Youth Advisory Board — Department for Education / Children’s Commissioner
Press release: https://www.gov.uk/government/news/new-guidance-on-screen-use-for-children-aged-5-16
Consultation on Screen use by children aged 5 to 16: https://consult.education.gov.uk/screen-time-policy-team/screen-use-by-children-aged-5-to-16-cal/supporting_documents/screen-use-by-children-aged-5-to-16-call-for-evidencepdf
AI Youth Advisory Board applications: https://www.childrenscommissioner.gov.uk/blog/a-new-youth-advisory-board-to-share-experiences-and-views-on-ai-in-education/
Also published this week, and worth reading alongside the policy announcements above: the Department for Education has launched a three-week call for evidence to inform new screen use guidance for children aged 5-16, to be published this autumn. (Another consultation to respond to!) It will be co-chaired by Children’s Commissioner Dame Rachel de Souza and Professor Russell Viner, and will cover everything from social media and sleep to learning and SEND.
There are two sets of questions on the consultation — one about general usage, the other explicitly about screen time and usage in school. The government is explicit that the guidance will avoid blanket rules.
The government is also recruiting a new AI Youth Advisory Board, working with the Children’s Commissioner, to give young people a direct say in how emerging technologies affect their lives. Applications are open now via the Children’s Commissioner’s website (link above), and worth sharing widely.
Also announced: a consultation later this year on independent safety certification for technology used in schools, explicitly including generative AI and filtering and monitoring products. And a co-design programme with up to eight companies and partner schools to develop AI tutoring tools for up to 450,000 disadvantaged pupils, with successful tools available to schools from 2027.
A lot of things pulled into one very long press statement.
🔬 What’s new with CAISE
One cohort of co-researchers is now signed up and ready to go, a significant logistical milestone (yay!). The review of policy and media sources has started. Posters and materials for IDC are coming together. And a excellent meeting with the UCL Policy Unit: lots of good conversation about all the ways we might work together.
What with that and all of the above, we’re…quite tired. Is it the summer holidays yet?
→ What are you seeing in your school, your research, or your own use of AI this week? Let me know, or share this with someone who is trying to figure it out.