UK warns parents over child photos amid AI abuse fears

The UK National Crime Agency (NCA), alongside the Internet Watch Foundation (IWF), has released guidance for parents on protecting children from the growing threat of AI-generated child sexual abuse material (CSAM). The advice stems from concerns that images of children posted online can be scraped and manipulated using increasingly sophisticated AI tools.

The NCA and IWF are not dictating parental behavior but are urging awareness of the risks. Key recommendations include making social media accounts private, utilizing 'close friends' features for photo sharing, and regularly auditing existing online photos. Parents are also encouraged to discuss image consent with institutions like schools and sports clubs, considering that past agreements may not account for current AI capabilities.

Advances in AI technology have provided criminals with accessible tools to create CSAM without direct victim interaction or grooming. This has led to instances where minors have been blackmailed after their images were altered into explicit content. The IWF reported a 14% increase in AI-generated CSAM last year, identifying over 8,000 such images and videos in 2025. Cases have emerged where images from social media or school websites were used to create fake nude material, leading to extortion threats.

To mitigate these risks, the guidance suggests reviewing privacy settings, controlling who sees children's images, and engaging in open conversations about image publication consent. The IWF's chief technology officer expressed discomfort but acknowledged the necessity of advising caution regarding online photo sharing due to the lack of protection against AI manipulation.