The European Union is grappling with the implications of its proposed 'Chat Control' legislation, which aims to combat child exploitation online by scanning private digital communications. The core of the debate lies in how to achieve this without undermining the privacy of legitimate user communications, particularly those protected by end-to-end encryption.
Currently, a temporary regulation allows platforms to voluntarily scan private messages for child sexual abuse material (CSAM) until 2028. However, this does not apply to end-to-end encrypted services like Signal or WhatsApp in the same manner as other platforms. A more permanent proposal, dubbed 'Chat Control 2.0', is still under negotiation, with the critical question remaining whether it will extend to scanning encrypted chats.
Detection tools primarily use hash matching, which compares content against a database of known illegal material, or machine-learning classification to identify grooming language patterns. Patrick Breyer, a digital rights activist, argues that both methods are prone to high rates of false positives, citing German figures where over 50% of reports were not criminally relevant. He also points to issues with how databases are vetted against European law.
For end-to-end encrypted services, where providers cannot access messages after encryption, scanning would need to occur on the user's device before encryption is applied, a process known as client-side scanning. This is a major point of contention, as it involves inspecting messages while they are still readable.
After a match is flagged, it is typically reviewed by human moderators before being reported to authorities. However, Breyer contends that this review process is also flawed, with varying legal standards and misclassifications of ordinary teenage communications. He advocates for scanning only when an independent court confirms reasonable suspicion, comparing it to a warrant for opening mail, rather than mass scanning.
As an alternative, Breyer suggests proactive scanning of the open and dark web for known illegal material and implementing 'security by design' features that warn users before sharing sensitive content, without the content leaving their device. For now, the fate of private messages under 'Chat Control' depends on the app used, but the ongoing negotiations for a permanent proposal could significantly alter this landscape.