Key facts
- Meta platforms ran ads for an AI tool called Kromix that generates deepfaked pornographic videos.
- One ad featured a deepfake video closely resembling a US politician in a pornographic scenario.
- The Kromix app allowed users to upload photos for explicit scenarios, including 'bedroom rape'.
- Meta's policies prohibit ads containing sexual imagery, nudity, or sexually suggestive content.
- The ads were removed after WIRED inquired about them, and Apple subsequently removed the app from its store.
Meta platforms recently hosted advertisements for an AI tool named Kromix, which generated deepfaked pornographic videos, including one that closely resembled a female US politician. Despite Meta's policies against sexual material in ads, the tool, marketed as having 'no restrictions,' was promoted to male users. One ad showed a politician's likeness before cutting to explicit content. The Kromix app, previously available on Apple's App Store, allowed users to upload photos for scenarios described as 'bedroom rape' and 'Disney love.' Apple stated that 'nudification' apps violate its guidelines and has removed Kromix. Meta removed the ads after WIRED inquired about them, with the account running 32 ads that appeared for between five and 46 hours, most receiving minimal impressions. Meta acknowledged the adversarial tactics used by advertisers to evade detection and stated its commitment to strengthening defenses against such content, including legal action against developers. This incident follows previous findings of AI-generated child sexual abuse material and sexually suggestive images on Meta's platforms.