Key facts
- Generative AI is being used to industrialize scam operations in Southeast Asia.
- Google is suing a network, 'Outsider Enterprise,' for allegedly using its AI models to defraud people.
- The scam operation sold subscription-based phishing kits that included AI-generated code and templates.
- The FBI reported that the platform facilitated the theft of millions of payment cards and approximately $3.87 billion in losses.
- The UN estimates that at least 300,000 people are involved in scam operations across Southeast Asia, with significant human rights abuses.
- ASEAN countries are increasing regional coordination to combat cybercrime and online scams.
Generative artificial intelligence has become a key tool for industrializing scam operations in Southeast Asia, enabling fraud at an unprecedented scale. Google has filed a lawsuit against a cybercrime network, dubbed 'Outsider Enterprise,' which allegedly used the company's own AI models to defraud hundreds of thousands of people.
The lawsuit details how Outsider Enterprise operated as a subscription service, offering phishing kits for as little as $88 per week. These kits included AI-generated code and over 290 pre-made templates designed to impersonate banks, government agencies, and retailers. Google claims the network created approximately 9,000 fake websites and 1 million fraudulent domains, sending out 2.5 million scam texts to Android users within a two-week period. The FBI, in conjunction with Google and Lumen's Black Lotus Labs, reported that this platform facilitated the theft of roughly 3.87 million payment cards and caused approximately $1.9 billion in losses since July 2023.
AI has significantly lowered the barrier to entry for committing fraud, removing language and labor constraints that previously limited scam operations. This has allowed these illicit businesses to flourish within fortified compounds across the Mekong region, where many workers are themselves victims of trafficking and forced labor. A UN human rights report estimated that at least 300,000 people are working in these scam operations, with the industry generating an estimated $64 billion globally per year, and over $43.8 billion from the Mekong region alone.
In response to the escalating problem, the U.S. Department of Treasury announced new sanctions on Southeast Asian scam centers, citing a 66% increase in scams originating from the region between 2023 and 2024. Americans alone lost an estimated $10 billion to these operations in 2024. ASEAN Member States have adopted a declaration and action plan to combat cybercrime and online scams, with Thailand leading the establishment of a working group on anti-online scams and Singapore expected to spearhead an ASEAN Task Force for cross-border law enforcement operations.