Artificial intelligence is making it cheaper and faster to spread disinformation, raising fears it could be weaponised in future elections across south-east Asia, a region with predominantly young and hyper-connected populations.
In a recent case, Anthropic revealed how its Claude AI was used in a political influence operation in Malaysia. The operation created a commercial election manipulation platform using about 1,000 X accounts, a fake news outlet called “Malaysia Pulse”, and fabricated documents.
The operation appeared designed to target voters in recent state elections, using census and electoral data to exploit sensitive political and social fractures, including race, religion, and royalty across all 222 Malaysian parliamentary constituencies.
AI's new sophistication
The experiment was ultimately ineffective once Anthropic stepped in, but it has sparked alarm about how AI could be used in future elections in the region, which is already deeply vulnerable to fake news.
Katie Harbath, who formerly worked on public policy for global elections at Meta, says the case shows how AI brings a new level of sophistication and ease to the disinformation landscape.
“AI can supercharge it in terms of you can make a lot more content that’s more personalised, quicker and cheaper,” says Harbath, who now heads the tech consultancy company Anchor Change. “But you still need a distribution mechanism, and at the moment, that’s still your more social media type platforms.”
Anthropic detailed the Malaysia election operation in its latest threat assessment, released in September. The report revealed how actors used Claude to build networks of fake social media profiles and news websites that targeted audiences on six continents. Anthropic said the actors included “governments, state-aligned propaganda institutions and state media, as well as private firms selling influence”.
Fake news 'petri dish'
South-east Asia is no stranger to disinformation. In recent years, Nobel laureate and Filipino journalist Maria Ressa has likened the Philippines to a “petri dish” for the weaponisation of disinformation and fake news, with techniques tried and tested in the region later replicated in the west.
But AI makes it much easier. “Basically AI is just mimicking what we would have, I guess, termed a few years ago, a troll factory,” says Rossine Fallorina of Sigla, a Philippine thinktank that researches AI. “Mostly because it speeds up the production process. So you don’t need 10 people to create a narrative or a story. You can just prompt it and then have it propagated.”
Last year, OpenAI banned accounts using AI to generate comments about Philippine politics and public officials across social platforms, with many fictitious comments generated in support of President Ferdinand Marcos Jnr.
Divisive potential
Across the region, some fear the divisive potential of AI on social media. “It feeds political polarisation and it feeds on divisions,” says Bridget Welsh, from the University of Nottingham Asia Research Institute Malaysia. “That’s really what’s concerning about the fragmented nature of what’s happening in Malaysia.”
Malaysia’s general election could be called for late 2027, while the Philippines and Cambodia have polls in 2028, and Indonesia the following year.
Already in the region, AI has been effective. In Indonesia, an AI-generated cartoon image of now-president Prabowo Subianto that helped soften his strongman image became wildly popular in the 2024 election.
It has also been used to inflame tensions, such as inciting hatred toward ethnic Rohingya refugees who fled to Malaysia from Myanmar during the civil war, says Dr Ben Loh, a media lecturer at Monash University Malaysia.
“It’s come to the point where people already have this deep-seated hate in their minds and when they see the content like this, even though it’s AI-generated to them, it’s merely reinforcing what they believe is already true,” says Loh.
The Anthropic report notes that the fake news outlet scraped legitimate Malaysian reporting and had the model rewrite it several times before republishing it under fabricated bylines. It also republished articles from Russian and Chinese state-aligned foreign outlets, including TV BRICS, Xinhua, Sputnik/RIA, and CGTN, stripping them of attribution.
Anthropic said in its threat assessment that in each case of identified political influence the company “disrupted the activity, used what we learned to strengthen our safeguards, and shared intelligence with authorities and industry partners, where appropriate”.
In future, Harbath says AI could be used to “flood the zone” in an attempt to influence the large language models (LLMs) from which AI models draw their information. “If there’s any sort of news drought, or if you have a place where there’s mostly government-sponsored media,” she says, “It wouldn’t take very much money to kind of flood the zone.”
