The Electoral Commission is working with the Home Office on a pilot project to combat the use of deepfakes targeting candidates in this year's Scottish and Welsh elections. Officials expect software capable of detecting AI-generated deepfake videos and images to be operational before campaigns begin in late March.
Sarah Mackie, the commission's chief in Scotland, said that if the software detects a hoax video or image, officials would contact the police, the candidate concerned, and inform the public. However, she acknowledged that the software cannot always provide 100% certainty. The commission would then urge social media platforms to take the content down, but such action is currently voluntary.
Mackie said the commission has urged the UK government to introduce legally enforceable 'takedown' powers that would require platforms to remove hoax material. 'What we don't have at the moment, and what we want, is called takedown powers – where we approach social media companies and demand something is taken down,' she stated.
While no deepfakes have emerged in UK election campaigns so far, their use has surged abroad, accelerated by free AI image-generation tools. British elections have repeatedly been targeted by state-sponsored fake social media accounts from countries including Russia, Iran, and North Korea.
The commission is also working with the Scottish parliament and police on a 'safety and confidence' project to support women and minority ethnic candidates who experience abuse or harassment. A 2022 study found about half of all female election candidates had experienced abuse, with many saying they would not stand again. Mackie noted that AI-driven 'undressing' technology, such as that generated by Elon Musk's Grok AI platform, would be reported to the police if used during an election.
A Home Office spokesperson said the Online Safety Act requires social media companies to remove unlawful content and prevent the spread of false information. 'Protecting elections from the threat of sophisticated deepfakes is vital to maintaining public trust in our democratic system,' they added. The pilot project could be rolled out for all UK elections if successful.
