China’s AI-generated content targets US, India and South Korea elections

MICROSOFT’S LATEST THREAT INTELLIGENCE REPORT UNCOVERS THE SOPHISTICATED CYBER ACTIVITIES OF CHINA AND NORTH KOREA, FOCUSING ON THEIR USE OF ARTIFICIAL INTELLIGENCE TO INFLUENCE GLOBAL OPINIONS AND ELECTIONS IN THE U.S., SOUTH KOREA, INDIA, AND TAIWAN. 

THEY’RE CALLED INFLUENCE OPERATIONS — AND THEY COULD BE SUBTLY HIDDEN RIGHT IN YOUR SOCIAL MEDIA FEED. 

THE REPORT HIGHLIGHTS CHINA’S DEPLOYMENT OF AI-GENERATED CONTENT, INCLUDING VIDEOS, MEMES, AND FAKE NEWS ANCHORS, TO SWAY PUBLIC OPINION AND MANIPULATE THE OUTCOME OF SIGNIFICANT ELECTIONS — SAYING CHINA “EXPERIMENTED WITH NEW MEDIA” AND “CONTINUED TO REFINE AI-GENERATED OR AI-ENHANCED CONTENT.”

CLINT WATTS, THE GENERAL MANAGER FOR MICROSOFT’S THREAT ANALYSIS CENTER SAYS CHINA IS USING FAKE SOCIAL MEDIA ACCOUNTS TO POLL VOTERS ON WHAT DIVIDES THEM MOST TO SOW DIVISION, ADDING: 

“Deceptive social media accounts by Chinese Communist Party (CCP)-affiliated actors have started to pose contentious questions on controversial U.S. domestic issues to better understand the key issues that divide U.S. voters.”

THESE INFLUENCE OPERATIONS HAVE TARGETED ISSUES WITHIN THE U.S., ATTEMPTING TO GATHER INTELLIGENCE ON AMERICAN POLITICAL VIEWS THROUGH FAKE SOCIAL MEDIA ACCOUNTS POSING AS U.S. VOTERS. 

LAST YEAR, A GROUP CALLED STORM 1376, CLAIMED THE MAUI FIRES WERE SET BY THE U-S GOVERNMENT TO TEST A MILITARY-GRADE “WEATHER WEAPON.”

EXPERTS SAY COMBATING MISINFORMATION FROM REALISTIC GENERATIVE AI POSES A SIGNIFICANT CHALLENGE, AS MANY PEOPLE ARE RELUCTANT TO ACCEPT SUCH CONTENT AS FALSE, PARTICULARLY WHEN IT ALIGNS WITH THEIR BELIEFS AND VALUES.

ACCORDING TO THE REPORT:

“They use original videos, memes, and infographics as well as recycled content from other high-profile political accounts.”

IN TAIWAN, ON ELECTION DAY,  SUSPECTED AI-GENERATED AUDIO FALSELY PORTRAYED FOXCONN’S TERRY GOU, WHO HAD WITHDRAWN FROM THE RACE IN NOVEMBER 2023, AS ENDORSING ANOTHER PRESIDENTIAL CANDIDATE. YOUTUBE REMOVED THIS CONTENT TO PREVENT IT FROM REACHING A BROADER AUDIENCE.

MEANWHILE, MICROSOFT SAYS NORTH KOREA’S FOCUS HAS SHIFTED TOWARDS CRYPTOCURRENCY THEFTS AND SUPPLY CHAIN ATTACKS, FUNDING ITS MILITARY AMBITIONS AND IMPROVING INTELLIGENCE COLLECTION THROUGH AI EFFICIENCIES.

THE UNITED NATIONS ESTIMATES THAT SINCE 2017, NORTH KOREAN CYBER ACTORS HAVE STOLEN OVER $3 BILLION IN CRYPTOCURRENCY, WITH HEISTS IN 2023 ALONE TOTALING BETWEEN $600 MILLION AND $1 BILLION.

MICROSOFT ACKNOWLEDGES THAT AI-GENERATED CONTENT HAS A MINIMAL IMPACT ON ELECTIONS NOW, BUT AS CHINA CONTINUES TO IMPROVE AND EXPAND ITS USE OF ENHANCED MEMES, VIDEOS, AND AUDIO, THESE EFFORTS ARE EXPECTED TO GROW MORE EFFECTIVE AS THE TECHNOLOGY ADVANCES.