ENTER THE MATRIX

Inside China’s chilling network of AI generated PEOPLE on Facebook & Twitter spreading anti-vaxx lies & Covid fake news

CHINA has a sprawling creepy network of AI generated people who it uses to spread anti-vaxx lies and fake news about Covid.

Beijing is believed to use a massive "spamouflage" network to muddy the waters and promote its own interests to unwitting social media users - and its computer generated "people" are perhaps its most disturbing tactic.

Advertisement
None of these people are real - they have all been created in a computer by China

Twitter and Facebook profiles are being fronted by pictures of people who simply do not exist - but have constructed by AI software.

These "people" have never been born - they are simply bundles of code with the illusion of personality, with varying ages, genders, facial shapes and ethnicities.

The photos are almost indistinguishable from real people and are photo realistic with the imperfections that bring faces to life - far beyond what would see in video games like The Sims.

Seeing one crossing your feed on Facebook, Twitter and Instagram you would never think twice that they may be "fake".

Advertisement

And while the cutting edge tech of AI-generated faces has many harmless applications, numerous experts have said China uses a vast network of these people in a wing of its online propaganda campaign.

The AI "people" can help Chinese trolls beat standard checks on fake accounts, such as being able to trace stolen profile pictures using reverse image search.

Fake accounts are also believed to be used to bolster Chinese state media on Facebook - with the state also deploying so-called "warrior trolls" to fight a pro-China PR battle in online spaces in the West.

State-backed newspapers and TV channels have had massive social media growth in recent years as they pump out stories with claims including Covid came from a US lab and that Western vaccines are dangerous.

Advertisement

China appears to have stepped up its efforts over the last few years to spread its narratives and influence people - especially in the wake of the Covid pandemic.

Key questions still remain over China's honesty in the first days of the outbreak as it has been accused of covering up key details and failing to warn the world about the risk.

And the debate still rages to whether or not Covid may have actually leaked from a Chinese bio lab in Wuhan, something Beijing furiously denies - instead deflecting allegations towards the US.

A coordinated influence operation on Twitter, Facebook and YouTube is using a mix of fake and re purposed accounts to push pro-China narratives

Centre for Information Resilience

China's army AI generated people play a key role in trying to shrug off these narratives and fight back against the West - attempting to reach folks with their perspectives and lies directly through social media.

Advertisement

The images are created using a system known as StyleGAN - which is "trained" by studying a set of images, such as a selection of faces, which it then uses create AI generated approximations.

And a second part of the system is trained to recognise fake images.

These two prongs work in tandem to create pictures which can fool even the most diligent human eyes.

Analysis shows all the photos appear to be built around the same 'frame' - results on all the eyes being exactly level
Advertisement
AI generators faces look normal at first glance - but have minor imperfections such as fuzzy hair, extra teeth or warped extremitiesCredit: Centre for Information Resilience
This face fronting an account on Twitter has seen its ears warped - revealing it was created by an AICredit: Centre for Information Resilience
Examples of fake Twitter accounts used to amplify and share Chinese content found by The Centre for Information ResilienceCredit: Centre for Information Resilience

The Centre for Information Resilience have published a new report on the pro-China propaganda networks that rely on these AI faces - as well as other more traditional methods of trolling and misinformation.

Advertisement

Experts found that not only one do the Chinese bots and trolls push pro-China narratives - they also seek to inflame hot button issues in the West, such as race and US gun laws.

"A coordinated influence operation on Twitter, Facebook and YouTube is using a mix of fake and re purposed accounts to push pro-China narratives and distort perceptions on important issues.", the report reads.

Social media accounts with existing followings are sometimes hijacked by China and then turned into shell accounts spouting Beijing's propaganda.

It added: "This research is evidence of a deliberate effort to distort international perceptions on significant issues."

Advertisement

Some deny human rights abuses over Uighur Muslims in China - and meanwhile others attack the US over events such as the killing of George Floyd.

CIR experts found a number of accounts using the AI-generated images to like, comment and share posts on Facebook.

And they noted some of the flaws which can you spot in the pictures, such as slightly warped glasses frames, and the fact they have the exact same composition - with an exactly pinpointed eye line matching in each photo.

Generated.Photos offers a look into the world of AI face - with thousands upon thousands available free of use of any age or genderCredit: Generated.Photos
Advertisement

Social media analyses firm Graphika also produced a report on what it dubbed China's "Spamouflage" network as it deploys armies of fake accounts.

It warned the operation is finally starting to break out of the "echo chamber" of fake accounts and reach real social media users - including some influencers.

They found the network was used to big up China's vaccine and warned of potential dangers of the safe US-made Pfizer-BioNTech jab.

"Spamouflage is a cheerleader for Chinese state narratives of China’s rise and America’s fall," Graphika said.

Advertisement

Videos - often featuring clunky AI generated voices - are also often pumped out by the propaganda operation in multiple languages to try and reach people worldwide.

Facebook announced last year it had taken down a Chinese network of fake accounts using AI generated faces - but the battle continues in the information space.

China denies conducting such campaigns but research continues to reveal that they leverage the manipulation playbook

Theresa Payton

Experts however previously told The Sun Online they believe China remains active on the platform - with its state outlets such as CGTN and China Daily being the far biggest new outlets on Facebook.

China's enormous pages have more followers than some of the world's most popular celebrities - including Will Smith, Lionel Messi, Justin Bieber, Katy Perry and Dwayne 'The Rock' Johnson.

Advertisement

And all of them are known to heavily push China's narrative on the pandemic and other fake news - having been given a negative "red" rating for trustworthiness by monitoring group NewsGuard.

Hannah Bailey, a doctoral candidate at the Oxford Internet Institute (OII), told The Sun Online they suspect a large amount of the followers on these Facebook pages are "inauthentic" users, such as bots.

Ms Bailey explained the colossal follower counts help give the pages gravity and draw in more real users who can then be exposed to China's narratives.

Theresa Payton, the first female chief intelligence officer at the White House, CEO of Fortalice Solutions, told The Sun Online: "China denies conducting such campaigns but research continues to reveal that they leverage the manipulation playbook using various truths in their news organizations, repurposed news adding twists and disinformation, setting up fictional organizations, fake personas, chatbots and artificial intelligence."

Advertisement

Most read in News

VACATION NIGHTMARE
My husband faces 12 years in foreign jail over legal item in his luggage
WAKING NIGHTMARE
Boy, 10, woke up to entire family dead after dad's sick rampage
TRAGIC END
Pastor's body found after puzzling final sighting on neighbor's Ring camera
TOWER OF FIRE
5 explosions & inferno rip through Russian oil depot in Ukraine drone attack

Relations between the West and China remain strained as the Covid pandemic continues to ravage the world - so far killing 4.2million people after emerging in Wuhan in December 2019.

China has enjoyed a rapid recovery after boasting it has dealt with the virus - but is now suffering its worst outbreak since the first wave.

Questions continue to swirl as to whether Covid may have escaped from the Wuhan Institute of Virology, a coronavirus lab just miles from the pandemic's ground zero.

Beijing has denied any allegations - and its been warned tensions between the West and China could become a new "Cold War".

Advertisement
China gives US list of 'its wrongdoings' & demands Americans must STOP them
Topics
Advertisement
You might like
Advertisement
Advertisement
Show More
Advertisement
Advertisement
Advertisement