LATEST

CHARBONNEAU – Influencers and their deepfakes are indistinguishable

(Image: Gerd Altmann, Pixabay)

RESEARCHERS AT McGill University’s Centre for Media, Technology and Democracy uncovered a network of Instagram and TikTok accounts that “steal real people’s faces” and has them speak  about politically sensitive issues.

Astonishingly, many of the followers of the influencers couldn’t notice the difference between the real people and their deepfakes.

Despite obvious indicators that the deepfake videos were AI created, such as accent switches and facial glitches, many viewers failed to notice the difference. Only 6.3 per cent of comments on the videos suggested they were bot-made, fake or otherwise suspect.

Thousands of users tried to engage in human-to-human responses with the deepfakes.

And the deepfakes tricked platform detection systems too, such asTikTok. Its automated tools flagged only 4% of the videos as AI-generated.

It’s sadly laughable that some influencers and their deepfakes post the same drivel: misinformation about vaccines and health, control by the deep state, the “Great Reset” and the World Economic Forum.

Who are these deepfake creators?

The McGill report couldn’t say. The behaviour of the creators suggests that it’s a paid operation; the posting schedule appeared to follow workday hours. The posts appeared to come from timezones in East or Southeast Asia but the country could not be identified..

And why would anyone have deepfakes parrot the same nonsense as the real person? Double the nonsense equals the same nonsense.

Disinformation analysts point to motives behind this campaign.

Here are a few theories.

One is “Audience Farming.” The deepfake network is building credibility and reach for future use. Outrage-inducing political content, such as fabricated stories about the U.S.-Canada trade war is one of the fastest ways to gain millions of views.

Once an account amasses a large, trusting following, operators can sell the account, pivot to financial scams, or deploy it for targeted political influence during a critical future event.

Another theory is that they want to sow chaos and polarization.

McGill researchers found that the accounts in this network did not stick to one ideological perspective; they frequently switched nationalities and took opposing sides in debates.

Rather than convincing viewers of one specific view, the goal of “both-sides” disinformation is used to manufacture division – setting Canadians against Americans, Canadians against their own government and against each other.

Another idea is that they were testing their AI tools to see whether they could  evade detection.  They may have been using deepfakes as a “live sandbox” to test a commercial AI tool or “disinformation-as-a-service” platform.

The fact that TikTok’s automated tools flagged only 4% of the videos as AI-generated proved that their tool can bypass detection at a large scale, making it valuable to paying clients.

Or maybe they were “Click-Farming.”  Financial gain is the most common driver for deepfake networks globally. They could cash in on platform creator funds, affiliate links, or crypto schemes once accounts qualify for payouts.

Misinformation can not only serve the goals of foreign agitators, it can generate marketing possibilities.

And we are the product that is  being sold.

David Charbonneau is a retired TRU electronics instructor who hosts a blog at http://closetproductions.ca/EyeView/eyeviewcover.htm

Mel Rothenburger's avatar
About Mel Rothenburger (12255 Articles)
ArmchairMayor.ca is a forum about Kamloops and the world. It has more than one million views. Mel Rothenburger is the former Editor of The Daily News in Kamloops, B.C. (retiring in 2012), and past mayor of Kamloops (1999-2005). At ArmchairMayor.ca he is the publisher, editor, news editor, city editor, reporter, webmaster, and just about anything else you can think of. He is grateful for the contributions of several local columnists. This blog doesn't require a subscription but gratefully accepts donations to help defray costs.

Leave a Reply