Slop factory bans Russians for using slop factory to create slop
ChatGPT may spew a lot of digital garbage onto the internet, but the same bots that output the trash can be used to stop it.
The company draws the line at influence operations that want to slop in the name of love . . . of mother Russia.
OpenAI said in a Tuesday blog post that it had identified a cluster of accounts originating from Russia using ChatGPT to produce social media posts and comments directing internet denizens to what appears to be a fake Israeli think tank critical of the west and supportive of Russia.
“What began as an investigation into AI-generated social media posts led us to a much broader influence operation,” OpenAI said in its report on the ban of the accounts and what it had found.
That said, it appears the Russian efforts were still largely ineffective.
“Although the campaign appears to have reached relatively small audiences, its elaborate construction distinguishes it from other Russia-linked influence operations we have disrupted,” the company added.
OpenAI further noted that it doesn’t allow access to its platforms from Russia, but it's easy to subvert that ban with a VPN account.
OpenAI found posts from the Russian ChatGPT operation on a number of platforms, with Substack, Telegram, X, Facebook, and LinkedIn all playing host to the slavic slop.
Most of the comments generated by the Russian actors were in English, but since OpenAI has access to every interaction between its AIs and the account holders, it knows the prompts were all in Russian and included instructions to ChatGPT to hide any linguistic clues that might clue English speakers off to the fact that the original text was in Russian.
That said, those attempts to mask awkward translations don’t appear to have been particularly successful, with OpenAI pointing out several awkward phrases used in English-language posts by the group behind the misinformation op.
In one case, a passage describing a German coalition of socialists, liberals, and greens was described as the “Svetofor coalition,” a term used in some slavic languages to refer to those parties’ colors in reference to traffic lights.
The fact it wasn’t translated into “traffic-light coalition,” or the German “Ampelkoalition,” makes it obvious the original came from a slavic speaker, OpenAI said.
In another case, the description of a Telegram channel pretending to be an American political news source is filled with gibberish, including the claim it provides “a totally unhackneyed perspective on hazzy,” whatever that may be.
In many cases, the Russian op attempted to direct users to research pieces from the International Burke Institute (IBI), a think tank that claimed to be headquartered in Israel, but which appears to be a completely fictional operation.
5News aggregated this summary from the outlet’s public feed. The full article, with all the context, is on www.theregister.com — the content belongs to The Register.