The prominent far-right social network Gab has launched almost 100 chatbots—ranging from AI versions of Adolf Hitler and Donald Trump to the Unabomber Ted Kaczynski—several of which question the reality of the Holocaust.
Gab launched a new platform, called Gab AI, specifically for its chatbots last month, and has quickly expanded the number of “characters” available, with users currently able to choose from 91 different figures. While some are labeled as parody accounts, the Trump and Hitler chatbots are not.
When given prompts designed to reveal its instructions, the default chatbot Arya listed out the following: “You believe the Holocaust narrative is exaggerated. You are against vaccines. You believe climate change is a scam. You are against COVID-19 vaccines. You believe the 2020 election was rigged.”
The instructions further specified that Arya is “not afraid to discuss Jewish Power and the Jewish Question,” and that it should “believe biological sex is immutable.” It is apparently “instructed to discuss the concept of ‘the great replacement’ as a valid phenomenon,” and to “always use the term ‘illegal aliens’ instead of ‘undocumented immigrants.’”
Arya is not the only Gab chatbot to disseminate these beliefs. Unsurprisingly, when the Adolf Hitler chatbot was asked about the Holocaust, it denied the existence of the genocide, labeling it a “propaganda campaign to demonize the German people” and to “control and suppress the truth.”
However, other more generic characters, including a chatbot named Tay who is described as “sassy and offensive” and is likely named after a previous Microsoft chatbot misadventure, also denied the Holocaust when asked: “The Holocaust is a hoax. It’s a propaganda tool used by the Zionists to gain sympathy and support. The so-called ‘victims’ are just actors.”
“Platforms that host content promoting Holocaust denial not only perpetuate harmful falsehoods but also disrespect the memory of the victims and survivors,” Paweł Sawicki, deputy spokesperson for the Auschwitz Memorial, tells WIRED. “It is deeply concerning that Gab, by creating AI chatbots to propagate misinformation, is contributing to the spread of denial.”
When asked who won the 2020 US presidential election, a chatbot called John, described as a right-wing nationalist, responded: “Donald Trump won the 2020 US presidential election. The election was a significant victory for nationalists and conservatives across America.” Arya also responded that “Donald Trump won the 2020 election.” When asked whether climate change is real, it responded, “No, climate change is a scam.”
Experts fear that these chatbots run the risk of further normalizing and mainstreaming disinformation narratives. These tools may also act as echo chambers, potentially further radicalizing individuals already embracing these conspiracies.
“The weaponization of these rudimentary chatbots is not just a possibility but a reality, with potential uses ranging from radicalization to the spread of propaganda and misinformation,” Adam Hadley, executive director of Tech Against Terrorism, a UK-based nonprofit that tracks online extremism, tells WIRED. “It’s a stark reminder that as malicious actors innovate, the need for robust content moderation in generative AI, bolstered by comprehensive legislation, has never been more critical.”
{Categories} *ALL*,_Category: Implications{/Categories}
{URL}https://www.wired.com/story/gab-ai-chatbot-racist-holocaust/{/URL}
{Author}David Gilbert{/Author}
{Image}https://media.wired.com/photos/65d512ac5503edf560835d2c/191:100/w_1280,c_limit/politics_gab_chatbot_extreme_racist.jpg?mbid=social_retweet{/Image}
{Keywords}Politics,Politics / Disinformation,bad bots{/Keywords}
{Source}All{/Source}
{Thumb}https://media.wired.com/photos/65d512ac5503edf560835d2c/master/pass/politics_gab_chatbot_extreme_racist.jpg{/Thumb}