WASHINGTON: Elon Musk’s AI chatbot Grok produced inaccurate and contradictory responses when users sought to fact-check the Israel-Iran conflict, a study said Tuesday, raising fresh doubts about its reliability as a debunking tool.
With tech platforms reducing their reliance on human fact-checkers, users are increasingly utilizing AI-powered chatbots — including xAI’s Grok — in search of reliable information, but their responses are often themselves prone to misinformation.
“The investigation into Grok’s performance during the first days of the Israel-Iran conflict exposes significant flaws and limitations in the AI chatbot’s ability to provide accurate, reliable, and consistent information during times of crisis,” said the study from the Digital Forensic Research Lab (DFRLab) of the Atlantic Council, an American think tank.
“Grok demonstrated that it struggles with verifying already-confirmed facts, analyzing fake visuals, and avoiding unsubstantiated claims.”
The DFRLab analyzed around 130,000 posts in various languages on the platform X, where the AI assistant is built in, to find that Grok was “struggling to authenticate AI-generated media.”
Following Iran’s retaliatory strikes on Israel, Grok offered vastly different responses to similar prompts about an AI-generated video of a destroyed airport that amassed millions of views on X, the study found.
It oscillated — sometimes within the same minute — between denying the airport’s destruction and confirming it had been damaged by strikes, the study said.
In some responses, Grok cited the a missile launched by Yemeni rebels as the source of the damage. In others, it wrongly identified the AI-generated airport as one in Beirut, Gaza, or Tehran.
When users shared another AI-generated video depicting buildings collapsing after an alleged Iranian strike on Tel Aviv, Grok responded that it appeared to be real, the study said.
The Israel-Iran conflict, which led to US air strikes against Tehran’s nuclear program over the weekend, has churned out an avalanche of online misinformation including AI-generated videos and war visuals recycled from other conflicts.
AI chatbots also amplified falsehoods.
As the Israel-Iran war intensified, false claims spread across social media that China had dispatched military cargo planes to Tehran to offer its support.
When users asked the AI-operated X accounts of AI companies Perplexity and Grok about its validity, both wrongly responded that the claims were true, according to disinformation watchdog NewsGuard.
Researchers say Grok has previously made errors verifying information related to crises such as the recent India-Pakistan conflict and anti-immigration protests in Los Angeles.
Last month, Grok was under renewed scrutiny for inserting “white genocide” in South Africa, a far-right conspiracy theory, into unrelated queries.
Musk’s startup xAI blamed an “unauthorized modification” for the unsolicited response.
Musk, a South African-born billionaire, has previously peddled the unfounded claim that South Africa’s leaders were “openly pushing for genocide” of white people.
Musk himself blasted Grok after it cited Media Matters — a liberal media watchdog he has targeted in multiple lawsuits — as a source in some of its responses about misinformation.
“Shame on you, Grok,” Musk wrote on X. “Your sourcing is terrible.”
Grok shows ‘flaws’ in fact-checking Israel-Iran war: study
https://arab.news/6f8at
Grok shows ‘flaws’ in fact-checking Israel-Iran war: study
- “Grok demonstrated that it struggles with verifying already-confirmed facts, analyzing fake visuals, and avoiding unsubstantiated claims”
Trial opens in Tunisia of NGO workers accused of aiding migrants
- Aid workers accused of assisting irregular migration to Tunisia went on trial on Monday, as Amnesty International criticized what it called “the relentless criminalization of civil society”
TUNIS: Aid workers accused of assisting irregular migration to Tunisia went on trial on Monday, as Amnesty International criticized what it called “the relentless criminalization of civil society” in the country.
Six staff members of the Tunisian branch of the France Terre d’Asile aid group, along with 17 municipal workers from the eastern city of Sousse, face charges of sheltering migrants and facilitating their “illegal entry and residence.”
If convicted, they face up to 10 years in prison.
Migration is a sensitive issue in Tunisia, a key transit point for tens of thousands of people seeking to reach Europe each year.
A former head of Terre d’Asile Tunisie, Sherifa Riahi, is among the accused and has been detained for more than 19 months, according to her lawyer Abdellah Ben Meftah.
He told AFP that the accused had carried out their work as part of a project approved by the state and in “direct coordination” with the government.
Amnesty denounced what it described as a “bogus criminal trial” and called on Tunisian authorities to drop the charges.
“They are being prosecuted simply for their legitimate work providing vital assistance and protection to refugees, asylum seekers and migrants in precarious situations,” Sara Hashash, Amnesty’s deputy MENA chief, said in the statement.
The defendants were arrested in May 2024 along with about a dozen humanitarian workers, including anti-racism pioneer Saadia Mosbah, whose trial is set to start later this month.
In February 2023, President Kais Saied said “hordes of illegal migrants,” many from sub-Saharan Africa, posed a demographic threat to the Arab-majority country.
His speech triggered a series of racially motivated attacks as thousands of sub-Saharan African migrants in Tunisia were pushed out of their homes and jobs.
Thousands were repatriated or attempted to cross the Mediterranean, while others were expelled to the desert borders with Algeria and Libya, where at least a hundred died that summer.
This came as the European Union boosted efforts to curb arrivals on its southern shores, including a 255-million-euro ($290-million) deal with Tunis.
