← Symptoms

Xenophobia & Violence

The connection between online hate and real-world violence was documented before many people had heard of Facebook.

How to read this page. Tap any underlined word to see the precise academic term and a short definition. Expand any "Deeper" box for the evidence and contested points. The main text works on its own — you can skip both and still get the whole argument.

The timeline

Stormfront — the first major hate site on the internet — was set up in 1995. By the early 2000s, researchers were studying how far people in white racist chat rooms would go in advocating violence. In June 2004, the OSCE held a formal intergovernmental meeting in Paris specifically on racist and xenophobic online propaganda and its connection to hate crimes — nearly twenty years before the EU Digital Services Act required platforms to assess this risk. By early 2007, the Southern Poverty Law Center counted roughly 12,000 white-supremacist propaganda videos, hate-rock concert reels and Holocaust-denial pseudo-documentaries openly available on YouTube and other video-sharing sites.

This is not hindsight. These warnings were contemporaneous, specific, and well-evidenced — documented before the platforms that amplified the problem at scale had become dominant.

Myanmar: the documented case

Facebook's dominance in Myanmar began taking root around 2012, as the country opened up after decades of military rule; by 2018 it had 18 million users, about a third of the population, and for most of the people online, Facebook was the internet. UN investigators and journalists documented Facebook's role in the amplification of anti-Rohingya hate speech from 2016 onward. Facebook itself acknowledged in 2018 that it had not done enough to prevent the platform being used for incitement to violence. In 2017, the Myanmar military conducted a campaign against the Rohingya people that the UN's Special Rapporteur on Myanmar said in March 2018 bore "the hallmarks of genocide"; the UN Fact-Finding Mission later called for senior military officials to be investigated and prosecuted for genocide.

The causal pathway from Facebook amplification to atrocity is complex — existing ethnic tensions, military action, historical grievances all played roles. What is documented: Facebook was the primary information environment, it amplified content that dehumanised the Rohingya population, the UN Independent Fact-Finding Mission found the company's response to the hate speech on its platform "slow and ineffective", and the human-rights impact assessment Facebook itself commissioned from BSR found that the platform was "being used by bad actors to spread hate speech, incite violence, and coordinate harm".

The algorithm does not choose hate. It chooses engagement.

The mechanism is the same throughout this site. The algorithm does not have views on ethnicity or politics. It surfaces content that generates strong emotional responses — and hatred, fear, and tribal identity are among the most engaging emotions. What follows from that is narrower than the popular story: the platform lowers the cost of finding extreme content, and of finding each other, and it serves extreme material preferentially to people already leaning that way. Whether the recommendation engine drives the escalation on its own is contested.

An internal Facebook presentation from 2016, studying political groups in Germany, found that 64% of all joins to extremist groups came through the platform's own recommendation tools — "our recommendation systems grow the problem," as the slide put it. The mechanism is documented on How It Works.

What the research shows on online-offline violence connections

Research on the relationship between online hate speech and offline violence finds correlations. A study by Müller and Schwarz found a significant positive relationship between Facebook posts with anti-refugee sentiment and attacks on refugees in Germany, at the local level — and, using internet outages as a natural experiment, showed the relationship weakened when access was cut.

The honest framing: a causal pathway has been documented, with rigour, in one country and period. It is not deterministic — most people who consume hateful content do not commit violence. The direction is consistent. The scale of the amplification is what changes the base rates.

How we know — the natural experiment behind the anti-refugee finding +

The standard objection to "online hate correlates with offline attacks" is that towns with more hostility might simply have both more hateful posts and more attacks, with the internet just along for the ride. Müller and Schwarz (2021) addressed this with a natural experiment: they used local internet and Facebook outages — disruptions unrelated to local attitudes — as a lever. Where outages cut access, the relationship between anti-refugee sentiment and attacks on refugees weakened. Because the outages were essentially random with respect to local politics, this gets much closer to a causal claim than a simple correlation.

What it shows and its limits. It is strong evidence that the platform amplified existing sentiment into action in a specific country and period, not a universal constant. It does not say everyone exposed becomes violent — the claim is about shifted base rates across many communities, which is exactly how amplification at scale would look.

What you can do →
Elections & Democratic Harm →
Yes, but… →