Entry 026, How lies spread

Troll farms

Also known as: Troll factory, Web brigades, Paid commenters, Comment army

Offices full of paid people posting under fake names at scale, not to win arguments but to inflame both sides, drown out real voices and make everyone trust less.

Sneaky: fools careful people too

Spot it

  • Fresh accounts argue passionately about a country they never otherwise mention, in slightly odd phrasing.
  • The same talking points appear on both extremes of a debate at the same time.
  • Accounts work in shifts, active nine-to-five in a time zone that does not match their claimed home.
  • Profiles claim to be a nurse from Ohio or a mum from Debrecen but have no local life in their history.
  • The goal of every post is heat, not an answer; each thread ends angrier than it started.

How it works

A troll farm is an office. Real desks, real shifts, real salaries. People come in at nine, log into a dozen fake accounts each and post until five: comments under news articles, replies in groups, memes, “personal” stories. Then the next shift takes over. Unlike bots, they can argue, joke and adapt, which is exactly what makes them worth a payroll.

The famous one is the Internet Research Agency in St Petersburg. In 2018 a US grand jury indicted the company and thirteen people for running thousands of fake American personas on Facebook, Instagram, Twitter and YouTube from 2014 onward, on a budget of more than a million dollars a month. The indictment shows the method. The same office ran pages for Black activists and for police supporters, pro-immigrant groups and anti-immigrant groups, and in 2016 two of its pages organised a protest and a counter-protest outside the same Islamic centre in Houston, on the same day.

That is the whole point: the farm’s product is not persuasion but heat. While you are shouting at your neighbour, you are not looking at who lit the fire. Reporting from inside the St Petersburg office (Adrian Chen’s 2015 piece “The Agency”) described quotas per shift: so many comments, so many posts, these keywords included.

Farms are not only Russian and not only state-run. Commercial “PR” agencies in the Philippines, India, Nigeria, Mexico and elsewhere rent out comment armies to parties and companies; Oxford researchers counted organised social media manipulation campaigns in 70 countries in 2019. Inside the farm, each account is a sockpuppet; when a platform catches the network, it calls it coordinated inauthentic behavior.

Example

Two accounts, same office, same morning, under a news story about a refugee shelter:

@proud_mom_ohio, 4h They put the shelter 200 m from a primary school and nobody asked us. Our kids come last, as always. Share if you agree.

@justice_now_44, 4h Look at the racists crawling out under this post. This town was built by immigrants. Disgusting people, all of them.

Neither post asks for information, proposes anything or replies to anyone. Each is written to make one half of the readers furious at the other half. The shelter, real or not, is just the stage.

Why it works on you

  • You cannot see the office. A comment looks like a person. Fifty comments look like a community. Nothing on the screen says “shift two, desk nine”.
  • It feeds your tribe. The farm confirms what your side already fears about the other side, which is the most believable content there is. See us vs. them.
  • Anger is contagious and cheap. One furious comment reliably produces ten real ones. The farm pays for the first; you donate the rest.

What to do

When a thread suddenly heats up: look at who started it. Click the three angriest profiles. Creation date, earlier posts, whether they have any life outside this topic. Odd phrasing in a “local” voice is a tell, not proof.

When you catch yourself boiling: that is the product working. Close the thread for ten minutes. If the issue matters, read a proper report on it, not the replies.

In a comment section: do not argue with a shift worker; you are filling their quota. Report the pattern, note it publicly once (“three-week-old accounts, both extremes, same hour”) and move on.

Don’t confuse it with

  • Angry real people. Most furious comments come from genuine humans having a bad day. The farm pattern is fresh accounts, both extremes, no history.
  • Open party activists. A campaign volunteer posting under their own name is politics, not a farm. The deception is the fake identity.

Reply kit

Calm, copy-pasteable replies for when you meet this under a post. Link the technique, not the accusation.

  • Not saying you're a troll, but this thread has the classic farm pattern: new accounts, both extremes, zero interest in an answer. Worth knowing how it works: https://manipedia.eu/en/troll-farms

  • Heads up: paid comment operations don't try to convince you, they try to make you furious at your neighbours. Here's the documented playbook: https://manipedia.eu/en/troll-farms

  • Before we tear each other apart: the loudest accounts here are three weeks old. Here's what troll farms actually do: https://manipedia.eu/en/troll-farms

We know not every reply sounds natural as a comment, so feel free to put it in your own words. They are here to help, above all older friends and relatives, who often know these tricks less well and so are frequent targets. Reaching them is one of this site’s most important goals.

Sources & further reading

  1. US Department of Justice: Grand jury indicts thirteen Russian individuals and three Russian companies (2018)
  2. Adrian Chen, The Agency (The New York Times Magazine, 2015)
  3. Troll farm (Wikipedia)
  4. Internet Research Agency (Wikipedia)