Our work titled Online Human-Bot Interactions: Detection, Estimation, and Characterization has been accepted for publication at the prestigious International AAAI Conference on Web and Social Media (ICWSM 2017) to be held in Montreal, Canada in May 2017!
The goal of this study was twofold: first, we aimed at understanding how difficult is to detect social bots on Twitter respectively for machine learning models and for humans. Second, we wanted to perform a census of the Twitter population to estimate how many accounts are not controlled by humans, but rather by computer software (bots).
To address the first question, we developed a family of machine learning models that leverages over one thousand features characterising the online behaviour of Twitter accounts. We then trained these models with manually-annotated collections of examples of human and bot-controlled accounts across the spectrum of complexity, ranging from simple bots to very sophisticated ones fueled by advanced AI. We discovered that, while human accounts and simple bots are very easy to identify, both by other humans and by our models, there exist a family of sophisticated social AIs that systematically escape identification by our models and by human snap-judgment.
Our second finding reveals that a significant fraction of Twitter accounts, between 9% and 15%, are likely social bots. This translates in nearly 50 million accounts, according to recent estimates that put the Twitter userbase at above 320 million. Although not all bots are dangerous, many are used for malicious purposes: in the past, for example, Twitter bots have been used to manipulate public opinion during election times, to manipulate the stock market, and by extremist groups for radical propaganda.
To learn more, read our paper: Online Human-Bot Interactions: Detection, Estimation, and Characterization.
Cite as:
Onur Varol, Emilio Ferrara, Clayton Davis, Filippo Menczer, Alessandro Flammini. Online Human-Bot Interactions: Detection, Estimation, and Characterization. ICWSM 2017
Press Coverage
- Twitter Bot — or Not? – The New York Times
- Searching for proof of Amy – San Francisco Examiner
- News That 48 Million Of Twitter’s Users May Be Bots Could Impact Its Valuation – Forbes
- Fake accounts scandal weighs on Twitter boss – The Times
- Pressure Grows on Twitter CEO Dorsey Amid Bot Scandal – The Street
- CMO Today: Marketers and Political Wonks Gather for SXSW – The Wall Street Journal
- Huge number of Twitter accounts are not operated by humans – ABC News
- Early Twitter investor Chris Sacca says he ‘hates’ the stock, calls bot issue ‘embarrassing’ – CNBC
- Up to 48 million Twitter accounts are bots, study says – CNET
- R u bot or not? – VICE
- New Machine Learning Framework Uncovers Twitter’s Vast Bot Population – VICE/Motherboard
- A Whopping 48 Million Twitter Accounts Are Actually Just Bots, Study Says – Tech Times
- 15 Percent Of Twitter Accounts May Be Bots [STUDY] – Value Walk
- Why the Rise of Bots is a Concern for Social Networks – Enterpreneuer
- Study reveals whopping 48M Twitter accounts are actually bots – CBS News
- Twitter is home to nearly 48 million bots, according to report – The Daily Dot
- As many as 48 million Twitter accounts aren’t people, says study – CNBC
- New Study Says 48 Million Accounts On Twitter Are Bots – We are social media
- Almost 48 million Twitter accounts are bots – Axios
- Twitter user accounts: around 15% or 48 million are bots [study] – The Vanguard
- Report: 48 Million Twitter Accounts Are Bots – Breitbart
- Rise of the TWITTERBOTS – Daily Mail
- 15 per cent of Twitter is bots, but not the Kardashian kind – The Inquirer
- 48 mn Twitter accounts are bots, says study – The Economic Times
- 9-15 per cent of Twitter accounts are bots, reveals study – Financial Express
- Nearly 48 million Twitter accounts are bots: study – Deccan herald
- Study: Nearly 48 Million Twitter Accounts Are Fake; Many Push Political Agendas – The Libertarian Republic
- As many as 48 million accounts on Twitter are actually bots, study finds – Sacramento Bee
- Study Reveals Roughly 48M Twitter Accounts Are Actually Bots – CBS DFW
- Up to 48 million Twitter accounts may be Bots – Financial Buzz
- Up to 15% of Twitter accounts are not real people – Blasting News
- Tech Bytes: Twitter is Being Invaded by Bots – WDIO Eyewitness News
- About 9-15% of Twitter accounts are bots: Study – The Indian Express
- Twitter Has Nearly 48 Million Bot Accounts, So Don’t Get Hurt By All Those Online Trolls – India Times
- Twitter May Have 45 Million Bots on Its Hands – Investopedia
- Bots run amok on Twitter – My Broadband
- 9-15% of Twitter accounts are bots: Study – MENA FN
- Up To 15 Percent Of Twitter Users Are Bots, Study Says – Vocativ
- 48 million active Twitter accounts could be bots – Gearbrain
- Study: 15% of Twitter accounts could be bots – Marketing Dive
- 15% of Twitter users are actually bots, study claims – MemeBurn
- Almost 48 million Twitter accounts are bots – Click Lancashire
- As many as 48 million or around 15% of Twitter accounts are bots – TechWorm
- Twitter Has an Overwhelming 48 Million Bot Accounts – GineersNow
Press in non-English media
- Bis zu 48 von 319 Mio. Twitter-Nutzern sind Bots – Kronen Zeitung (in German)
- Bad Bot oder Mensch – das ist hier die Frage – Medien Milch (in German)
- Studie: Bis zu 48 Millionen Twitter-Nutzer sind in Wirklichkeit Bots – T3N (in German)
- Der Aufstieg der Twitter-Bots: 48 Millionen Nutzer sind nicht menschlich – Studie – Sputnik News (in German)
- Studie: Bis zu 48 Millionen Nutzer auf Twitter sind Bots – der Standard (in German)
- “Blade Runner”-Test für Twitter-Accounts: Bot oder Mensch? – der Standard (in German)
- Bot-Paradies Twitter – Sachsische Zeitung (in German)
- 15 Prozent Social Bots? – DLF24 (in German)
- TWITTER: IST JEDER SIEBTE USER EIN BOT? – UberGizmo (in German)
- Twitter: Bis zu 48 Millionen Bot-Profile – Heise (in German)
- Studie: Bis zu 15 Prozent aller aktiven, englischsprachigen Twitter-Konten sind Bots – Netzpolitik (in German)
- Automatische Erregung – Wiener Zeitung (in German)
- Un 15% de los usuarios de Twitter son bots – El Mundo (in Spanish)
- Al menos el 15 por ciento de las cuentas de Twitter son bots – El Tiempo (in Spanish)
- 15 por ciento de las cuentas de Twitter son ‘bots’: estudio – CNET (in Spanish)
- El 15% de las cuentas de Twitter son bots – Gestion (in Spanish)
- 48 de los 319 millones de usuarios activos de Twitter son bots – TIC Beat (in Spanish)
- 15% de las cuentas de Twitter son ‘bots’ – Merca 2.0 (in Spanish)
- 48 de los 319 de usuarios activos en Twitter son bots – MDZ (in Spanish)
- Twitter, paradis des «bots»? – Slate (in French)
- Twitter compterait 48 millions de comptes gérés par des robots – MeltyStyle (in French)
- Twitter : 48 millions de comptes sont des bots – blog du moderateur (in French)
- ’30 tot 50 miljoen actieve Twitter-accounts zijn bots’ – NOS (in Dutch)
- 48 εκατομμύρια χρήστες στο Twitter δεν είναι άνθρωποι, σύμφωνα με έρευνα Πηγή – LiFo (in Greek)
- 48 triệu người dùng Twitter là bot và mối nguy hại – Khoa Hoc Phattrien (in Vietnamese)