• search hit 2 of 3
Back to Result List

We Don't Know What We Don't Know: When and How the Use of Twitter's Public APIs Biases Scientific Inference

  • Though Twitter research has proliferated, no standards for data collection have crystallized. When using keyword queries, the most common data sources—the Search and Streaming APIs—rarely return the full population of tweets, and scholars do not know whether their data constitute a representative sample. This paper seeks to provide the most comprehensive look to-date at the potential biases that may result. Employing data derived from four identical keyword queries to the Firehose (which provides the full population of tweets but is cost-prohibitive), Streaming, and Search APIs, we use Kendall’s-tau and logit regression analyses to understand the differences in the datasets, including what user and content characteristics make a tweet more or less likely to appear in sampled results. We find that there are indeed systematic differences that are likely to bias scholars’ findings in almost all datasets we examine, and we recommend significant caution in future Twitter research.

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Document Type:Article
Language:English
Author(s):Daniela StockmannORCiD, Rebekah Tromble, Andreas Storz
Parent Title (German):Available at SSRN
Publication year:2017
Publishing Institution:Hertie School
Number pages:26
Related URL:http://hdl.handle.net/1887/81896
DOI:https://doi.org/10.2139/ssrn.3079927
Release Date:2020/02/04
Volume:3079927
Licence of document (German):Metadaten / metadata
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.