Refine
Document Type
- Article (3)
- Working Paper (1)
Language
- English (4)
Has Fulltext
- no (4)
Is part of the Bibliography
- no (4)
Combined survey and web tracking data have great potential for social-scientific research. They allow linking information on online behavior with data on reported offline behavior, opinions, and attitudes. At the same time, ethical, legal, and technical challenges make it difficult to disseminate linked web tracking data to the scientific community. This whitepaper aims to address these challenges by providing guidance for researchers and archivists, discussing legal, practical, and ethical aspects, disclosure risks, and establishing a framework for publishing web tracking data. Recommendations for best practices are also provided based on experiences from a research project funded by the German Consortium for the Social, Behavioural, Educational and Economic Sciences.
In this note, we provide direct evidence of cheating in online assessments of political knowledge. We combine survey responses with web tracking data of a German and a US online panel to assess whether people turn to external sources for answers. We observe item-level prevalence rates of cheating that range from 0 to 12 percent depending on question type and difficulty, and find that 23 percent of respondents engage in cheating at least once across waves. In the US panel, which employed a commitment pledge, we observe cheating behavior among less than 1 percent of respondents. We find robust respondent- and item-level characteristics associated with cheating. However, item-level instances of cheating are rare events; as such, they are difficult to predict and correct for without tracking data. Even so, our analyses comparing naive and cheating-corrected measures of political knowledge provide evidence that cheating does not substantially distort inferences.
Do Online Voter Guides Empower Citizens? Evidence from a Field Experiment with Digital Trace Data
(2021)
Voting Advice Applications (VAAs), which provide citizens with information on the party that best represents their political preferences, are often cited as evidence of the empowering capabilities of digital tools. Aside from the informational benefits of these voter guides, observational studies have suggested a strong effect on political participation and vote choice. However, existing impact evaluations have been limited by a reliance on convenience samples, lack of random assignment, or both. This raises questions about self-selection and the precise mechanisms underlying how voters learn about politics. Here, we provide evidence from a field experiment with survey outcomes conducted with a sample of over 1,000 German citizens in the 2017 federal election campaign. Using linked panel survey and digital trace data combined with a randomized encouragement to complete a VAA, we assess respondents’ compliance with treatment and observe how the use of this tool affects political behavior, attitudes, media consumption, political knowledge, and even social media activity. Our findings reveal that the overwhelming consensus in favor of positive effects on turnout and vote choice should be treated with caution, as we find no such effects. Rather, the actual virtue of VAAs in a complex online information environment lies in increasing knowledge about parties’ positions on issues—exactly the kind of information these tools were designed to provide.
What role do ideologically extreme media play in the polarization of society? Here we report results from a randomized longitudinal field experiment embedded in a nationally representative online panel survey (N = 1,037) in which participants were incentivized to change their browser default settings and social media following patterns, boosting the likelihood of encountering news with either a left-leaning (HuffPost) or right-leaning (Fox News) slant during the 2018 US midterm election campaign. Data on ≈ 19 million web visits by respondents indicate that resulting changes in news consumption persisted for at least 8 wk. Greater exposure to partisan news can cause immediate but short-lived increases in website visits and knowledge of recent events. After adjusting for multiple comparisons, however, we find little evidence of a direct impact on opinions or affect. Still, results from later survey waves suggest that both treatments produce a lasting and meaningful decrease in trust in the mainstream media up to 1 y later. Consistent with the minimal-effects tradition, direct consequences of online partisan media are limited, although our findings raise questions about the possibility of subtle, cumulative dynamics. The combination of experimentation and computational social science techniques illustrates a powerful approach for studying the long-term consequences of exposure to partisan news.