Using Students as a Distributed Coding Team for Validation through Intercoder Agreement

Please always quote using this URN: urn:nbn:de:bvb:29-opus4-71303
  • In qualitative research, results often emerge through an analysis process called coding. A common measure of validity of theories built through qualitative research is the agreement between different people coding the same materials. High intercoder agreement indicates that the findings are derived from the data as opposed to being relative results based on the original researcher's bias. However, measuring such intercoder agreement incurs the high cost of having additional researchers perform seemingly redundant work. In this paper we present first results on a novel method of using students for validating theories. We find that intercoder agreement between a large number of students isIn qualitative research, results often emerge through an analysis process called coding. A common measure of validity of theories built through qualitative research is the agreement between different people coding the same materials. High intercoder agreement indicates that the findings are derived from the data as opposed to being relative results based on the original researcher's bias. However, measuring such intercoder agreement incurs the high cost of having additional researchers perform seemingly redundant work. In this paper we present first results on a novel method of using students for validating theories. We find that intercoder agreement between a large number of students is almost as good as the intercoder agreement between two professionals working on the same materials.show moreshow less

Export metadata

Additional Services

Share in Twitter Search Google Scholar Statistics
Metadaten
Author:Andreas Kaufmann, Ann Barcomb, Dirk Riehle
Persistent identifiers - URN:urn:nbn:de:bvb:29-opus4-71303
ISSN:2191-5008
Title of the journal / compilation (English):Technical Reports
Series (Volume number):Technical reports / Department Informatik (CS 2016-01)
Document Type:Report
Language:English
Year of publication:2016
Date of online publication (Embargo Date):2016/04/05
Publishing Institution:Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)
Release Date:2016/05/12
Tag:Collective Coding; Distributed Coding; Intercoder Agreement; Qualitative Data Analysis; Theory Triangulation
SWD-Keyword:validation
Length/size:10
Institutes:Technische Fakultät
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 000 Informatik, Informationswissenschaft, allgemeine Werke
3 Sozialwissenschaften / 37 Bildung und Erziehung / 378 Hochschulbildung
open_access (DINI-Set):open_access
Licence (German):Keine Creative Commons Lizenz - es gilt der Veröffentlichungsvertrag und das deutsche Urheberrecht
Einverstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.