Collecting minority language data from Twitter (X): A case study of Karelian
- The visibility of an endangered language online plays a crucial role in language revitalisation. The internet offers a new domain for using minority languages, especially for speakers living outside the language communities. This article investigates Karelian language visibility on X, formerly known as Twitter, and describes the first corresponding data collection using language-related keywords and hashtags. In total, 2,625 entries written fully or partially in Livvi, South and Viena Karelian were scraped with Postman API. The visibility of Karelian on Twitter (X) has been increasing considerably in the past few years, with Livvi-Karelian being the most prominent dialect. Automatic language detection was tested on such data for Karelian for the first time, and allows the identification of Livvi-Karelian (or a mix of dialects that include Livvi-Karelian) with 99.7% sensitivity, and South Karelian and Viena Karelian as Livvi-Karelian with 90% and 73.8% sensitivity, respectively. The entries were also analysed thematically, and 10 major topics were identified. Since the data was collected using keywords and hashtags related to the Karelian language itself, most of the entries are related to the language and vocabulary in sense of translation or language learning. Language status and policy is another important topic identified in the data. Although language-related topics are the most popular, there are a substantial number of entries on eight further topics. Excluding citations from religious texts and media headlines, 751 Twitter (X) entries could be used for linguistic and sociological research. Further data collection considerations are also discussed.
| URN: | urn:nbn:de:kobv:526-opus4-20583 |
|---|---|
| Publisher DOI: | https://doi.org/10.1515/9783111434018-007 |
| Author: | Ilia MoshnikovORCiD, Eugenia RykovaORCiD |
| ISBN: | 978-3-11-143401-8 |
| Parent Title (English): | Exploring digitally-mediated communication with corpora : Methods, analyses, and corpus construction |
| Document Type: | Part of a Book |
| Language: | English |
| Year of Publication: | 2025 |
| First Page: | 163 |
| Last Page: | 186 |
| Publisher: | De Gruyter Brill |
| Faculties an central facilities: | Fachbereich Wirtschaft, Informatik, Recht |
| Editor: | Louis Cotgrove, Laura Herzberg, Harald Lüngen |
| Publishing Institution: | Technische Hochschule Wildau |
| Tag: | Karelian; X (Twitter); automatic language recognition; data scraping; language policy; language revitalisation; language status; minority language |
| Source: | Moshnikov, Ilia and Rykova, Eugenia. "Collecting minority language data from Twitter (X): A case study of Karelian". Exploring digitally-mediated communication with corpora: Methods, analyses, and corpus construction, edited by Louis Cotgrove, Laura Herzberg and Harald Lüngen, De Gruyter, 2025, pp. 163-186. https://doi.org/10.1515/9783111434018-007 |
| Dewey Decimal Classification: | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 006 Spezielle Computerverfahren |
| 3 Sozialwissenschaften / 30 Sozialwissenschaften, Soziologie / 302 Soziale Interaktion | |
| 4 Sprache / 49 Andere Sprachen / 491 Ostindoeuropäische und keltische Sprachen | |
| Licence (German): | Creative Commons - CC BY - Namensnennung 4.0 International |
| Release Date: | 2025/09/09 |



