The Denglisch Corpus of German-English Code-Switching

Doreen Osmelak; Shuly Wintner

The Denglisch Corpus of German-English Code-Switching

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

When multilingual speakers involve in a conversation they inevitably introduce code-switching (CS), i.e., mixing of more than one language between and within utterances. CS is still an understudied phenomenon, especially in the written medium, and relatively few computational resources for studying it are available. We describe a corpus of German-English codeswitching in social media interactions. We focus on some challenges in annotating CS, especially due to words whose language ID cannot be easily determined. We introduce a novel schema for such word-level annotation, with which we manually annotated a subset of the corpus. We then trained classifiers to predict and identify switches, and applied them to the remainder of the corpus. Thereby, we created a large-scale corpus of German-English mixed utterances with precise indications of CS points.

Original language	English
Title of host publication	SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop
Editors	Lisa Beinborn, Koustava Goswami, Saliha Muradoglu, Alexey Sorokin, Ritesh Kumar, Andreas Shcherbakov, Edoardo M. Ponti, Ryan Cotterell, Ekaterina Vylomova
Publisher	Association for Computational Linguistics
Pages	42-51
Number of pages	10
ISBN (Electronic)	9781959429562
State	Published - 2023
Event	5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, SIGTYP 2023, co-located with the 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023 - Hybrid, Dubrovnik, Croatia Duration: 6 May 2023 → …

Publication series

Name	SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop

Conference

Conference	5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, SIGTYP 2023, co-located with the 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023
Country/Territory	Croatia
City	Hybrid, Dubrovnik
Period	6/05/23 → …

Bibliographical note

Publisher Copyright:
© 2023 Association for Computational Linguistics.

ASJC Scopus subject areas

Language and Linguistics
Artificial Intelligence
Human-Computer Interaction
Linguistics and Language

Cite this

Osmelak, D., & Wintner, S. (2023). The Denglisch Corpus of German-English Code-Switching. In L. Beinborn, K. Goswami, S. Muradoglu, A. Sorokin, R. Kumar, A. Shcherbakov, E. M. Ponti, R. Cotterell, & E. Vylomova (Eds.), SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop (pp. 42-51). (SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop). Association for Computational Linguistics.

Osmelak, Doreen ; Wintner, Shuly. / The Denglisch Corpus of German-English Code-Switching. SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop. editor / Lisa Beinborn ; Koustava Goswami ; Saliha Muradoglu ; Alexey Sorokin ; Ritesh Kumar ; Andreas Shcherbakov ; Edoardo M. Ponti ; Ryan Cotterell ; Ekaterina Vylomova. Association for Computational Linguistics, 2023. pp. 42-51 (SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop).

@inproceedings{a263cc1afca94d65a2cf5f5318eaa6cf,

title = "The Denglisch Corpus of German-English Code-Switching",

abstract = "When multilingual speakers involve in a conversation they inevitably introduce code-switching (CS), i.e., mixing of more than one language between and within utterances. CS is still an understudied phenomenon, especially in the written medium, and relatively few computational resources for studying it are available. We describe a corpus of German-English codeswitching in social media interactions. We focus on some challenges in annotating CS, especially due to words whose language ID cannot be easily determined. We introduce a novel schema for such word-level annotation, with which we manually annotated a subset of the corpus. We then trained classifiers to predict and identify switches, and applied them to the remainder of the corpus. Thereby, we created a large-scale corpus of German-English mixed utterances with precise indications of CS points.",

author = "Doreen Osmelak and Shuly Wintner",

note = "Publisher Copyright: {\textcopyright} 2023 Association for Computational Linguistics.; 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, SIGTYP 2023, co-located with the 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023 ; Conference date: 06-05-2023",

year = "2023",

language = "English",

series = "SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop",

publisher = "Association for Computational Linguistics",

pages = "42--51",

editor = "Lisa Beinborn and Koustava Goswami and Saliha Muradoglu and Alexey Sorokin and Ritesh Kumar and Andreas Shcherbakov and Ponti, {Edoardo M.} and Ryan Cotterell and Ekaterina Vylomova",

booktitle = "SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop",

}

Osmelak, D & Wintner, S 2023, The Denglisch Corpus of German-English Code-Switching. in L Beinborn, K Goswami, S Muradoglu, A Sorokin, R Kumar, A Shcherbakov, EM Ponti, R Cotterell & E Vylomova (eds), SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop. SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop, Association for Computational Linguistics, pp. 42-51, 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, SIGTYP 2023, co-located with the 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023, Hybrid, Dubrovnik, Croatia, 6/05/23.

The Denglisch Corpus of German-English Code-Switching. / Osmelak, Doreen; Wintner, Shuly.
SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop. ed. / Lisa Beinborn; Koustava Goswami; Saliha Muradoglu; Alexey Sorokin; Ritesh Kumar; Andreas Shcherbakov; Edoardo M. Ponti; Ryan Cotterell; Ekaterina Vylomova. Association for Computational Linguistics, 2023. p. 42-51 (SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - The Denglisch Corpus of German-English Code-Switching

AU - Osmelak, Doreen

AU - Wintner, Shuly

PY - 2023

Y1 - 2023

N2 - When multilingual speakers involve in a conversation they inevitably introduce code-switching (CS), i.e., mixing of more than one language between and within utterances. CS is still an understudied phenomenon, especially in the written medium, and relatively few computational resources for studying it are available. We describe a corpus of German-English codeswitching in social media interactions. We focus on some challenges in annotating CS, especially due to words whose language ID cannot be easily determined. We introduce a novel schema for such word-level annotation, with which we manually annotated a subset of the corpus. We then trained classifiers to predict and identify switches, and applied them to the remainder of the corpus. Thereby, we created a large-scale corpus of German-English mixed utterances with precise indications of CS points.

AB - When multilingual speakers involve in a conversation they inevitably introduce code-switching (CS), i.e., mixing of more than one language between and within utterances. CS is still an understudied phenomenon, especially in the written medium, and relatively few computational resources for studying it are available. We describe a corpus of German-English codeswitching in social media interactions. We focus on some challenges in annotating CS, especially due to words whose language ID cannot be easily determined. We introduce a novel schema for such word-level annotation, with which we manually annotated a subset of the corpus. We then trained classifiers to predict and identify switches, and applied them to the remainder of the corpus. Thereby, we created a large-scale corpus of German-English mixed utterances with precise indications of CS points.

UR - http://www.scopus.com/inward/record.url?scp=85174741044&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85174741044

T3 - SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop

SP - 42

EP - 51

BT - SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop

A2 - Beinborn, Lisa

A2 - Goswami, Koustava

A2 - Muradoglu, Saliha

A2 - Sorokin, Alexey

A2 - Kumar, Ritesh

A2 - Shcherbakov, Andreas

A2 - Ponti, Edoardo M.

A2 - Cotterell, Ryan

A2 - Vylomova, Ekaterina

PB - Association for Computational Linguistics

T2 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, SIGTYP 2023, co-located with the 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023

Y2 - 6 May 2023

ER -

Osmelak D, Wintner S. The Denglisch Corpus of German-English Code-Switching. In Beinborn L, Goswami K, Muradoglu S, Sorokin A, Kumar R, Shcherbakov A, Ponti EM, Cotterell R, Vylomova E, editors, SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop. Association for Computational Linguistics. 2023. p. 42-51. (SIGTYP 2023 - 5th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, Proceedings of the Workshop).

The Denglisch Corpus of German-English Code-Switching

Abstract

Publication series

Conference

Bibliographical note

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this