SchAman: Spell-Checking Resources and Benchmark for Endangered Languages from Amazonia

Oncevay A.; Cardoso G.; Alva C.; Ávila C.L.; Balarezo J.V.; Rodríguez S.E.; Camaiteri D.S.; Rojas E.Z.; Francis D.L.; Bautista J.L.; Rios N.A.; Cesareo R.Z.; Montoya H.E.G.; Zariquiey R. · Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing: Long Paper, AACL-IJCNLP 2022 (2022) · DOI: 10.18653/v1/2022.aacl-short.51

Resumen

Spell-checkers are core applications in language learning and normalisation, which may enormously contribute to language revitalisation and language teaching in the context of indigenous communities. Spell-checking as a generation task, however, requires large amount of data, which is not feasible for endangered languages, such as the languages spoken in Peruvian Amazonia. We propose here augmentation methods for various misspelling types as a strategy to train neural spell-checking models and we create an evaluation resource for four indigenous languages of Peru: Shipibo-Konibo, Asháninka, Yánesha, Yine. We focus on special errors that are significant for learning these languages, such as phoneme-to-grapheme ambiguity, grammatical errors (gender, tense, number, among others), accentuation, punctuation and normalisation in contexts where two or more writing traditions co-exist. We found that an ensemble model, trained with augmented data from various types of error achieves overall better scores in most of the error types and languages. Finally, we released our spell-checkers as a web service to be used by indigenous communities and organisations to develop future language materials.

Instituciones: Pontificia Universidad Católica del Perú; Universidad Nacional de Ingeniería; Universidad Católica Sedes Sapientiae