La traducció automàtica en centres d’acollida: selecció de sistemes i avaluació multilingüe de la qualitat
Article Sidebar
Main Article Content
Aquest article aborda la selecció d’un sistema de traducció automàtica per a l’ús en centres d’acollida, destinat a traduir missatges redactats en anglès, francès i neerlandès a 14 llengües, incloses llengües de baixos recursos com el paixtu i el somali. La qualitat de la traducció s’avalua mitjançant mètriques automàtiques i avaluacions humanes dutes a terme per experts, amb la finalitat de donar suport a una comunicació multilingüe eficaç.
Article Details
Aquesta obra està sota una llicència internacional Creative Commons Reconeixement 4.0.
(c) Lieve Macken, Margot Fonteyne, Arda Tezcan, Ella van Hest, Katrijn Maryns, July De Wilde, 2025
Agirre, Eneko; Cer, Daniel; Diab, Mona; Gonzalez-Agirre, Aitor (2012). SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity. In: Eneko Agirre; Johan Bos; Mona Diab; Suresh Manandhar; Yuval Marton; Deniz Yuret (eds.). *SEM 2012: The First Joint Conference on Lexical and Computational Semantics Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (SemEval 2012). Association for Computational Linguistics, pp. 385–393. <https://aclanthology.org/S12-1051/>. [Accessed: 20251217].
Aharoni, Roee; Johnson, Melvin; Firat, Orhan (2019). Massively Multilingual Neural Machine Translation. In: Jill Burstein; Christy Doran; Thamar Solorio (eds.). Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, pp. 3874–3884, <https://aclanthology.org/N19-1388/>. [Accessed: 20251217].
Bartoń, Kamil (2023). MuMIn: Multi-model inference.
<https://cran.r-project.org/package=MuMIn>. [Accessed: 20251217].
Bergunde, Annika; Pöllabauer, Sonja (2019). Curricular design and implementation of a training course for interpreters in an asylum context. Translation & Interpreting, v. 11, n. 1, pp. 1–21. <https://www.trans-int.org/index.php/transint/article/view/560/325>. [Accessed: 20251217].
Bojar, Ondřej; Chatterjee, Rajen; Federmann, Christian; Graham, Yvette; Haddow, Barry; Huck, Matthias; Jimeno Yepes, Antonio; Koehn, Philipp; Logacheva, Varvara; Monz, Christof; Negri, Matteo, Névéol, Aurélie; Neves, Mariana, Popel, Martin; Post, Matt; Rubino, Raphael; Scarton, Carolina; Specia, Lucia; Turchi, Marco; Verspoor, Karin; Zampieri, Marcos (2016). Findings of the 2016 Conference on Machine Translation. In: Ondřej Bojar; Christian Buck; Rajen Chatterjee; Christian Federmann; Liane Guillou; Barry Haddow; Matthias Huck; et al. (eds.). Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers. Association for Computational Linguistics, pp. 131–198 <https://doi.org/10.18653/v1/W16-2301> [Accessed: 20251217].
Ciribuco, Andrea (2020). Translating the village: Translation as part of the everyday lives of asylum seekers in Italy. Translation Spaces, v. 9, n. 2, pp. 179–201. <https://doi.org/10.1075/ts.20002.cir>. [Accessed: 20251217].
Demmans Epp, Carrie (2017). Migrants and Mobile Technology Use: Gaps in the Support Provided by Current Tools. Journal of Interactive Media in Education, n. 1. <https://jime.open.ac.uk/articles/jime.432>. [Accessed: 20251217].
Deng, Wesley Hanwen; Mehandru, Nikita; Robertson, Samantha; Salehi, Niloufar (2022). Beyond General Purpose Machine Translation: The Need for Context-specific Empirical Research to Design for Appropriate User Trust. arXiv:2205.06920v1. <https://doi.org/10.48550/arXiv.2205.06920>. [Accessed: 20251217].
Fan, Angela; Bhosale, Shruti; Schwenk, Holger; Ma, Zhiyi; El-Kishky, Ahmed; Goyal, Siddharth; Baines, Mandeep; Celebi, Onur; Wenzek, Guillaume; Chaudhary, Vishrav; Goyal, Naman; Birch, Tom; Liptchinsky, Vitaliy; Edunov, Sergey; Auli, Michael; Joulin, Armand (2021). Beyond English-Centric Multilingual Machine Translation. Journal of Machine Learning Research, v. 22, n. 107, pp. 1-48 <https://jmlr.org/papers/volume22/20-1307/20-1307.pdf>. [Accessed: 20251217].
Freitag, Markus; Mathur, Nitika; Deutsch, Daniel; Lo, Chi-Kiu; Avramidis, Eleftherios; Rei, Ricardo; Thompson, Brian; Blain, Frederic; Kocmi, Tom; Wang, Jiayi; Adelani, David Ifeoluwa; Buchicchio, Marianna; Zerva, Chrysoula; Lavie, Alon (2024). Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. In: Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz (eds.). Proceedings of the Ninth Conference on Machine Translation, November 2024. Association for Computational Linguistics, pp. 47–81. <https://aclanthology.org/2024.wmt-1.2/>. [Accessed: 20251217].
Gavioli, Laura; Wadensjö, Cecilia (eds.). (2023). The Routledge handbook of public service interpreting. London: Routledge. <https://doi.org/10.4324/9780429298202>. [Accessed: 20251217].
González Figueroa, Laura Andrea; Pöllabauer, Sonja (2025). Interpreter provision and training of interpreters for languages of limited diffusion: an overview of the situation in Austria. FITISPos International Journal, v. 12, n. 1, pp. 122–136. <https://doi.org/10.37536/FITISPos-IJ.2025.12.1.390>. [Accessed: 20251217].
Graham, Yvette; Baldwin, Timothy; Moffat, Alistair (2013). Continuous Measurement Scales in Human Evaluation of Machine Translation. In: Antonio Pareja-Lora; Maria Liakata; Stefanie Dipper (eds.). Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse. Association for Computational Linguistics, pp. 33-41. <https://aclanthology.org/W13-2305/> [Accessed: 20251217].
Hendy, Amr; Abdelrehim, Mohamed; Sharaf, Amr; Raunak, Vikas; Gabr, Mohamed; Matsushita, Hitokazu; Kim, Young Jin; Afify, Mohamed; Awadalla, Hany Hassan (2023). How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation. arXiv:2302.09210v1. <https://doi.org/10.48550/arXiv.2302.09210>. [Accessed: 20250519]. [Accessed: 20251217].
Hu, Junjie; Ruder, Sebastian; Siddhant, Aditya; Neubig, Graham; Firat, Orhan; Johnson, Melvin (2020). XTREME: a massively multilingual multi-task benchmark for evaluating cross-lingual generalization. In: Hal Daumé III; Aarti Singh (eds.). PMLR, Proceedings of Machine Learning Research, v. 119, pp. 4411-4421. <https://proceedings.mlr.press/v119/hu20b.html>. [Accessed: 20251217].
Jaeger, Byron C.; Edwards, Lloyd J.; Das, Kalyan; Sen, Pranab K. (2017). An R statistic for fixed effects in the generalized linear mixed model. Journal of Applied Statistics, v. 44, n. 6, pp. 1086–1105. <https://doi.org/10.1080/02664763.2016.1193725>. [Accessed: 20251217].
Kivijärvi, Antti; Myllylä, Martta (2022). Layered Confinement in Reception Centers: A Study of Asylum Seekers’ Experiences in Finland. Journal of Immigrant & Refugee Studies, v. 22, n. 4, pp. 1–14 <https://doi.org/10.1080/15562948.2022.2132341>. [Accessed: 20251217].
Kuznetsova, Alexandra; Brockhoff, Per B.; Christensen, Rune H. B. (2017). lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software, v. 82, n. 12, pp. 1–26. <https://doi.org/10.18637/jss.v082.i13> [Accessed: 20251217].
Licht, Daniel; Gao, Cynthia; Lam, Janice; Guzman, Francisco; Diab, Mona; Koehn, Philipp (2022). Consistent Human Evaluation of Machine Translation across Language Pairs. In: Kevin Duh; Francisco Guzmán (eds.). Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Association for Machine Translation in the Americas, pp. 309–321. <https://aclanthology.org/2022.amta-research.24/>. [Accessed: 20251217].
Liebling, Daniel J.; Lahav, Michal; Evans, Abigail; Donsbach, Aaron; Holbrook, Jess; Smus, Boris; Boran, Lindsey (2020). Unmet Needs and Opportunities for Mobile Translation AI. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, pp. 1-13. <https://doi.org/10.1145/3313831.3376261>. [Accessed: 20251217].
Macken, Lieve; van Hest, Ella; Tezcan, Arda; Lumingu, Michaël; Maryns, Katrijn; De Wilde, July (2025). Machine Translation to Inform Asylum Seekers: Intermediate Findings from the MaTIAS Project. In: Pierrette Bouillon; Johanna Gerlach; Sabrina Girletti; Lise Volkart; Raphael Rubino; Rico Sennrich; Samuel Läubli; Martin Volk; Miquel Esplà-Gomis; Vincent Vandeghinste; Helena Moniz; Sara Szoc (eds.) Proceedings of Machine Translation Summit XX : Volume 2. European Association for Machine Translation, pp. 77–78. <https://aclanthology.org/2025.mtsummit-2.10/>. [Accessed: 20251217].
Martindale, Marianna J.; Carpuat, Marine (2018). Fluency Over Adequacy: A Pilot Study in Measuring User Trust in Imperfect MT. In: Colin Cherry; Graham Neubig (eds.). Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Association for Machine Translation in the Americas, pp. 13–25. <https://aclanthology.org/W18-1803/>. [Accessed: 20251217].
Maryns, Katrijn; Smith-Khan, Laura Allison; Jacobs, Marie (2023). Multilingualism in Asylum and Migration Procedures. In: Carolyn McKinney; Pinky Makoe; Virginia Zavala (eds.). The Routledge handbook of multilingualism. 2nd ed. Abingdon, Oxo; New York: Routledge, pp. 394–414.
Microsoft (2025) Microsoft Translator. <https://translator.microsoft.com/>.
NLLB Team; Costa-Jussà, Marta R.; Cross, James; Çelebi, Onur; Elbayad, Maha; Heafield, Kenneth; Heffernan, Kevin; Kalbassi, Elahe; Lam, Janice; Licht, Daniel; Maillard, Jean; Sun, Anna; et al. (2022). No Language Left Behind: Scaling Human-Centered Machine Translation. arXiv:2207.04672v3 <https://doi.org/10.48550/arXiv.2207.04672>. [Accessed: 20251217].
OpenAI (2025) ChatGPT. <https://chat.openai.com/>.
Papineni, Kishore; Roukos, Salim; Ward, Todd; Zhu, Wei-Jing (2002). BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, pp. 311-318. <https://doi.org/10.3115/1073083.1073135>. [Accessed: 20251217].
Pięta, Hanna; Valdez, Susana (2024). Migration and translation technologies. In: Brigid Maher; Loredana Polezzi; Rita Wilson (eds.). The Routledge handbook of translation and migration. Abingdon, Oxon; New York: Routledge, pp. 434-450. <https://doi.org/10.4324/9781003287797-33>. [Accessed: 20251217].
Popović, Maja (2015). chrF: character n-gram F-score for automatic MT evaluation. In: Ondřej Bojar; Rajan Chatterjee; Christian Federmann; Barry Haddow; Chris Hokamp; Matthias Huck; Varvara Logacheva; Pavel Pecina (eds.). Proceedings of the Tenth Workshop on Statistical Machine Translation. Association for Computational Linguistics, pp. 392–395 <https://doi.org/10.18653/v1/W15-3049> [Accessed: 20251217].
Rei, Ricardo; Stewart, Craig; Farinha, Ana C.; Lavie, Alon (2020). COMET: A Neural Framework for MT Evaluation. In: Bonnie Webber; Trevor Cohn; Yulan He; Yang Liu (eds.). Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, pp. 2685–2702. <https://aclanthology.org/2020.emnlp-main.213/>. [Accessed: 20251217].
Robinson, Nathaniel; Ogayo, Perez; Mortensen, David R.; Neubig, Graham (2023). ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages. In: Philipp Koehn, Barry Haddow, Tom Kocmi, Christof Monz (eds.). Proceedings of the Eighth Conference on Machine Translation. Association for Computational Linguistics, pp. 392–418. <https://aclanthology.org/2023.wmt-1.40/>. [Accessed: 20251217].
Sellam, Thibault; Das, Dipanjan; Parikh, Ankur (2020). BLEURT: Learning Robust Metrics for Text Generation. In: Dan Jurafsky; Joyce Chai; Natalie Schluter; Joel Tetreault (eds.). Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, pp. 7881–7892. <https://aclanthology.org/2020.acl-main.704/>. [Accessed: 20251217].
Snover, Matthew; Dorr, Bonnie; Schwartz, Rich; Micciulla, Linnea; and Makhoul, John (2006). A Study of Translation Edit Rate with Targeted Human Annotation. In: Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers. Association for Machine Translation in the Americas, pp. 223–231. <https://aclanthology.org/2006.amta-papers.25/>. [Accessed: 20251217].
Valdez, Susana; Guerberof Arenas, Ana; Ligtenberg, Kars (2023). Migrant communities living in the Netherlands and their use of MT in healthcare settings. In: Mary Nurminen; Judith Brenner; Maarit Koponen; Sirkku Latomaa; Mikhail Mikhailov; Frederike Schierl; Tharindu Ranasinghe; Eva Vanmassenhove; Sergi Alvarez Vidal; Nora Aranberri; Mara Nunziatini; Carla Parra Escartín; Mikel Forcada; Maja Popovic; Carolina Scarton; Helena Moniz (eds.). Proceedings of the 24th Annual Conference of the European Association for Machine Translation. European Association for Machine Translation, pp. 325–334. <https://aclanthology.org/2023.eamt-1.32/>. [Accessed: 20251217].
Vanroy, Bram; Tezcan, Arda; Macken, Lieve (2023). MATEO: MAchine Translation Evaluation Online. In: Mary Nurminen; Judith Brenner; Maarit Koponen; Sirkku Latomaa; Mikhail Mikhailov; Frederike Schierl; Tharindu Ranasinghe; Eva Vanmassenhove; Sergi Alvarez Vidal; Nora Aranberri; Mara Nunziatini; Carla Parra Escartín; Mikel Forcada; Maja Popovic; Carolina Scarton; Helena Moniz (eds.). Proceedings of the 24th Annual Conference of the European Association for Machine Translation. European Association for Machine Translation, pp. 499–500. <https://aclanthology.org/2023.eamt-1.52/>. [Accessed: 20251217].
Vieira, Lucas N. (2024). Machine translation and migration. In: Brigid Maher; Loredana Polezzi; Rita Wilson (eds.). The Routledge handbook of translation and migration. Abingdon, Oxon; New York: Routledge, pp. 221–234. <https://doi.org/10.4324/9781003287797-33>. [Accessed: 20251217].
Xu, Weijia; Agrawal, Sweta; Briakou, Eleftheria; Martindale, Marianna J.; Carpuat, Marine (2023). Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection. Transactions of the Association for Computational Linguistics, v. 11, pp. 546–564. <https://doi.org/10.1162/tacl_a_00563>. [Accessed: 20251217].
Zhang, Tianyi; Kishore, Varsha; Wu, Felix; Weinberger, Kilian Q.; Artzi, Yoav (2020). BERTScore: Evaluating Text Generation with BERT. arXiv:1904.09675v3. <https://doi.org/10.48550/arXiv.1904.09675>. [Accessed: 20251217].
Zouhar, Vilém; Chen, Pinzhen; Lam, Tsz Kin; Moghe, Nikita; Haddow, Barry (2024). Pitfalls and Outlooks in Using COMET. In: Barry Haddow; Tom Kocmi; Philipp Koehn; Christof Monz (eds.). Proceedings of the Ninth Conference on Machine Translation. Association for Computational Linguistics, pp. 1272–1288. <https://aclanthology.org/2024.wmt-1.121/>. [Accessed: 20251217].
Articles més llegits del mateix autor/a
- Paola Ruffo, Joke Daems, Lieve Macken, Mesura i percepció de l'esforç: avaluació de tres fluxos de treball en traducció literària , Tradumàtica: traducció i tecnologies de la informació i la comunicació: Núm. 22 (2024): Interacció persona-ordinador en traducció i interpretació: programes i aplicacions