L'impacte de l'ús de text a veu (TTS) en els fluxos de treball de postedició de traducció automàtica (PEMT) sobre l'esforç cognitiu, la productivitat, la qualitat i les percepcions dels traductors.
Article Sidebar
Main Article Content
Aquest experiment de seguiment ocular investiga l’impacte de l’ús de text a veu (TTS) juntament amb l’experiència de traducció i postedició de traducció automàtica (PEMT) en l’esforç cognitiu, la productivitat, la qualitat i les percepcions dels traductors durant la postedició de traducció automàtica de l’anglès a l’alemany. El TTS ha reduït substancialment la velocitat de la PEMT i la durada mitja de les fixacions en el text meta, a banda d’augmentar el nombre de fixacions i el temps de permanència en els textos origen i meta. El TTS no ha tingut un efecte significatiu en la distància d’edició ni en la qualitat del text meta. L’experiència tampoc ha mostrat un impacte significatiu. 14 dels 21 participants han preferit realitzar la postedició amb TTS.
Article Details
Aquesta obra està sota una llicència internacional Creative Commons Reconeixement 4.0.
(c) Dragos Ciobanu, Miguel Rios, Alina Secară, Justus Brockmann, Raluca-Maria Chereji, Claudia Wiesinger, 2024
Allain, J.-F. (2010). Repenser la révision: Défense et illustration de la relecture croisée. Traduire, 223, 114–120. <https://doi.org/10.4000/traduire.316.> [Accessed: 20241218].
Báez M. C. T. (2018). Machine Translation and Postediting: Impact of Training and Directionality on Quality and Productivity. Tradumàtica tecnologies de la traducció, 16(16). <https://doi.org/10.5565/rev/tradumatica.215> [Accessed: 20241218].
Balling, L. W. (2008). A brief introduction to regression designs and mixed-effects modelling by a recent convert. In S. Göpferich, A. L. Jakobsen, & I. Mees (Eds.), Looking At Eyes (pp. 175–192). Samfundslitteratur.
Briva-Iglesias, V., O’Brien, S., & Cowan, B. R. (2023). The impact of traditional and interactive post-editing on Machine Translation User Experience, quality, and productivity. Translation, Cognition & Behavior, 6(1), 60–86. <https://doi.org/10.1075/tcb.00077.bri.> [Accessed: 20241218].
Brockmann, J., Secară, A., & Ciobanu, D. (forthcoming). The use of speech technologies and machine translation in institutional translation practices. Proceedings of the 45th Translating and the Computer (TC45) Conference. Translating and the Computer (TC45), Luxembourg.
Bürkner, P.-C. (2017). brms: An R Package for Bayesian Multilevel Models Using Stan. Journal of Statistical Software, 80(1), 1–28. <https://doi.org/10.18637/jss.v080.i01.> [Accessed: 20241218].
Cadwell, P., O’Brien, S., & Teixeira, C. S. C. (2018). Resistance and accommodation: Factors for the (non-) adoption of machine translation among professional translators. Perspectives, 26(3), 301–321. <https://doi.org/10.1080/0907676X.2017.1337210.> [Accessed: 20241218].
Canfora, C., & Ottmann, A. (2020). Risks in neural machine translation. Translation Spaces, 9(1), 57–77.
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017). Stan: A Probabilistic Programming Language. Journal of Statistical Software, 76, 1–32. <https://doi.org/10.18637/jss.v076.i01.> [Accessed: 20241218].
Castilho, S. (2016). Measuring acceptability of machine translated enterprise content [PhD Thesis]. Dublin City University.
Chen, F., & Jokinen, K. (2010). Speech technology: Theory and applications. Springer.
Chereji, R. (2024). What makes a medical translator? A survey on medical translators’ profiles, work-related challenges and use of Computer-Assisted Translation and Automatic Speech Recognition tools. The Journal of Specialised Translation, (42), 39–63. <https://doi.org/10.26034/cm.jostrans.2024.5979> [Accessed: 20241218].
Ciobanu, D. (2016). Automatic speech recognition in the professional translation process. Translation Spaces, 5(1), 124–144. <https://doi.org/10.1075/ts.5.1.07cio.> [Accessed: 20241218].
Ciobanu, D., Ragni, V., & Secară, A. (2019). Speech Synthesis in the Translation Revision Process: Evidence from Error Analysis, Questionnaire, and Eye-Tracking. Informatics, 6(4)(51), Article 4. <https://doi.org/10.3390/informatics6040051.> [Accessed: 20241218].
Conklin, K., Pellicer-Sánchez, A., & Carrol, G. (2018). Eye-Tracking: A Guide for Applied Linguistics Research. Cambridge University Press. <https://doi.org/10.1017/9781108233279.> [Accessed: 20241218].
Daems, J., Carl, M., Vandepitte, S., Hartsuiker, R., & Macken, L. (2016). The Effectiveness of Consulting External Resources During Translation and Post-editing of General Text Types. In M. Carl, S. Bangalore, & M. Schaeffer (Eds.), New Directions in Empirical Translation Process Research: Exploring the CRITT TPR-DB (pp. 111–133). Springer International Publishing. <https://doi.org/10.1007/978-3-319-20358-4_6> [Accessed: 20241218].
Daems, J., Vandepitte, S., Hartsuiker, R. J., & Macken, L. (2017a). Translation Methods and Experience: A Comparative Analysis of Human Translation and Post-editing with Students and Professional Translators. Meta, 62(2), 245–270. <https://doi.org/10.7202/1041023ar.> [Accessed: 20241218].
Daems, J., Vandepitte, S., Hartsuiker, R. J., & Macken, L. (2017b). Identifying the Machine Translation Error Types with the Greatest Impact on Post-editing Effort. Frontiers in Psychology, 8. <https://doi.org/10.3389/fpsyg.2017.01282.> [Accessed: 20241218].
Dai, G. & Liu, S. (2024). Towards predicting post-editing effort with source text readability: An investigation for english-chinese machine translation. The Journal of Specialised Translation, 41, 206–229. <https://doi.org/10.26034/cm.jostrans.2024.4723.> [Accessed: 20241218].
Damerau, F. J. (1964). A technique for computer detection and correction of spelling errors. Commun. ACM, 7, 171–176.
De Almeida, G., & O’Brien, S. (2010). Analysing post-editing performance: Correlations with years of translation experience. Proceedings of the 14th Annual Conference of the European Association for Machine Translation. European Association for Machine Translation, St. Raphael.
do Carmo, F. (2021). Editing Actions: A Missing Link Between Translation Process Research and Machine Translation Research. In M. Carl (Ed.), Explorations in Empirical Translation Process Research (pp. 3–38). Springer International Publishing. <https://doi.org/10.1007/978-3-030-69777-8_1.> [Accessed: 20241218].
ELIA, EMT, EUATC, FIT EUROPE, GALA, LIND, & WOMEN IN LOCALIZATION. (2024). 2024 European Language Industry Survey. Trends, expectations and concerns of the European language industry.
EyeLink Data Viewer (4.2.1). (2021). [Computer software]. SR Research Ltd.
Farrell, M. (2023). Do translators use machine translation and if so, how? Results of a survey among professional translators. In J. Moorkens & V. Sosoni (Eds.), Proceedings of the 44th Translating and the Computer (TC44) conference (pp. 49–60). <https://www.asling.org/tc44/wp-content/uploads/TC44-luxembourg2022.pdf.> [Accessed: 20241218].
Ferreira, A., Schwieter, J. W., Gottardo, A., & Jones, J. (2016). Cognitive effort in direct and inverse translation performance: Insight from eye-tracking technology. Cadernos de Tradução, 36(3), 60–80. <https://doi.org/10.5007/2175-7968.2016v36n3p60.> [Accessed: 20241218].
GALA. (2024). AI & Automation Barometer Report. <https://user.gala-global.org/files/ed13f63f-8c94-4a89-becf-7d982e5fe985.bin.> [Accessed: 20241218].
Gaspari, F., Toral, A., Naskar, S. K., Groves, D., & Way, A. (2014). Perception vs. reality: Measuring machine translation post-editing productivity. Proceedings of the 11th Conference of the Association for Machine Translation in the Americas, 60–72. <https://aclanthology.org/2014.amta-wptp.5.> [Accessed: 20241218].
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian Data Analysis (2nd ed.). Chapman and Hall/CRC.
Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. In Data Analysis Using Regression and Multilevel/Hierarchical Models: Vol. Analytical methods for social research. Cambridge University Press.
Gius, E., Meister, J. C., Meister, M., Petris, M., Bruck, C., Jacke, J., Schumacher, M., Gersthofer, D., Flüh, M., & Horstmann, J. (2022). CATMA 6 (10.5281/zenodo.1470118; 6.5) [Computer software]. Zenodo.
Heiss, A. (2021). Bayesian statistics resources. <https://evalf21.classes.andrewheiss.com/resource/bayes/.> [Accessed: 20241218].
Herbig, N., Düwel, T., Pal, S., Meladaki, K., Monshizadeh, M., Krüger, A., & van Genabith, J. (2020). MMPE: A Multi-Modal Interface for Post-Editing Machine Translation. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 1691–1702. <https://doi.org/10.18653/v1/2020.acl-main.155.> [Accessed: 20241218].
Holmqvist, K., & Andersson, R. (2017). Eye-tracking: A comprehensive guide to methods, paradigms and measures (2nd ed.). Lund Eye Tracking Research Institute.
Hvelplund, K. T. (2014). Eye tracking and the translation process: Reflections on the analysis and interpretation of eye-tracking data. MonTI. Monografías de Traducción e Interpretación, 201–223. <https://doi.org/10.6035/MonTI.2014.ne1.6.> [Accessed: 20241218].
Hvelplund, K. T. (2017). Translators’ Use of Digital Resources during Translation. HERMES - Journal of Language and Communication in Business, 56, Article 56. <https://doi.org/10.7146/hjlcb.v0i56.97205> [Accessed: 20241218].
Hvelplund, K. T. (2019). Digital resources in the translation process – attention, cognitive effort and processing flow. Perspectives, 27(4), 510–524. <https://doi.org/10.1080/0907676X.2019.1575883> [Accessed: 20241218].
ISO - International Organization for Standardization. (2017). ISO 18587:2017 Translation services – Post-editing of machine translation output – Requirements. <http://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/06/29/62970.html.> [Accessed: 20241218].
ISO - International Organization for Standardization. (2024). ISO 5060:2024 Translation services – Evaluation of translation output – General guidance. <https://www.iso.org/standard/80701.html.> [Accessed: 20241218].
Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354. <https://doi.org/10.1037/0033-295X.87.4.329.> [Accessed: 20241218].
Koponen, M. (2012). Comparing human perceptions of post-editing effort with post-editing operations. Proceedings of the Seventh Workshop on Statistical Machine Translation, 181–190. <https://aclanthology.org/W12-3123.> [Accessed: 20241218].
Kruschke, J. K. (2018). Rejecting or Accepting Parameter Values in Bayesian Estimation. Advances in Methods and Practices in Psychological Science, 1(2), 270–280. <https://doi.org/10.1177/2515245918771304.> [Accessed: 20241218].
Kruschke, J. K. (2021). Bayesian Analysis Reporting Guidelines. Nature Human Behaviour, 5(10), 1282–1291. <https://doi.org/10.1038/s41562-021-01177-7.> [Accessed: 20241218].
Levenshtein, V. I. (1965). Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics. Doklady, 10, 707–710.
Liu, Y., & Zheng, B. (2022). Comparability of difficulty levels of translation tasks in CET-6 parallel test forms: Evidence from product and process-based data. The Interpreter and Translator Trainer, 16(4), 428–447. <https://doi.org/10.1080/1750399X.2022.2036938> [Accessed: 20241218].
Liyanapathirana, J., Bouillon, P., & Mesa-Lao, B. (2019). Surveying the potential of using speech technologies for post-editing purposes in the context of international organizations: What do professional translators think? Proceedings of Machine Translation Summit XVII: Translator, Project and User Tracks, 149–158. https://aclanthology.org/W19-6728.> [Accessed: 20241218].
Lommel, A., Uszkoreit, H., & Burchardt, A. (2014). Multidimensional Quality Metrics (MQM): A Framework for Declaring and Describing Translation Quality Metrics. Revista Tradumàtica: Tecnologies de La Traducció, 12, 455–463.
Macken, L., Prou, D., & Tezcan, A. (2020). Quantifying the Effect of Machine Translation in a High-Quality Human Translation Production Process. Informatics, 7(2), Article 2. <https://doi.org/10.3390/informatics7020012.> [Accessed: 20241218].
McElreath, R. (2016). Statistical rethinking: A Bayesian course with examples in R and Stan. CRC Press/Taylor & Francis Group.
Meidert, U., Neumann, S., Ehrensberger-Dow, M., & Becker, H. (2016). Physical Ergonomics at Translators’ Workplaces: Findings from Ergonomic Workplace Assessments and Interviews. ILCEA. Revue de l’Institut Des Langues et Cultures d’Europe, Amérique, Afrique, Asie et Australie, 27. <http://journals.openedition.org/ilcea/3996.> [Accessed: 20241218].
Moorkens, J., O’Brien, S., da Silva, I. A. L., de Lima Fonseca, N. B., & Alves, F. (2015). Correlations of perceived post-editing effort with measurements of actual effort. Machine Translation, 29(3), 267–284. <https://doi.org/10.1007/s10590-015-9175-2.> [Accessed: 20241218].
Moorkens, J., & O’Brien, S. (2017). Assessing user interface needs of post-editors of machine translation. In D. Kenny (Ed.), Human Issues in Translation Technology (pp. 109–130). Routledge. <https://www-taylorfrancis-com.uaccess.univie.ac.at/books/edit/10.4324/9781315648934/human-issues-translation-technology-dorothy-kenny.> [Accessed: 20241218].
Moorkens, J. (2018). Eye tracking as a measure of cognitive effort for post-editing of machine translation. In C. Walker & F. M. Federici (Eds.), Eye Tracking and Multidisciplinary Studies on Translation (pp. 55–70). John Benjamins Publishing Company. <https://benjamins.com/catalog/btl.143.03tei> [Accessed: 20241218].
O’Brien, S. (2009). Eye-tracking in translation process research: Methodological challenges and solutions. In I. M. Mees, S. Göpferich, & F. Alves (Eds.), Methodology, Technology and Innovation in Translation Process Research: A Tribute to Arnt Lykke Jakobsen (pp. 251–266). Samfundslitteratur. <https://research.cbs.dk/en/publications/methodology-technology-and-innovation-in-translation-process-rese.> [Accessed: 20241218].
Orlando, M., Liao, S., & Kruger, J-L. (2024). Translation and Interpreting technologies and their impact on the industry. Macquarie University.
Parra Escartín, C., & Arcedillo, M. (2015). Machine translation evaluation made fuzzier: A study on post-editing productivity and evaluation metrics in commercial settings. Proceedings of MT Summit XV, 131–144. <https://aclanthology.org/2015.mtsummit-papers.11/.> [Accessed: 20241218].
R Core Team. (2023). R: A Language and Environment for Statistical Computing [Computer software]. R Foundation for Statistical Computing. <https://www.R-project.org/> [Accessed: 20241218].
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422. <https://doi.org/10.1037/0033-2909.124.3.372.> [Accessed: 20241218].
Rios, M., Brockmann, J., Wiesinger, C., Chereji, R.-M., Secară, A., & Ciobanu, D. (2024). Bayesian Hierarchical Modelling for Analysing the Effect of Speech Synthesis on Post-Editing Machine Translation. EAMT 2024.
Rochard, M. (2021). Michel Rochard—Linguiste du mois de juin 2021 (A. Bulger, Interviewer) [Interview]. <https://www.le-mot-juste-en-anglais.com/2021/06/le-linguiste-du-mois-juillet-2021-michel-rochard-est-dipl%C3%B4m%C3%A9-de-traduction-et-dinterpr%C3%A9tation-de-liaison-du-fas-germ.html.> [Accessed: 20241218].
Scocchera, G. (2017). Translation Revision as Rereading: Different Aspects of the Translator’s and Reviser’s Approach to the Revision Process. Mémoires Du Livre / Studies in Book Culture, 9(1).
Silva, B. B., Orrego-Carmona, D., & Szarkowska, A. (2022). Using linear mixed models to analyze data from eye-tracking research on subtitling. Translation Spaces, 11(1), 60–88. <https://doi.org/10.1075/ts.21013.sil.> [Accessed: 20241218].
SR Research WebLink (2.1.1). (2021). [Computer software]. SR Research Ltd.
Tan, L. (2023). Speech translation. In S.-W. Chan (Ed.), Routledge Encyclopedia of Translation Technology (2nd ed., pp. 726–737). Routledge. <https://doi.org/10.4324/9781315749129-51.> [Accessed: 20241218].
Taylor, P. (2009). Text-to-Speech Synthesis. Cambridge University Press. <https://doi.org/10.1017/CBO9780511816338.> [Accessed: 20241218].
Temizöz, Ö. (2016). Postediting machine translation output: Subject matter experts versus professional translators. Perspectives, 24(4), 646–665. <https://doi.org/10.1080/0907676X.2015.1119862.> [Accessed: 20241218].
Vieira, L. N. (2014). Indices of cognitive effort in machine translation post-editing. Machine Translation, 28(3), 187–216. <https://doi.org/10.1007/s10590-014-9156-x.> [Accessed: 20241218].
Wang, Y., & Daghigh, A. J. (2023). Effect of text type on translation effort in human translation and neural machine translation post-editing processes: Evidence from eye-tracking and keyboard-logging. Perspectives, 0(0), 1–16. <https://doi.org/10.1080/0907676X.2023.2219850.> [Accessed: 20241218].
Wiesinger, C., Brockmann, J., Secară, A., & Ciobanu, D. (2022). Speech-enabled machine translation post-editing in the context of translator training. In M. Kornacki & G. Massey (Eds.), Contextuality in Translation and Interpreting. Selected Papers from the Łódź-ZHAW Duo Colloquium on Translation and Meaning 2020–2021 (Vol. 70, pp. 67–89). Peter Lang.
Articles més llegits del mateix autor/a
- Dragos Ciobanu, De Dragons i el reconeixement de veu, bruixots i aprenents , Tradumàtica: traducció i tecnologies de la informació i la comunicació: Núm. 12 (2014): Traducció i qualitat