EVALUATING THE STRENGTHS AND LIMITATIONS OF CHATGPT-GENERATED TRANSLATIONS IN ACADEMIC POST-EDITING WORKFLOWS

Christanta Rejuna Phanes S Brahmana, Rudy Sofyan, Umar Mono

Abstract


This study evaluates the strengths and limitations of ChatGPT-generated translations in academic post-editing workflows. The research highlights ChatGPT's ability to enhance translation efficiency by producing grammatically precise and structurally sound drafts, enabling post-editors to focus on higher-level refinements like coherence and contextual accuracy. While the tool demonstrates significant advantages in improving workflow efficiency and adapting texts to academic conventions, it faces challenges in addressing cultural nuances and idiomatic expressions, particularly in underrepresented languages such as Indonesian. The study suggests potential improvements, including expanding training datasets and incorporating advanced contextual understanding features, to maximize ChatGPT's utility. Ultimately, the findings emphasize the importance of combining AI capabilities with human expertise to ensure high-quality and culturally sensitive academic translations. Future research should focus on refining AI tools to meet the diverse needs of global academic communication.

Keywords


Academic text translation, Artificial Intelligence, ChatGPT-generated translations, Post-editing Process, Strengths and Limitations

Full Text:

PDF

References


Alkhawaja, L. (2024). Unveiling the New Frontier: ChatGPT-3 Powered Translation for Arabic-English Language Pairs. Theory and Practice in Language Studies, 14(2), 347–357. https://doi.org/10.17507/tpls.1402.05

Bassnett, S. (2002). Translation Studies (Third Edition). Routledge (Taylor and Francis Group).

Berg, B. L., & Lune, H. (2017). Qualitative research methods for the social sciences (Ninth Edition). Pearson Education Limited.

Creswell, J. W. (2011). Educational Research - Planning, Conducting, and Evaluating Quantitative and Qualitative Research (P. A. Smith, Ed.; Fourth Ed.). Pearson.

Gao, R., Lin, Y., Zhao, N., & Cai, Z. G. (2024). Machine translation of Chinese classical poetry: a comparison among ChatGPT, Google Translate, and DeepL Translator. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03363-0

Gill, S. S., & Kaur, R. (2023). ChatGPT: Vision and Challenges. Internet of Things and Cyber-Physical Systems, 3, 262–271. https://doi.org/https://doi.org/10.1016/j.iotcps.2023.05.004

Gustafsson, J. (2017). Single case studies vs. multiple case studies: A comparative study.

Hidayati, N. N., & Nihayah, D. H. (2024). Google Translate, ChatGPT or Google Bard AI: A Study toward Non-English Department College Students' Preference and Translation Comparison. Inspiring: English Education Journal, 7(1), 14–33. https://doi.org/10.35905/inspiring.v7i1.8821

Jiao, W., Wang, W., Huang, J., Wang, X., Shi, S., & Tu, Z. (2023). Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine. http://arxiv.org/abs/2301.08745

Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., Wu, Z., Zhao, L., Zhu, D., Li, X., Qiang, N., Shen, D., Liu, T., & Ge, B. (2023). Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models. https://doi.org/10.1016/j.metrad.2023.100017

Mijwil, M. M., Hiran, K. K., Doshi, R., Dadhich, M., Al-Mistarehi, A.-H., & Bala, I. (2023). ChatGPT and the Future of Academic Integrity in the Artificial Intelligence Era: A New Frontier. Al-Salam Journal for Engineering and Technology, 2(2), 116–127. https://doi.org/10.55145/ajest.2023.02.02.015

Munday, Jeremy. (2008). Introducing translation studies : theories and applications (Second Ed.). Routledge.

Salam, A., Mahfud, M., & Nurhusna, N. (2018). Characteristic of academic texts from systemic functional linguistics perspectives. International Journal of Language Education, 2(2), 122–134. https://doi.org/10.26858/ijole.v2i2.5266

Sharabi, C. (2023). What is Automatic Translation? Is it Right for Your Localization Projects? https://www.getblend.com/blog/what-is-automatic-translation/

Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). Sage Publications, Inc.

Vieira, L. N., Alonso, E., & Bywood, L. (2019). Introduction - Post-editing in practice_Process, product. JoSTrans: The Journal of Specialised Translation, 2(31), 1–13. https://jostrans.org/issue31/art_introduction.pdf

Ye, L. (2024). Frontiers in Computing and Intelligent Systems The Feasibility Study of Artificial Intelligence ChatGPT in Translation Field. Frontiers in Computing and Intelligent Systems ISSN: 2832-, 8(1), 52–57.

Yin, R. K. (2003). Case study research design and methods (3rd Ed). Sage Publications, Inc.




DOI: https://doi.org/10.30743/ll.v9i1.10551

Refbacks

  • There are currently no refbacks.


Fakultas Sastra 
Universitas Islam Sumatera Utara (UISU), Medan
Jl. Sisingamangaraja Teladan Medan 20217
Telp. (061) 7869911, e-mail: language_literacy@sastra.uisu.ac.id