PROPOSITION-BASED EVALUATION OF MACHINE-TRANSLATED ACADEMIC TEXT

Aulia Addinillah Arum, B.R. Suryo Baskoro

Abstract


This study aims to describe the rendition of propositional meaning in machine-translated academic text. A proposition is that part of the meaning of a clause or sentence that is constant, despite changes in such things as the voice or illocutionary force of the clause. A proposition may be related to other units of its kind through interpropositional relations, such as temporal relations and logical relations. To assess whether the meaning of an utterance is conveyed adequately in the target text, we conducted the proposition-based evaluation by looking at the grammatical structure, semantic roles, and the category of proposition reflected in the source text and the target text. The analysis is done by adopting the qualitative approach based on Larson’s theory of Meaning-Based Translation. The findings of this study suggest that identical grammatical structure can have a positive correlation to the semantic structure and the transfer of meaning in machine translation. This study also reveals that grammatical-structure similarity does not always indicate meaning accuracy in translation.

 


Keywords


Translation Evaluation, Machine Translation, Translation Quality, Meaning, Semantic Role

Full Text:

PDF

References


Badziński, A. (2018). Collocations, Equivalence, and Untranslatability as Selected Critical Aspects in Medical Translation. In Towards Understanding Medical Translation and Interpreting. Gdańsk University Press.

Baker, M. (2018). In Other Words. Routledge.

Chomsky, N. (2019). Studies on Semantics in Generative Grammar. In Studies on Semantics in Generative Grammar. De Gruyter Mouton. https://doi.org/10.1515/9783110867589

Culy, C., & Riehemann, S. Z. (2003). The Limits of NGram Translation Evaluation Metrics. Proceedings of Machine Translation Summit IX, 71–78.

Daniele, F. (2019). Performance of an automatic translator in translating medical abstracts. Heliyon, 5(10), e02687. https://doi.org/10.1016/j.heliyon.2019.e02687

DeFrancesco, C., & Perkins, K. (2012). An Analysis of the Proposition Density, Sentence and Clause Types, and Non-Finite Verbal Usage in Two College Textbooks. Proceedings of the 11th Annual College of Education & GSN Research Conference, 6. http://education.fiu.edu/research_conference/

Dixon, R. M. W. (2010). Basic linguistic theory (Vol. 2). Oxford University Press.

Farwell, D., & Helmreich, S. (2003, September 23). Pragmatics-based translation and MT evaluation. Workshop on Systemizing MT Evaluation. MTSummit 2003, New Orleans, USA. https://aclanthology.org/2003.mtsummit-eval.3

Giménez, J., & Màrquez, L. (2010). Linguistic measures for automatic machine translation evaluation. Machine Translation, 24(3–4), 209–240. https://doi.org/10.1007/s10590-011-9088-7

Givón, T. (2001). Syntax: An introduction. Vol. 1: ... (Rev. ed). Benjamins.

Kashgary, A. D. (2011). The paradox of translating the untranslatable: Equivalence vs. non-equivalence in translating from Arabic into English. Journal of King Saud University - Languages and Translation, 23(1), 47–57. https://doi.org/10.1016/j.jksult.2010.03.001

Kemp, G. (2018). What Is This Thing Called Philosophy of Language? (2nd ed.). Routledge.

Koehn, P. (2010). Statistical Machine Translation. Cambridge University Press. https://www.cambridge.org/id/academic/subjects/computer-science/artificial-intelligence-and-natural-language-processing/statistical-machine-translation?format=HB&isbn=9780521874151

Larson, M. (1998). Meaning-based Translation. A Guide to Cross-Language Equivalence (2nd ed.). University Press of America.

Monz, C., & Koehn, P. (2006). Manual and automatic evaluation of machine translation between European languages. Proceedings of the Workshop on Statistical Machine Translation, 102–121.

Papineni, K. et al. (2002). Bleu: A Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, 311–318. https://doi.org/10.3115/1073083.1073135

Pavey, E. L. (2010). The structure of language: An introduction to grammatical analysis. Cambridge University Press. https://doi.org/10.1017/CBO9780511777929

Popović, M. (2020). Informative Manual Evaluation of Machine Translation Output. Proceedings of the 28th International Conference on Computational Linguistics, 5059–5069. https://doi.org/10.18653/v1/2020.coling-main.444

Wu, Y., & Xu, R. (2011). The Application of Chomsky’s Syntactic Theory in Translation Study. Journal of Language Teaching and Research, 2(2), 396–399. https://doi.org/10.4304/jltr.2.2.396-399




DOI: https://doi.org/10.30743/ll.v6i1.4678

Refbacks

  • There are currently no refbacks.


Fakultas Sastra 
Universitas Islam Sumatera Utara (UISU), Medan
Jl. Sisingamangaraja Teladan Medan 20217
Telp. (061) 7869911, e-mail: language_literacy@sastra.uisu.ac.id