1. Evaluation of Machine Translation Quality through the Metrics of Error Rate and Accuracy
- Author
-
Michal Munk, Petr Hájek, Jan Skalka, and Daša Munková
- Subjects
Similarity (geometry) ,Machine translation ,Computer science ,business.industry ,media_common.quotation_subject ,Word error rate ,020206 networking & telecommunications ,02 engineering and technology ,computer.software_genre ,language.human_language ,0202 electrical engineering, electronic engineering, information engineering ,language ,General Earth and Planetary Sciences ,020201 artificial intelligence & image processing ,Quality (business) ,Slovak ,Evaluation of machine translation ,Artificial intelligence ,State (computer science) ,business ,computer ,Sentence ,Natural language processing ,General Environmental Science ,media_common - Abstract
The aim of the paper is to find out whether it is necessary to use all automatic measures of error rate and accuracy when evaluating the quality of machine translation output from the synthetic Slovak language into the analytical English language. We used multiple comparisons for the analysis and visualized the results for each sentence through the icon graphs. Based on the results, we can state that all examined metrics, which are based on textual similarity, except the f-measure, are needed to be included in the MT quality evaluation when analyzing, sentence by sentence, the machine translation output.
- Published
- 2020