Diagnosing High-Quality Statistical Machine Translation Using Traces of Post-Edition Operations - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Diagnosing High-Quality Statistical Machine Translation Using Traces of Post-Edition Operations

Résumé

This paper proposes a fine-grained flexible analysis methodology to reveal the residual difficulties of a high-quality Statistical Machine Translation (SMT) system. This proposal is motivated by the fact that the traditional automated metrics are not enough informative to indicate the nature and reasons of those residual difficulties. Their resolution is however a key point towards improving the high-quality output. The novelty of our approach consists in diagnosing Machine Translation (MT) performance by making a connection between errors, the characteristics of source sentences and some internal parameters of the system, using traces of Post-Edition (PE) operations as well as Quality Estimation (QE) techniques. Our methodology is illustrated on a SMT system adapted to the medical domain, based on a high quality English-French parallel corpus of Cochrane systematic review abstracts. Our experimental results show that the main difficulties that the system faces are in the domains of term precision and source language syntactic and stylistic peculiarities. We furthermore provide general information regarding the corpus structure and its specificities, including internal stylistic varieties characteristic of this sub-genre.
Fichier principal
Vignette du fichier
Ive16diagnosing.pdf (230.13 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01388655 , version 1 (20-08-2019)

Identifiants

  • HAL Id : hal-01388655 , version 1

Citer

Julia Ive, Aurélien Max, François Yvon, Philippe Ravaud. Diagnosing High-Quality Statistical Machine Translation Using Traces of Post-Edition Operations. International Conference on Language Resources and Evaluation - Workshop on Translation Evaluation: From Fragmented Tools and Data Sets to an Integrated Ecosystem (MT Eval 2016 2016), 2016, Portorož, Slovenia. pp.8. ⟨hal-01388655⟩
276 Consultations
71 Téléchargements

Partager

Gmail Facebook X LinkedIn More