Hello,

Translation Quality Assessment (TQA) has seen significant advancements in recent years, particularly with the integration of artificial intelligence and the development of sophisticated evaluation metrics. Key developments include:

1. Integration of Large Language Models (LLMs):Recent studies have demonstrated that large language models, such as GPT-3.5 and GPT-4, can effectively evaluate translation quality. These models, when properly prompted, achieve state-of-the-art accuracy in assessing translations, aligning closely with human evaluations based on the Multidimensional Quality Metrics (MQM) framework.

arXiv

2. Development of Advanced Evaluation Metrics:Metrics like LEPOR (Length Penalty, Precision, n-gram Position difference Penalty, and Recall) have been introduced to provide a more nuanced assessment of translation quality. LEPOR incorporates multiple factors to address language biases and has been further enhanced in versions like hLEPOR and nLEPOR, integrating linguistic features and n-gram analyses for improved evaluation.

Wikipédia

3. Standardization Efforts:The Multidimensional Quality Metrics (MQM) framework has been pivotal in standardizing translation quality assessment. In 2024, the MQM Council introduced refined scoring models, including the Linear Calibrated Scoring Model and the Non-Linear Scoring Model, to enhance the precision and reliability of translation evaluations.

arXiv

4. Addressing Limitations in Existing Models:Recent research has critically examined current TQA models, identifying issues such as limited applicability, underutilization of technology, and lack of standardized evaluation criteria. Innovative approaches are being proposed to overcome these challenges, emphasizing the need for adaptable and technology-integrated assessment methods.

I have written a research proposal, ChatGPT and Google Translate as automatic translation tools, present at Researchgate, concerning how to evaluate these two tools.

Thank you Prof. Hans Kronning for sharing your research proposal.