Leveraging GPT-4 for Automatic Translation Post-Editing

Authors: Vikas Raunak, Amr Sharaf, Hany Hassan Awadallah, Arul Menezes

License: CC BY 4.0

Results of the summarizing process for the arXiv paper: 2305.14878v1

  • Comprehensive Summary
  • Key points
  • Layman's Summary
  • Blog article
In recent years, Neural Machine Translation (NMT) has emerged as the leading approach to machine translation. However, even with NMT models, post-editing is still required to rectify errors and enhance quality, especially in critical settings. To address this issue, researchers have explored various approaches to Automatic Post-Editing (APE), including context-aware models and the use of artificial training data. In this study, the authors formalize the task of APE with Large Language Models (LLMs) and investigate the use of GPT-4 for automatic post-editing across several language pairs. Their results demonstrate that GPT-4 is adept at producing meaningful edits even when the target language is not English. Notably, they achieve state-of-the-art performance on WMT-22 English-Chinese, English-German, Chinese-English and German-English language pairs using GPT-4 based post-editing. While previous studies have contributed significantly to the development of neural models for APE by exploring different architectures and learning strategies, this work represents the first investigation into using GPT-4 for automatic post-editing of translations. Additionally, it is related to other works exploring LLMs for translation. Overall, these findings suggest that GPT-4 can be a valuable tool in improving machine translation quality through automatic post-editing. With further advancements in LLM technology expected in the immediate future, it holds great promise for enhancing machine translation capabilities across multiple languages.
AI-generated keywords: Neural Machine Translation

AI-generated Key Points

  • Neural Machine Translation (NMT) is the leading approach to machine translation.
  • Even with NMT models, post-editing is still required to rectify errors and enhance quality, especially in critical settings.
  • Researchers have explored various approaches to Automatic Post-Editing (APE), including context-aware models and the use of artificial training data.
  • The authors formalize the task of APE with Large Language Models (LLMs) and investigate the use of GPT-4 for automatic post-editing across several language pairs.
  • Their results demonstrate that GPT-4 is adept at producing meaningful edits even when the target language is not English, achieving state-of-the-art performance on WMT-22 English-Chinese, English-German, Chinese-English and German-English language pairs using GPT-4 based post-editing.
  • This work represents the first investigation into using GPT-4 for automatic post-editing of translations and is related to other works exploring LLMs for translation.
  • These findings suggest that GPT-4 can be a valuable tool in improving machine translation quality through automatic post-editing.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Abstract: While Neural Machine Translation (NMT) represents the leading approach to Machine Translation (MT), the outputs of NMT models still require translation post-editing to rectify errors and enhance quality, particularly under critical settings. In this work, we formalize the task of translation post-editing with Large Language Models (LLMs) and explore the use of GPT-4 to automatically post-edit NMT outputs across several language pairs. Our results demonstrate that GPT-4 is adept at translation post-editing and produces meaningful edits even when the target language is not English. Notably, we achieve state-of-the-art performance on WMT-22 English-Chinese, English-German, Chinese-English and German-English language pairs using GPT-4 based post-editing, as evaluated by state-of-the-art MT quality metrics.

Submitted to arXiv on 24 May. 2023

Tools for this paper

Explain it differently 3 free rewrites left today
Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Markdown (Notion, Obsidian) · Premium
Citation alerts Premium
Journal club Slides to present it Premium
For journalists Press kit and hype check Premium

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.