Unsupervised Pidgin Text Generation By Pivoting English Data and Self-Training
AI-generated Key Points
- Researchers address the lack of machine translation systems and NLP datasets for West African Pidgin English
- Aim to bridge the gap between Pidgin English and English through natural language generation techniques
- Develop a system to generate descriptions in Pidgin English from structured data
- Utilize existing monolingual Pidgin English text and parallel English data-to-text corpora
- Train a data-to-English text generation system before implementing unsupervised neural machine translation and self-training methods
- Human evaluation shows improvement in fluency and relevance using pivoting + self-training technique
- Research accepted at Workshop at ICLR 2020, offering innovative solutions for addressing language barriers in NLP
Authors: Ernie Chang, David Ifeoluwa Adelani, Xiaoyu Shen, Vera Demberg
Abstract: West African Pidgin English is a language that is significantly spoken in West Africa, consisting of at least 75 million speakers. Nevertheless, proper machine translation systems and relevant NLP datasets for pidgin English are virtually absent. In this work, we develop techniques targeted at bridging the gap between Pidgin English and English in the context of natural language generation. %As a proof of concept, we explore the proposed techniques in the area of data-to-text generation. By building upon the previously released monolingual Pidgin English text and parallel English data-to-text corpus, we hope to build a system that can automatically generate Pidgin English descriptions from structured data. We first train a data-to-English text generation system, before employing techniques in unsupervised neural machine translation and self-training to establish the Pidgin-to-English cross-lingual alignment. The human evaluation performed on the generated Pidgin texts shows that, though still far from being practically usable, the pivoting + self-training technique improves both Pidgin text fluency and relevance.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Look for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.