Results of the summarizing process for the arXiv paper: 2204.03084v1

In their paper titled "Knowledge Infused Decoding," authors Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, and Ahmed Hassan Awadallah introduce a novel decoding algorithm called Knowledge Infused Decoding (KID) for generative language models (LMs). The study addresses the limitations of pre-trained LMs in recalling factually correct knowledge within specific contexts. This often leads to counterfactual or hallucinatory generation in knowledge-intensive natural language generation tasks. Existing solutions typically involve modifying pre-training or task fine-tuning objectives to incorporate knowledge. However, these methods require additional training or architectural adjustments. <br> This memory interacts with an externally created knowledge trie and is continuously updated as a knowledge-aware constraint using reinforcement learning. The effectiveness of KID was evaluated on six diverse knowledge-intensive NLG tasks. In these tasks, Particularly strong performance was observed in few-shot scenarios compared to seven related knowledge-infusion techniques. Human evaluation confirmed that KID enhances the generation of more relevant and factual language based on input context when compared to multiple baseline models. Additionally, The code for implementing KID is openly available on GitHub at https://github.com/microsoft/KID. This research was presented at ICLR 2022 and contributes valuable insights into improving the performance of generative LMs through dynamic external knowledge infusion during decoding processes.

• - Authors: Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Hassan Awadallah
• - Introduces Knowledge Infused Decoding (KID) algorithm for generative language models
• - Addresses limitations of pre-trained LMs in recalling factually correct knowledge within specific contexts
• - KID interacts with externally created knowledge trie and is continuously updated using reinforcement learning
• - Evaluated on six diverse knowledge-intensive NLG tasks with strong performance in few-shot scenarios
• - Human evaluation confirms KID enhances generation of more relevant and factual language compared to baseline models
• - Code for implementing KID available on GitHub at https://github.com/microsoft/KID
• - Presented at ICLR 2022 and contributes insights into improving generative LMs through dynamic external knowledge infusion during decoding

Summary- The authors created a special algorithm called Knowledge Infused Decoding (KID) for language models. - KID helps these models remember correct information better in specific situations. - It works by using external knowledge and learning from feedback to get better over time. - KID was tested on different tasks and did well, especially when given only a little information. - People who checked KID said it made more accurate sentences compared to other models. Definitions- Algorithm: A set of instructions or rules followed by a computer to solve a problem or perform a task. - Language model: A computer program that generates human-like text based on input data. - Knowledge: Information or facts that someone knows or learns about a particular subject. - Trie: A tree-like data structure used for storing and retrieving information efficiently. - Reinforcement learning: A type of machine learning where an algorithm learns through trial and error by receiving feedback on its actions.

Introduction

In recent years, there has been a significant increase in the use of generative language models (LMs) for various natural language generation (NLG) tasks. These models have shown impressive performance in generating coherent and fluent text based on input prompts. However, one major limitation of these pre-trained LMs is their inability to recall factual knowledge within specific contexts. This often leads to counterfactual or hallucinatory generation, which can be problematic in knowledge-intensive NLG tasks. To address this issue, a team of researchers from Microsoft Research and Carnegie Mellon University came up with a novel decoding algorithm called Knowledge Infused Decoding (KID). In their paper titled "Knowledge Infused Decoding," authors Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, and Ahmed Hassan Awadallah introduce KID as an effective solution for incorporating external knowledge into pre-trained LMs during the decoding process.

The Need for Knowledge-Infused Decoding

Pre-trained LMs are trained on large amounts of data from diverse sources and do not have access to external knowledge during inference. This lack of external knowledge results in the generation of factually incorrect or irrelevant text when prompted with specific contexts that require domain-specific knowledge. For example, when asked about the capital city of France, a pre-trained LM may generate "Paris is located in Germany" instead of "Paris is the capital city of France." Existing solutions to incorporate external knowledge into pre-trained LMs involve modifying pre-training objectives or fine-tuning techniques. However, these methods require additional training or architectural adjustments and may not always improve performance significantly.

The KID Algorithm

The KID algorithm aims to overcome the limitations mentioned above by dynamically incorporating external knowledge into pre-trained LMs during the decoding process. This is achieved through a memory component that interacts with an externally created knowledge trie, which is continuously updated as a knowledge-aware constraint using reinforcement learning. The KID algorithm consists of three main components: the pre-trained LM, the knowledge trie, and the memory module. During inference, the input prompt is first passed through the pre-trained LM to generate a probability distribution over all possible tokens in the vocabulary. The top-k tokens are then selected based on this distribution and used to update the memory module. Next, the memory module retrieves relevant information from the knowledge trie based on these top-k tokens and updates its internal state accordingly. This updated state is then used to constrain subsequent token generation by modifying their probabilities in favor of more relevant and factual tokens.

Evaluation Results

To evaluate the effectiveness of KID, it was tested on six diverse knowledge-intensive NLG tasks including question-answering, summarization, and dialogue generation. In each task, KID outperformed seven related techniques for incorporating external knowledge into LMs. Particularly strong performance was observed in few-shot scenarios where only a small amount of training data was available. This demonstrates that KID can effectively incorporate external knowledge even when there is limited training data available for fine-tuning. Human evaluation was also conducted to compare KID's performance against multiple baseline models. The results showed that KID significantly improves language generation by producing more relevant and factual text compared to other methods.

Availability

The code for implementing KID is openly available on GitHub at https://github.com/microsoft/KID. This allows researchers and developers to easily use and build upon this algorithm for their own projects.

Conclusion

In conclusion, "Knowledge Infused Decoding" introduces an innovative solution for incorporating external knowledge into pre-trained LMs during the decoding process. The KID algorithm effectively addresses the limitations of pre-trained LMs in recalling factually correct knowledge within specific contexts, resulting in improved performance on various knowledge-intensive NLG tasks. With its availability on GitHub, KID has the potential to be widely adopted and further developed by researchers and developers in the field of natural language processing.