In the era of e-commerce and web applications, Recommender Systems (RecSys) have become indispensable tools in providing personalized suggestions tailored to individual user preferences. While Deep Neural Networks (DNNs) have significantly advanced recommender systems by modeling user-item interactions and incorporating textual side information, they still face challenges such as understanding users' interests, capturing textual data effectively, generalizing to diverse recommendation scenarios, and reasoning on their predictions. The emergence of Large Language Models (LLMs) like ChatGPT and GPT4 has revolutionized Natural Language Processing (NLP) and Artificial Intelligence (AI) fields with their exceptional language understanding, generation capabilities, generalization skills, and reasoning abilities. Recent studies have explored leveraging LLMs to enhance recommender systems due to their promising potential. To address the evolving landscape of LLM-empowered recommender systems, a comprehensive review is essential. This paper delves into various aspects including Pre-training, Fine-tuning, and Prompting techniques. Initially introducing methods that utilize LLMs as feature encoders for learning user and item representations, the review then explores recent advancements in leveraging LLMs through pre-training, fine-tuning processes, and prompting strategies to enhance recommender systems. The authors provide insights into future directions in this emerging field while highlighting the importance of summarizing existing LLM-empowered recommender systems for researchers in relevant domains. By offering an in-depth understanding of how LLMs can be harnessed to improve recommendation algorithms,this review aims to contribute to the ongoing evolution of recommender systems powered by cutting-edge language models.
SummaryRecommender Systems (RecSys) help suggest things you might like when shopping online or using apps based on what you prefer. Deep Neural Networks (DNNs) make these systems better by understanding how people interact with items and using extra written information, but they still have some challenges to overcome. Large Language Models (LLMs) such as ChatGPT and GPT4 are super smart at understanding language and making decisions, which has been a big deal in the world of talking computers. People are now looking into using LLMs to make recommender systems even better. To do this, experts need to study how LLMs can be used in different ways to improve these suggestion systems.
Definitions
- Recommender Systems (RecSys): Tools that help suggest things you might like based on your preferences.
- Deep Neural Networks (DNNs): Advanced computer systems that learn how people interact with things and use extra written information.
- Large Language Models (LLMs): Super smart computer programs that understand language really well and can make decisions based on it.
- Natural Language Processing (NLP): Technology that helps computers understand human language.
- Pre-training: Teaching a computer program basic knowledge before fine-tuning it for specific tasks.
- Fine-tuning: Adjusting a computer program to perform better at a specific task after pre-training it.
- Prompting: Giving specific instructions or cues to guide a computer program's decision-making process.
In the world of e-commerce and web applications, personalized recommendations have become a crucial aspect of user experience. Recommender systems (RecSys) play a vital role in providing these tailored suggestions by leveraging user preferences and behavior data. However, traditional recommender systems face challenges such as understanding users' interests, capturing textual data effectively, generalizing to diverse recommendation scenarios, and reasoning on their predictions.
To overcome these challenges, researchers have turned to Deep Neural Networks (DNNs), which have significantly advanced recommender systems by modeling user-item interactions and incorporating textual side information. Despite their success, DNNs still struggle with certain aspects of recommendation tasks. This is where Large Language Models (LLMs) come into play.
The emergence of LLMs like ChatGPT and GPT4 has revolutionized Natural Language Processing (NLP) and Artificial Intelligence (AI) fields with their exceptional language understanding, generation capabilities, generalization skills, and reasoning abilities. Recent studies have explored leveraging LLMs to enhance recommender systems due to their promising potential.
In light of this evolving landscape of LLM-empowered recommender systems, a comprehensive review is essential. This paper delves into various aspects including Pre-training, Fine-tuning, and Prompting techniques for utilizing LLMs in enhancing recommendation algorithms.
Firstly,the authors introduce methods that utilize LLMs as feature encoders for learning user and item representations. These approaches aim to improve the performance of traditional collaborative filtering methods by incorporating textual data through pre-trained language models.
Next,the review explores recent advancements in leveraging LLMs through pre-training processes specifically designed for recommendation tasks. These techniques involve training an LLM on large-scale datasets containing both text-based features and interaction data between users and items.This allows the model to learn more about users' preferences while also improving its ability to generate relevant recommendations based on those preferences.
Furthermore,fine-tuning strategies are discussed where an LLM is trained on a specific recommendation task, such as movie or music recommendations. This fine-tuning process allows the model to adapt to the specific characteristics of the recommendation domain, resulting in more accurate and personalized suggestions.
Lastly,the review delves into prompting techniques where LLMs are prompted with user-item pairs and asked to generate relevant recommendations. This approach has shown promising results in improving the reasoning abilities of recommender systems powered by LLMs.
The authors also provide insights into future directions in this emerging field, highlighting the importance of summarizing existing LLM-empowered recommender systems for researchers in relevant domains. By offering an in-depth understanding of how LLMs can be harnessed to improve recommendation algorithms, this review aims to contribute to the ongoing evolution of recommender systems powered by cutting-edge language models.
In conclusion, leveraging Large Language Models has shown great potential in enhancing traditional recommender systems. With their exceptional language understanding and generation capabilities, generalization skills, and reasoning abilities,Large Language Models have opened up new possibilities for personalized recommendations. As research continues in this area,it is essential to keep track of advancements and summarize them for researchers working on similar problems.This review serves as a valuable resource for those interested in exploring the intersection between large language models and recommender systems,and paves way for further developments in this exciting field.
With the prosperity of e-commerce and web applications, Recommender Systems (RecSys) have become an important component of our daily life, providing personalized suggestions that cater to user preferences. While Deep Neural Networks (DNNs) have made significant advancements in enhancing recommender systems by modeling user-item interactions and incorporating textual side information, DNN-based methods still face limitations, such as difficulties in understanding users' interests and capturing textual side information, inabilities in generalizing to various recommendation scenarios and reasoning on their predictions, etc. Meanwhile, the emergence of Large Language Models (LLMs), such as ChatGPT and GPT4, has revolutionized the fields of Natural Language Processing (NLP) and Artificial Intelligence (AI), due to their remarkable abilities in fundamental responsibilities of language understanding and generation, as well as impressive generalization and reasoning capabilities. As a result, recent studies have attempted to harness the power of LLMs to enhance recommender systems. Given the rapid evolution of this research direction in recommender systems, there is a pressing need for a systematic overview that summarizes existing LLM-empowered recommender systems, to provide researchers in relevant fields with an in-depth understanding. Therefore, in this paper, we conduct a comprehensive review of LLM-empowered recommender systems from various aspects including Pre-training, Fine-tuning, and Prompting. More specifically, we first introduce representative methods to harness the power of LLMs (as a feature encoder) for learning representations of users and items. Then, we review recent techniques of LLMs for enhancing recommender systems from three paradigms, namely pre-training, fine-tuning, and prompting. Finally, we comprehensively discuss future directions in this emerging field.