Pfeed: Generating near real-time personalized feeds using precomputed embedding similarities

AI-generated keywords: personalized recommender systems embeddings approximate nearest neighbor search dynamic feed generation e-commerce platforms

AI-generated Key Points

  • Personalized recommender systems commonly use embeddings to encode customer actions and items
  • Retrieval is done in the embedding space through approximate nearest neighbor search
  • Challenges include restrictions on diversity within user embeddings and costly real-time infrastructure maintenance
  • A method was proposed to address these challenges by dynamically updating customer profiles and generating personalized feeds every two minutes using precomputed embeddings
  • The method was implemented at Bol, an e-commerce platform, resulting in enhanced customer engagement and a 4.9% uplift in conversions
  • Historical customer interactions data is used with an encoder model to generate query embeddings for items, which are matched against item embeddings using ANNS for recommendations
  • The system incorporates ranking algorithms, diversity considerations, business rules integration, and merging recommendations based on recent interactions
  • By updating near real-time every two minutes, the method successfully delivers tailored feeds while addressing concerns about diverse user interests and minimizing infrastructure costs
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Binyam Gebre, Karoliina Ranta, Stef van den Elzen, Ernst Kuiper, Thijs Baars, Tom Heskes

9 pages, 8 figures
License: CC BY 4.0

Abstract: In personalized recommender systems, embeddings are often used to encode customer actions and items, and retrieval is then performed in the embedding space using approximate nearest neighbor search. However, this approach can lead to two challenges: 1) user embeddings can restrict the diversity of interests captured and 2) the need to keep them up-to-date requires an expensive, real-time infrastructure. In this paper, we propose a method that overcomes these challenges in a practical, industrial setting. The method dynamically updates customer profiles and composes a feed every two minutes, employing precomputed embeddings and their respective similarities. We tested and deployed this method to personalise promotional items at Bol, one of the largest e-commerce platforms of the Netherlands and Belgium. The method enhanced customer engagement and experience, leading to a significant 4.9% uplift in conversions.

Submitted to arXiv on 25 Feb. 2024

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2402.16073v2

In personalized recommender systems, embeddings are commonly utilized to encode customer actions and items. Retrieval is then conducted in the embedding space through approximate nearest neighbor search. However, this approach presents challenges such as potential restrictions on the diversity of captured interests within user embeddings and the necessity for costly real-time infrastructure to maintain their up-to-date status. To address these issues in a practical industrial setting, a method was proposed that dynamically updates customer profiles and generates personalized feeds every two minutes by leveraging precomputed embeddings and their corresponding similarities. This method was implemented and tested at Bol, a prominent e-commerce platform serving the Netherlands and Belgium, to personalize promotional items. The results were promising with enhanced customer engagement and experience leading to a notable 4.9% uplift in conversions. The process involved utilizing historical customer interactions data alongside an encoder model to generate query embeddings for items in the catalogue. These query embeddings were then matched against item embeddings stored in an index vector database using approximate nearest neighbor search (ANNS) to retrieve relevant recommendations. Furthermore, the system incorporated elements of ranking algorithms, diversity considerations, business rules integration, and merging recommendations based on recent customer interactions. By combining these components effectively within a near real-time framework that updates every two minutes, the method successfully delivered tailored feeds to users while addressing concerns related to maintaining diverse user interests and minimizing infrastructure costs associated with real-time updates. Authors Binyam Gebre, Karoliina Ranta, Stef van den Elzen, Ernst Kuiper, Thijs Baars, and Tom Heskes present this innovative approach in their paper titled "Pfeed: Generating near real-time personalized feeds using precomputed embedding similarities," offering valuable insights for enhancing personalization strategies in e-commerce platforms through efficient use of embedding techniques and dynamic feed generation processes.
Created on 03 Jun. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.