A Unified Framework for Multi-Domain CTR Prediction via Large Language Models

AI-generated keywords: CTR prediction

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Click-through rate (CTR) prediction in online recommendation platforms is important
  • Challenges associated with multi-domain CTR prediction
  • Traditional models using discrete identifiers limit generalization and result in performance drops in certain domains
  • Proposed solution called Uni-CTR utilizes a Large Language Model (LLM) to capture commonalities between domains and domain-specific networks for unique characteristics
  • Masked loss strategy decouples domain-specific networks from the backbone LLM, allowing flexibility and scalability
  • Experimental results show Uni-CTR outperforms state-of-the-art MDCTR models significantly and demonstrates effectiveness in zero-shot prediction
  • Uni-CTR applied in industrial scenarios confirms its efficiency
  • Unified framework for multi-domain CTR prediction leveraging semantic representations and domain-specific networks
  • Uni-CTR model showcases superior performance compared to existing models and proves effective in real-world applications.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Zichuan Fu, Xiangyang Li, Chuhan Wu, Yichao Wang, Kuicai Dong, Xiangyu Zhao, Mengchen Zhao, Huifeng Guo, Ruiming Tang

Still being revised

Abstract: Click-Through Rate (CTR) prediction is a crucial task in online recommendation platforms as it involves estimating the probability of user engagement with advertisements or items by clicking on them. Given the availability of various services like online shopping, ride-sharing, food delivery, and professional services on commercial platforms, recommendation systems in these platforms are required to make CTR predictions across multiple domains rather than just a single domain. However, multi-domain click-through rate (MDCTR) prediction remains a challenging task in online recommendation due to the complex mutual influence between domains. Traditional MDCTR models typically encode domains as discrete identifiers, ignoring rich semantic information underlying. Consequently, they can hardly generalize to new domains. Besides, existing models can be easily dominated by some specific domains, which results in significant performance drops in the other domains (\ie the ``seesaw phenomenon``). In this paper, we propose a novel solution Uni-CTR to address the above challenges. Uni-CTR leverages a backbone Large Language Model (LLM) to learn layer-wise semantic representations that capture commonalities between domains. Uni-CTR also uses several domain-specific networks to capture the characteristics of each domain. Note that we design a masked loss strategy so that these domain-specific networks are decoupled from backbone LLM. This allows domain-specific networks to remain unchanged when incorporating new or removing domains, thereby enhancing the flexibility and scalability of the system significantly. Experimental results on three public datasets show that Uni-CTR outperforms the state-of-the-art (SOTA) MDCTR models significantly. Furthermore, Uni-CTR demonstrates remarkable effectiveness in zero-shot prediction. We have applied Uni-CTR in industrial scenarios, confirming its efficiency.

Submitted to arXiv on 17 Dec. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2312.10743v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

, , , , The importance of click-through rate (CTR) prediction in online recommendation platforms is discussed in this paper, along with the challenges associated with multi-domain CTR prediction. Traditional models often use discrete identifiers to represent domains, limiting their ability to generalize and resulting in performance drops in certain domains. To overcome these limitations, the authors propose a novel solution called Uni-CTR. This model utilizes a backbone Large Language Model (LLM) to learn layer-wise semantic representations that capture commonalities between domains, while also incorporating domain-specific networks to capture unique characteristics of each domain. A masked loss strategy is designed to decouple the domain-specific networks from the backbone LLM, allowing for flexibility and scalability when incorporating new or removing existing domains. Experimental results on three public datasets show that Uni-CTR outperforms state-of-the-art MDCTR models significantly and demonstrates remarkable effectiveness in zero-shot prediction. The authors have also applied Uni-CTR in industrial scenarios and confirmed its efficiency. In summary, this paper presents a unified framework for multi-domain CTR prediction that addresses the limitations of traditional models by leveraging semantic representations and domain-specific networks. The proposed Uni-CTR model showcases superior performance compared to existing models and proves effective in real-world applications.
Created on 08 Feb. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.