# UniGen: Universal Domain Generalization for Sentiment Classification via Zero-shot Dataset Generation

**Authors:** Juhwan Choi, Yeonghwa Kim, Seunguk Yu, JungMin Yun, YoungBin Kim  
**arXiv:** [2405.01022](https://arxiv.org/abs/2405.01022)  
**Date:** 2024-05-02  
**Summary page:** https://www.summarizepaper.com/en/paper/2405.01022v3/

## Key points

- Authors address limitations of pre-trained language models (PLMs) in terms of parameter size and applicability for inference
- Proposed approach to universal domain generalization generates datasets regardless of target domain
- Allows generalization of tiny task models to any domain sharing the label space
- Achieves generalizability across various domains using significantly smaller parameter set compared to PLMs
- Includes ablation studies comparing different PLMs and evaluates effectiveness of supervised contrastive learning and denoising memory banks

## Summary

, , , , 

In their paper titled "UniGen: Universal Domain Generalization for Sentiment Classification via Zero-shot Dataset Generation," authors Juhwan Choi, Yeonghwa Kim, Seunguk Yu, JungMin Yun, and YoungBin Kim address the limitations of pre-trained language models (PLMs) in terms of parameter size and applicability for inference. Recent studies have proposed using PLMs as dataset generators and training task-specific models for efficient inference. However, these approaches are often limited to specific domains due to the generation of domain-specific datasets. To overcome this limitation, the authors introduce a novel approach to universal domain generalization that generates datasets regardless of the target domain. This new method allows for the generalization of tiny task models to any domain sharing the label space, enhancing the real-world applicability of dataset generation paradigms. Through experiments, the authors demonstrate that their proposed approach achieves generalizability across various domains while using a significantly smaller parameter set compared to PLMs. The study also includes ablation studies comparing different PLMs and evaluates the effectiveness of supervised contrastive learning and denoising memory banks in improving model performance. Overall, "UniGen" presents a promising solution for universal domain generalization in sentiment classification tasks by enabling efficient inference across diverse domains without being constrained by domain-specific datasets. The findings suggest that this approach has the potential to enhance model flexibility and applicability in real-world scenarios.