Deep Hypergraph Structure Learning
AI-generated Key Points
⚠The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.
- High-order correlation is superior in data representation learning
- Hypergraphs are widely used in recent decades for this purpose
- Performance of hypergraph-based methods heavily relies on the quality of the hypergraph structure
- Generating a suitable hypergraph structure among data is challenging due to missing and noisy data that may lead to "bad connections"
- Zizhao Zhang et al. propose a general paradigm for deep hypergraph structure learning called DeepHGSL that optimizes the hypergraph structure for hypergraph-based representation learning
- The HyperGraph Information Bottleneck (HIB) principle guides the optimization of the hypergraph structure by constructing a loss function that minimizes noisy information in it
- DeepHGSL enhances correct connections and weakens wrong connections during training phase, thus optimizing and improving upon an otherwise heavily noisy structure
- The authors evaluate their model on four benchmark datasets for representation learning and demonstrate its effectiveness and robustness on both graph- and hypergraph-structured data compared with other state-of-the-art methods.
- DeepHGSL provides a promising solution to generate suitable high-quality structures for effective representation learning using deep neural networks while addressing challenges posed by missing or noisy data through HIB-guided optimization of these structures.
Authors: Zizhao Zhang, Yifan Feng, Shihui Ying, Yue Gao
Abstract: Learning on high-order correlation has shown superiority in data representation learning, where hypergraph has been widely used in recent decades. The performance of hypergraph-based representation learning methods, such as hypergraph neural networks, highly depends on the quality of the hypergraph structure. How to generate the hypergraph structure among data is still a challenging task. Missing and noisy data may lead to "bad connections" in the hypergraph structure and destroy the hypergraph-based representation learning process. Therefore, revealing the high-order structure, i.e., the hypergraph behind the observed data, becomes an urgent but important task. To address this issue, we design a general paradigm of deep hypergraph structure learning, namely DeepHGSL, to optimize the hypergraph structure for hypergraph-based representation learning. Concretely, inspired by the information bottleneck principle for the robustness issue, we first extend it to the hypergraph case, named by the hypergraph information bottleneck (HIB) principle. Then, we apply this principle to guide the hypergraph structure learning, where the HIB is introduced to construct the loss function to minimize the noisy information in the hypergraph structure. The hypergraph structure can be optimized and this process can be regarded as enhancing the correct connections and weakening the wrong connections in the training phase. Therefore, the proposed method benefits to extract more robust representations even on a heavily noisy structure. Finally, we evaluate the model on four benchmark datasets for representation learning. The experimental results on both graph- and hypergraph-structured data demonstrate the effectiveness and robustness of our method compared with other state-of-the-art methods.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
⚠The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.
Assess the quality of the AI-generated content by voting
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
Similar papers summarized with our AI tools
Navigate through even more similar papers through atree representation
Look for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.