Deep Hypergraph Structure Learning

AI-generated keywords: DeepHGSL Hypergraph Representation Learning Information Bottleneck Robustness

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • High-order correlation is superior in data representation learning
  • Hypergraphs are widely used in recent decades for this purpose
  • Performance of hypergraph-based methods heavily relies on the quality of the hypergraph structure
  • Generating a suitable hypergraph structure among data is challenging due to missing and noisy data that may lead to "bad connections"
  • Zizhao Zhang et al. propose a general paradigm for deep hypergraph structure learning called DeepHGSL that optimizes the hypergraph structure for hypergraph-based representation learning
  • The HyperGraph Information Bottleneck (HIB) principle guides the optimization of the hypergraph structure by constructing a loss function that minimizes noisy information in it
  • DeepHGSL enhances correct connections and weakens wrong connections during training phase, thus optimizing and improving upon an otherwise heavily noisy structure
  • The authors evaluate their model on four benchmark datasets for representation learning and demonstrate its effectiveness and robustness on both graph- and hypergraph-structured data compared with other state-of-the-art methods.
  • DeepHGSL provides a promising solution to generate suitable high-quality structures for effective representation learning using deep neural networks while addressing challenges posed by missing or noisy data through HIB-guided optimization of these structures.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Zizhao Zhang, Yifan Feng, Shihui Ying, Yue Gao

Abstract: Learning on high-order correlation has shown superiority in data representation learning, where hypergraph has been widely used in recent decades. The performance of hypergraph-based representation learning methods, such as hypergraph neural networks, highly depends on the quality of the hypergraph structure. How to generate the hypergraph structure among data is still a challenging task. Missing and noisy data may lead to "bad connections" in the hypergraph structure and destroy the hypergraph-based representation learning process. Therefore, revealing the high-order structure, i.e., the hypergraph behind the observed data, becomes an urgent but important task. To address this issue, we design a general paradigm of deep hypergraph structure learning, namely DeepHGSL, to optimize the hypergraph structure for hypergraph-based representation learning. Concretely, inspired by the information bottleneck principle for the robustness issue, we first extend it to the hypergraph case, named by the hypergraph information bottleneck (HIB) principle. Then, we apply this principle to guide the hypergraph structure learning, where the HIB is introduced to construct the loss function to minimize the noisy information in the hypergraph structure. The hypergraph structure can be optimized and this process can be regarded as enhancing the correct connections and weakening the wrong connections in the training phase. Therefore, the proposed method benefits to extract more robust representations even on a heavily noisy structure. Finally, we evaluate the model on four benchmark datasets for representation learning. The experimental results on both graph- and hypergraph-structured data demonstrate the effectiveness and robustness of our method compared with other state-of-the-art methods.

Submitted to arXiv on 26 Aug. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2208.12547v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

The use of high-order correlation has proven to be superior in data representation learning, with hypergraphs being widely used in recent decades. However, the performance of hypergraph-based representation learning methods, such as hypergraph neural networks, heavily relies on the quality of the hypergraph structure. Generating a suitable hypergraph structure among data is still a challenging task due to missing and noisy data that may lead to "bad connections" in the hypergraph structure and disrupt the learning process. Therefore, it becomes crucial to reveal the high-order structure or the hypergraph behind observed data. To address this issue, Zizhao Zhang et al. propose a general paradigm for deep hypergraph structure learning called DeepHGSL that optimizes the hypergraph structure for hypergraph-based representation learning. They extend the information bottleneck principle for robustness issues to the hypergraph case and name it as the HyperGraph Information Bottleneck (HIB) principle. This principle guides the optimization of the hypergraph structure by constructing a loss function that minimizes noisy information in it. The proposed method enhances correct connections and weakens wrong connections during training phase, thus optimizing and improving upon an otherwise heavily noisy structure. The authors evaluate their model on four benchmark datasets for representation learning and demonstrate its effectiveness and robustness on both graph- and hypergraph-structured data compared with other state-of-the-art methods. Furthermore, DeepHGSL provides a promising solution to generate suitable high-quality structures for effective representation learning using deep neural networks while addressing challenges posed by missing or noisy data through HIB-guided optimization of these structures. Overall, DeepHGSL offers an efficient approach to optimize a suitable high quality graph structure for better performance in representation learning tasks involving large amounts of missing or noisy data.
Created on 09 Apr. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.