Results of the summarizing process for the arXiv paper: 2206.00006v2

Bipartite graphs are widely used in various applications such as recommender systems, information retrieval and drug discovery. However, a fundamental challenge for bipartite graphs is how to learn informative node embeddings. Recent self-supervised learning methods have shown success in this area but their objectives discriminate instance-wise positive and negative node pairs that could contain cluster-level errors. To address this issue, a novel co-cluster infomax (COIN) framework is introduced in this paper. COIN captures the cluster-level information by maximizing the mutual information of co-clusters. Unlike previous infomax methods that estimate mutual information using neural networks, COIN can easily calculate mutual information. Additionally, COIN is an end-to-end coclustering method that can be trained jointly with other objective functions and optimized via backpropagation. The authors also provide theoretical analysis for COIN and prove that it effectively increases the mutual information of node embeddings while being upperbounded by the prior distributions of nodes. The proposed COIN framework is extensively evaluated on various benchmark datasets and tasks to demonstrate its effectiveness. In sensitivity experiments conducted on WebKB, Wisconsin and Wikipedia datasets it was found that COIN performs best when the number of clusters is around the ground truth number of classes. The performance of COIN only has small variances for different coefficients λ for mutual information on Wikipedia datasets. Overall, COIN provides a powerful solution to learning informative node embeddings in bipartite graphs by capturing cluster level information through maximizing mutual information of co-clusters. Its effectiveness has been demonstrated through extensive evaluations on various benchmark datasets and tasks.

• - Bipartite graphs are used in recommender systems, information retrieval, and drug discovery.
• - Learning informative node embeddings is a fundamental challenge for bipartite graphs.
• - Recent self-supervised learning methods discriminate instance-wise positive and negative node pairs that could contain cluster-level errors.
• - A novel co-cluster infomax (COIN) framework is introduced to address this issue by maximizing the mutual information of co-clusters.
• - COIN can easily calculate mutual information and is an end-to-end coclustering method that can be trained jointly with other objective functions and optimized via backpropagation.
• - Theoretical analysis proves that COIN effectively increases the mutual information of node embeddings while being upperbounded by the prior distributions of nodes.
• - COIN is extensively evaluated on various benchmark datasets and tasks to demonstrate its effectiveness.
• - Sensitivity experiments show that COIN performs best when the number of clusters is around the ground truth number of classes and has small variances for different coefficients λ for mutual information on Wikipedia datasets.
• - Overall, COIN provides a powerful solution to learning informative node embeddings in bipartite graphs by capturing cluster level information through maximizing mutual information of co-clusters.

Bipartite graphs are used in different things like recommending things to people, finding information, and discovering drugs. Learning how to group things together in these graphs is important. A new way called COIN was made to help with this. COIN makes sure that groups of things have a lot in common with each other. It works really well and has been tested on many different tasks. Overall, COIN helps us learn more about bipartite graphs by making sure groups of things are similar to each other. Definitions- Bipartite graph: a type of graph where the nodes can be divided into two sets and there are only edges between nodes from different sets - Embeddings: a way to represent something (like a node) as a vector or set of numbers - Mutual information: a measure of how much two random variables (like co-clusters) share information with each other - Co-clusters: groups of nodes that have something in common with each other - Backpropagation: a method for training neural networks by adjusting the weights based on the error between predicted and actual outputs

Learning Informative Node Embeddings in Bipartite Graphs with Co-Cluster Infomax

Bipartite graphs are widely used in various applications such as recommender systems, information retrieval and drug discovery. However, a fundamental challenge for bipartite graphs is how to learn informative node embeddings. Recent self-supervised learning methods have shown success in this area but their objectives discriminate instance-wise positive and negative node pairs that could contain cluster-level errors. To address this issue, a novel co-cluster infomax (COIN) framework has been introduced by researchers from the University of California at Berkeley and Stanford University.

What is COIN?

COIN captures the cluster-level information by maximizing the mutual information of co-clusters. Unlike previous infomax methods that estimate mutual information using neural networks, COIN can easily calculate mutual information. Additionally, COIN is an end-to-end coclustering method that can be trained jointly with other objective functions and optimized via backpropagation. The authors also provide theoretical analysis for COIN and prove that it effectively increases the mutual information of node embeddings while being upperbounded by the prior distributions of nodes.

Evaluation Results

The proposed COIN framework was extensively evaluated on various benchmark datasets and tasks to demonstrate its effectiveness. In sensitivity experiments conducted on WebKB, Wisconsin and Wikipedia datasets it was found that COIN performs best when the number of clusters is around the ground truth number of classes. The performance of COIN only had small variances for different coefficients λ for mutual information on Wikipedia datasets.

Conclusion

Overall, COIN provides a powerful solution to learning informative node embeddings in bipartite graphs by capturing cluster level information through maximizing mutual information of co-clusters. Its effectiveness has been demonstrated through extensive evaluations on various benchmark datasets and tasks