Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering

Authors: Michaël Defferrard, Xavier Bresson, Pierre Vandergheynst

Advances in Neural Information Processing Systems 29 (2016)
NIPS 2016 final revision

Results of the summarizing process for the arXiv paper: 1606.09375v3

  • Comprehensive Summary
  • Key points
  • Layman's Summary
  • Blog article
In their work titled "Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering," authors Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst aim to extend the application of convolutional neural networks (CNNs) from low-dimensional regular grids to high-dimensional irregular domains represented by graphs. These irregular domains include social networks, brain connectomes, and word embeddings. To achieve this, the authors propose a formulation of CNNs based on spectral graph theory. This mathematical framework provides the necessary background and efficient numerical schemes for designing fast localized convolutional filters on graphs. Importantly, their technique maintains the same linear computational complexity and constant learning complexity as traditional CNNs while being applicable to any graph structure. The authors validate their approach through experiments conducted on MNIST and 20NEWS datasets. The results demonstrate that their novel deep learning system can effectively learn local, stationary, and compositional features on graphs. Overall, this work presents a significant advancement in generalizing CNNs to high-dimensional irregular domains represented by graphs. By leveraging spectral graph theory which enables efficient computation of localized convolutional filters while maintaining the universality of application across various graph structures; this technique maintains the same linear computational complexity and constant learning complexity as traditional CNNs. The experiments conducted on MNIST and 20NEWS datasets demonstrate that this novel deep learning system can effectively learn local, stationary, and compositional features on graphs.
AI-generated keywords: Spectral Graph Theory Convolutional Neural Networks Irregular Domains Localized Filters Deep Learning

AI-generated Key Points

  • Authors aim to extend the application of CNNs from regular grids to irregular domains represented by graphs
  • Proposed formulation of CNNs based on spectral graph theory
  • Mathematical framework provides background and efficient numerical schemes for designing fast localized convolutional filters on graphs
  • Technique maintains linear computational complexity and constant learning complexity as traditional CNNs
  • Applicable to any graph structure
  • Validated through experiments on MNIST and 20NEWS datasets
  • Results demonstrate effective learning of local, stationary, and compositional features on graphs
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Abstract: In this work, we are interested in generalizing convolutional neural networks (CNNs) from low-dimensional regular grids, where image, video and speech are represented, to high-dimensional irregular domains, such as social networks, brain connectomes or words' embedding, represented by graphs. We present a formulation of CNNs in the context of spectral graph theory, which provides the necessary mathematical background and efficient numerical schemes to design fast localized convolutional filters on graphs. Importantly, the proposed technique offers the same linear computational complexity and constant learning complexity as classical CNNs, while being universal to any graph structure. Experiments on MNIST and 20NEWS demonstrate the ability of this novel deep learning system to learn local, stationary, and compositional features on graphs.

Submitted to arXiv on 30 Jun. 2016

Tools for this paper

Explain it differently 3 free rewrites left today
Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Markdown (Notion, Obsidian) · Premium
Citation alerts Premium
Journal club Slides to present it Premium
For journalists Press kit and hype check Premium

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

⚠The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

⚠The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.