Memory Fusion Network for Multi-view Sequential Learning

AI-generated keywords: Machine Learning Multi-View Sequential Learning Memory Fusion Network LSTM DMAN

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Multi-view sequential learning is a crucial area of study focusing on understanding and analyzing interactions between different views.
  • Researchers led by Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency developed the Memory Fusion Network (MFN) to address this complex problem.
  • MFN captures view-specific interactions and cross-view interactions using the System of LSTMs and Delta-memory Attention Network (DMAN) with Multi-view Gated Memory.
  • Through experimentation on benchmark datasets, MFN outperformed existing approaches for multi-view sequential learning.
  • The research was presented at AAAI 2018 as an oral presentation and demonstrates the potential of MFN in advancing the field of multi-view sequential learning.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, Louis-Philippe Morency

AAAI 2018 Oral Presentation

Abstract: Multi-view sequential learning is a fundamental problem in machine learning dealing with multi-view sequences. In a multi-view sequence, there exists two forms of interactions between different views: view-specific interactions and cross-view interactions. In this paper, we present a new neural architecture for multi-view sequential learning called the Memory Fusion Network (MFN) that explicitly accounts for both interactions in a neural architecture and continuously models them through time. The first component of the MFN is called the System of LSTMs, where view-specific interactions are learned in isolation through assigning an LSTM function to each view. The cross-view interactions are then identified using a special attention mechanism called the Delta-memory Attention Network (DMAN) and summarized through time with a Multi-view Gated Memory. Through extensive experimentation, MFN is compared to various proposed approaches for multi-view sequential learning on multiple publicly available benchmark datasets. MFN outperforms all the existing multi-view approaches. Furthermore, MFN outperforms all current state-of-the-art models, setting new state-of-the-art results for these multi-view datasets.

Submitted to arXiv on 03 Feb. 2018

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 1802.00927v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

In the field of machine learning, multi-view sequential learning is a crucial area of study that focuses on understanding and analyzing multi-view sequences. These sequences involve interactions between different views, including view-specific interactions and cross-view interactions. To address this complex problem, a group of researchers led by Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency have developed a novel neural architecture known as the Memory Fusion Network (MFN). The MFN is designed to explicitly capture both types of interactions within a neural framework and dynamically model them over time. The architecture consists of two key components: the System of LSTMs and the Delta-memory Attention Network (DMAN) with Multi-view Gated Memory. In the System of LSTMs, individual LSTM functions are assigned to each view to learn view-specific interactions independently. The DMAN mechanism then identifies cross-view interactions using a specialized attention mechanism. Through extensive experimentation on various publicly available benchmark datasets, the researchers compared MFN against existing approaches for multi-view sequential learning. Remarkably, MFN outperformed all other methods in terms of performance metrics. Not only did it surpass existing multi-view approaches but it also set new state-of-the-art results for these challenging multi-view datasets. This groundbreaking research was presented at AAAI 2018 as an oral presentation and showcases the potential of the Memory Fusion Network in advancing the field of multi-view sequential learning. With its innovative design and superior performance, MFN represents a significant contribution to machine learning research and opens up new possibilities for analyzing complex multi-view data structures effectively.
Created on 22 Feb. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.