The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches

Authors: Md Zahangir Alom, Tarek M. Taha, Christopher Yakopcic, Stefan Westberg, Mahmudul Hasan, Brian C Van Esesn, Abdul A S. Awwal, Vijayan K. Asari

39 pages, 46 figures, 3 tables. arXiv admin note: text overlap with arXiv:1408.3264, arXiv:1411.4046
License: CC BY 4.0

Results of the summarizing process for the arXiv paper: 1803.01164v1

  • Comprehensive Summary
  • Key points
  • Layman's Summary
  • Blog article
Deep learning has emerged as a highly successful field in machine learning, with applications spanning various domains. This comprehensive survey explores the development and advancements of deep learning approaches, including Deep Neural Networks (DNN), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN) such as Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoders (AE), Deep Belief Networks (DBN), Generative Adversarial Networks (GAN), and Deep Reinforcement Learning (DRL). The experimental results demonstrate that deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, Natural Language Processing (NLP), Cybersecurity, among others. This survey also covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches. Additionally, it explores the application of deep learning approaches across different domains and includes an evaluation of their performance. The report further encompasses recently developed frameworks, Software Development Kits (SDKs), and benchmark datasets used for implementing and evaluating deep learning models. While previous surveys have focused on Deep Learning in Neural Networks [1, 38] and Reinforcement Learning [234], this survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and the recently developed method of generative models [1]. Furthermore, the authors provide additional context by referencing a related paper on arXiv that overlaps with their work [1408.3264]. The survey is authored by Md Zahangir Alom et al., who are experts in the field of deep learning. Overall, this comprehensive survey provides valuable insights into the history and advancements of deep learning approaches across various application domains. It serves as a valuable resource for researchers seeking to gain an understanding of the latest developments in this rapidly growing field.
AI-generated keywords: Deep Learning Neural Networks Reinforcement Learning Generative Models Machine Learning

AI-generated Key Points

  • Deep learning is a highly successful field in machine learning with applications in various domains.
  • The survey explores the development and advancements of deep learning approaches, including DNN, CNN, RNN (LSTM and GRU), AE, DBN, GAN, and DRL.
  • Deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, NLP, and Cybersecurity.
  • The survey covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches.
  • It evaluates the performance of deep learning approaches across different domains.
  • The report includes information on frameworks, SDKs, and benchmark datasets used for implementing and evaluating deep learning models.
  • The survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and generative models.
  • It provides additional context by referencing related papers on arXiv that overlap with their work.
  • The survey is authored by experts in the field of deep learning.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Abstract: Deep learning has demonstrated tremendous success in variety of application domains in the past few years. This new field of machine learning has been growing rapidly and applied in most of the application domains with some new modalities of applications, which helps to open new opportunity. There are different methods have been proposed on different category of learning approaches, which includes supervised, semi-supervised and un-supervised learning. The experimental results show state-of-the-art performance of deep learning over traditional machine learning approaches in the field of Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical imaging, Medical information processing, Robotics and control, Bio-informatics, Natural Language Processing (NLP), Cyber security, and many more. This report presents a brief survey on development of DL approaches, including Deep Neural Network (DNN), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) including Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL). In addition, we have included recent development of proposed advanced variant DL techniques based on the mentioned DL approaches. Furthermore, DL approaches have explored and evaluated in different application domains are also included in this survey. We have also comprised recently developed frameworks, SDKs, and benchmark datasets that are used for implementing and evaluating deep learning approaches. There are some surveys have published on Deep Learning in Neural Networks [1, 38] and a survey on RL [234]. However, those papers have not discussed the individual advanced techniques for training large scale deep learning models and the recently developed method of generative models [1].

Submitted to arXiv on 03 Mar. 2018

Tools for this paper

Explain it differently 3 free rewrites left today
Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Markdown (Notion, Obsidian) · Premium
Citation alerts Premium
Journal club Slides to present it Premium
For journalists Press kit and hype check Premium

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.