The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches
Authors: Md Zahangir Alom, Tarek M. Taha, Christopher Yakopcic, Stefan Westberg, Mahmudul Hasan, Brian C Van Esesn, Abdul A S. Awwal, Vijayan K. Asari
AI-generated Key Points
- Deep learning is a highly successful field in machine learning with applications in various domains.
- The survey explores the development and advancements of deep learning approaches, including DNN, CNN, RNN (LSTM and GRU), AE, DBN, GAN, and DRL.
- Deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, NLP, and Cybersecurity.
- The survey covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches.
- It evaluates the performance of deep learning approaches across different domains.
- The report includes information on frameworks, SDKs, and benchmark datasets used for implementing and evaluating deep learning models.
- The survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and generative models.
- It provides additional context by referencing related papers on arXiv that overlap with their work.
- The survey is authored by experts in the field of deep learning.
Abstract: Deep learning has demonstrated tremendous success in variety of application domains in the past few years. This new field of machine learning has been growing rapidly and applied in most of the application domains with some new modalities of applications, which helps to open new opportunity. There are different methods have been proposed on different category of learning approaches, which includes supervised, semi-supervised and un-supervised learning. The experimental results show state-of-the-art performance of deep learning over traditional machine learning approaches in the field of Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical imaging, Medical information processing, Robotics and control, Bio-informatics, Natural Language Processing (NLP), Cyber security, and many more. This report presents a brief survey on development of DL approaches, including Deep Neural Network (DNN), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) including Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL). In addition, we have included recent development of proposed advanced variant DL techniques based on the mentioned DL approaches. Furthermore, DL approaches have explored and evaluated in different application domains are also included in this survey. We have also comprised recently developed frameworks, SDKs, and benchmark datasets that are used for implementing and evaluating deep learning approaches. There are some surveys have published on Deep Learning in Neural Networks [1, 38] and a survey on RL [234]. However, those papers have not discussed the individual advanced techniques for training large scale deep learning models and the recently developed method of generative models [1].
Tools for this paper
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
We compare the title and abstract with papers indexed in our database. For arXiv papers, we search within the same category; for DOI and other sources, we search across sources and subjects. You can rerun the search as our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.