Running summarizing tools on a new article

Check the paper below, then start its synthesis.


A Scalable Attention Mechanism Based Neural Network for Text Classification

Jianyun Zheng, Jianmin Pang, Xiaochuan Zhang, Di Sun, Xin Zhou, Kai Zhang, Dong Wang, MingLiang Li, Jun Wang

Journal of Physics Conference Series
License: CC BY

Abstract: Abstract In general, deep learning based text classification methods are considered to be effective but tend to be relatively slow especially for model training. In this work, we present a powerful, so-called “scalable attention mechanism”, which performs better than conventional attention mechanism in terms of both effectiveness and the speed of model training. Based on the scalable attention mechanism, we propose a neural network for text classification. The experimental results on eight representative datasets show that our method can obtain similar accuracy to state-of-the-art methods with training in less than 4 minutes on an NVIDIA GTX 1080Ti GPU. To the best of our knowledge, our method is at least twice faster than all the published deep learning classifiers.

Published on 01 Apr. 2020