Is Speech Emotion Recognition Language-Independent? Analysis of English and Bangla Languages using Language-Independent Vocal Features
Authors: Fardin Saad, Hasan Mahmud, Md. Alamin Shaheen, Md. Kamrul Hasan, Paresha Farastu
AI-generated Key Points
- Researchers explored Speech Emotion Recognition (SER) to determine language-independence
- Emotions studied: happiness, anger, neutral, sadness, disgust, fear
- Three Emotional Speech Sets used: two by Bengali speakers in Bangla and English, one by English speakers from Canada
- Language-independent prosodic features analyzed with SVM model for classification
- Three experiments conducted to test hypothesis: evaluating individual speech sets' performance, combining for unified context classification rate measurement, training/testing with different sets for recognition rate assessment
- SER is predominantly language-independent but discrepancies noted in recognizing disgust and fear across languages
- Non-native speakers can convey emotions through speech similar to native expression
- Vocal feature extraction done using Praat software's signal processing techniques
- Prosodic features like pitch median/mean/standard deviation/intensity captured emotional nuances aiding analysis
- Study highlights interplay between language/emotion recognition in speech processing systems and cross-linguistic applicability in SER research
Abstract: A language agnostic approach to recognizing emotions from speech remains an incomplete and challenging task. In this paper, we used Bangla and English languages to assess whether distinguishing emotions from speech is independent of language. The following emotions were categorized for this study: happiness, anger, neutral, sadness, disgust, and fear. We employed three Emotional Speech Sets, of which the first two were developed by native Bengali speakers in Bangla and English languages separately. The third was the Toronto Emotional Speech Set (TESS), which was developed by native English speakers from Canada. We carefully selected language-independent prosodic features, adopted a Support Vector Machine (SVM) model, and conducted three experiments to carry out our proposition. In the first experiment, we measured the performance of the three speech sets individually. This was followed by the second experiment, where we recorded the classification rate by combining the speech sets. Finally, in the third experiment we measured the recognition rate by training and testing the model with different speech sets. Although this study reveals that Speech Emotion Recognition (SER) is mostly language-independent, there is some disparity while recognizing emotional states like disgust and fear in these two languages. Moreover, our investigations inferred that non-native speakers convey emotions through speech, much like expressing themselves in their native tongue.
Tools for this paper
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
We compare the title and abstract with papers indexed in our database. For arXiv papers, we search within the same category; for DOI and other sources, we search across sources and subjects. You can rerun the search as our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.