eXnet: An Efficient Approach for Emotion Recognition in the Wild
SENSORS
Authors: Riaz, Muhammad Naveed; Shen, Yao; Sohail, Muhammad; Guo, Minyi
Abstract
Facial expression recognition has been well studied for its great importance in the areas of human-computer interaction and social sciences. With the evolution of deep learning, there have been significant advances in this area that also surpass human-level accuracy. Although these methods have achieved good accuracy, they are still suffering from two constraints (high computational power and memory), which are incredibly critical for small hardware-constrained devices. To alleviate this issue, we propose a new Convolutional Neural Network (CNN) architecture eXnet (Expression Net) based on parallel feature extraction which surpasses current methods in accuracy and contains a much smaller number of parameters (eXnet: 4.57 million, VGG19: 14.72 million), making it more efficient and lightweight for real-time systems. Several modern data augmentation techniques are applied for generalization of eXnet; these techniques improve the accuracy of the network by overcoming the problem of overfitting while containing the same size. We provide an extensive evaluation of our network against key methods on Facial Expression Recognition 2013 (FER-2013), Extended Cohn-Kanade Dataset (CK+), and Real-world Affective Faces Database (RAF-DB) benchmark datasets. We also perform ablation evaluation to show the importance of different components of our architecture. To evaluate the efficiency of eXnet on embedded systems, we deploy it on Raspberry Pi 4B. All these evaluations show the superiority of eXnet for emotion recognition in the wild in terms of accuracy, the number of parameters, and size on disk.
Deficits in facial emotion recognition and implicit attitudes toward emotion among adolescents with high functioning autism spectrum disorder
COMPREHENSIVE PSYCHIATRY
Authors: Liu, Tai-Ling; Wang, Peng-Wei; Yang, Yi-Hsin Connie; Hsiao, Ray C.; Su, Yi-Yin; Shyi, Gary Chon-Wen; Yen, Cheng-Fang
Abstract
Objective: Impaired social interaction is one of the core characteristics of autism spectrum disorder (ASD). This study was conducted to compare the facial emotion recognition (FER) abilities and emotional interference of adolescents with and without high-functioning ASD by performing the FER Task (FERT) using the faces of Taiwanese people and the Implicit Association Test (IAT), respectively. Methods: This study recruited 71 adolescents with high-functioning ASD who aged at 11 to 18 years old as the ASD group and 63 adolescents without ASD from the Taiwanese community as the non-ASD group. We investigated FER abilities by conducting the FERT on six types of emotional expression with a three-level intensity rating, and we performed the IAT for evaluating the strength of a person's automatic association with mental representations of emotions in memory. Results: Compared with the non-ASD group, the ASD group performed significantly worse on facial emotion differentiation and the ranking and rating of emotional intensity in the FERT. The ASD group had higher IAT scores than the non-ASD group. Conclusion: The results suggest that adolescents with high-functioning ASD have subtle deficits in facial emotion processing and emotional interference. (C) 2019 Elsevier Inc. All rights reserved This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).