en 5-Image Processing Image Processing Research Paper Research Paper <span style="font-size:10.0pt"><span style="line-height:107%"><span new="" roman="" style="font-family:" times="">This study proposes a descriptor-based approach combined with deep learning, which recognizes facial emotions for safe driving.&nbsp; Paying attention to the driver&#39;s facial expressions is crucial to address the increasing road accidents. This project aims to develop a Facial Emotion Recognition (FER) system that monitors the driver&#39;s facial expressions to identify emotions and provide instant assistance for safety control. In the initial stage, Viola-Jones face detection was employed to detect the facial region, followed by Butterworth high-pass filtering to enhance the identified region for locating the eye, nose, and mouth regions, using Viola-Jones face detection. Secondly, the Local Binary Patterns (LBP) feature descriptor is utilized to extract features from the identified eye, nose, and mouth regions. Using 3 RGB channels, the extracted features from these three regions are fed into RessNet-50 and EfficientNet deep networks. The outputs of the two deep learning models&#39; classifiers are combined and integrated using two ensemble methods: ensemble maximum voting and ensemble mean. Based on these combining classifier rules, the performance was evaluated on the JAFFE and KMU-FED databases. The experimental results demonstrate that the proposed method can effectively and with higher accuracy than other competitors recognize emotions in the JAFFE and KMU-FED datasets. The novelty and originality of this paper lie in its significant application in the automotive industry. Implementing our proposed method in a system capable of high accuracy and precision can help mitigate numerous driving hazards. Our approach has achieved 99% and 98% accuracy on the JAFFE and KMU-FED databases, respectively. This high level of accuracy, coupled with its practical relevance, underscores the innovative nature of our work.</span></span></span> Ensemble deep learning, combination of classifiers, Driver assistant, Face emotion recognition, Local binary pattern 147 161 http://ijeee.iust.ac.ir/browse.php?a_code=A-10-4936-1&slc_lang=en&sid=1 Ehsan Ghasemi ehsanghasemi91@birjand.ac.ir 1800319475328460014924 1800319475328460014924 No Department of Electrical and Computer Engineering, University of Birjand Seyyed Mohammad Razavi smrazavi@birjand.ac.ir 1800319475328460014925 1800319475328460014925 Yes Department of Electrical and Computer Engineering, University of Birjand Sajad Mohamadzadeh s.mohamadzadeh@birjand.ac.ir 1800319475328460014926 1800319475328460014926 No Department of Electrical and Computer Engineering, University of Birjand