You are required to read and agree to the below before accessing a full-text version of an article in the IDE article repository.

The full-text document you are about to access is subject to national and international copyright laws. In most cases (but not necessarily all) the consequence is that personal use is allowed given that the copyright owner is duly acknowledged and respected. All other use (typically) require an explicit permission (often in writing) by the copyright owner.

For the reports in this repository we specifically note that

  • the use of articles under IEEE copyright is governed by the IEEE copyright policy (available at
  • the use of articles under ACM copyright is governed by the ACM copyright policy (available at
  • technical reports and other articles issued by M‰lardalen University is free for personal use. For other use, the explicit consent of the authors is required
  • in other cases, please contact the copyright owner for detailed information

By accepting I agree to acknowledge and respect the rights of the copyright owner of the document I am about to access.

If you are in doubt, feel free to contact

An Intelligent Non-Contact based Approach for Monitoring Driver’s Cognitive Load


Publication Type:

Licentiate Thesis


The modern cars have been equipped with advanced technical features to help make driving faster, safer and comfortable. However, to enhance transport security i.e. to avoid unexpected traffic accidents it is necessary to consider a vehicle driver as a part of the environment and need to monitor driver’s health and mental state. Driving behavior-based and physiological parameters-based approaches are the two commonly used approaches to monitor driver’s health and mental state. Previously, physiological parame-ters-based approaches using sensors are often attached to the human body. Although these sensors attached with body provide excellent signals in lab conditions it can often be troublesome and inconvenient in driving situa-tions. So, physiological parameters extraction based on video images offers a new paradigm for driver’s health and mental state monitoring. This thesis report presents an intelligent non-contact-based approach to monitor driv-er’s cognitive load based on physiological parameters and vehicular parame-ters. Here, camera sensor has been used as a non-contact and pervasive methods for measuring physiological parameters.The contribution of this thesis is in three folds: 1) Implementation of a camera-based method to extract physiological parameters e.g., heart rate (HR), heart rate variability (HRV), inter-bit-interval (IBI), oxygen satura-tion (SpO2) and respiration rate (RR) considering several challenging con-ditions e.g. illumination, motion, vibration and movement. 2) Vehicular parameters e.g. lateral speed, steering wheel angle, steering wheel reversal rate, steering wheel torque, yaw rate, lanex, and lateral position extraction from a driving simulator. 3) Investigation of three machine learning algo-rithms i.e. Logistic Regression (LR), Support Vector Machine (SVM) and Linear Discriminant Analysis (LDA) to classify driver’s cognitive load. Here, according to the results, considering the challenging conditions, the highest correlation coefficient achieved for both HR and SpO2 is 0.96. Again, the Bland Altman plots shows 95% agreement between camera and the reference sensor. For IBI, the quality index (QI) is achieved 97.5% con-sidering 100 ms R-peak error. For cognitive load classification, two separate studies are conducted, study1 with 1-back task and study2 with 2-back task and both time domain and frequency domain features are extracted from the facial videos. Finally, the achieved average accuracy for the classifica-tion of cognitive load is 91% for study1 and 83% for study2. In future, the proposed approach should be evaluated in real-road driving environment considering other complex challenging situations such as high temperature, complete dark/bright environment, unusual movements, facial occlusion by hands, sunglasses, scarf, beard etc.


author = {Hamidur Rahman},
title = {An Intelligent Non-Contact based Approach for Monitoring Driver’s Cognitive Load },
url = {}