Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

DrowsyNet: Multivariate Time Series Classification for Embedded Driver Drowsiness Detection

google+
Views: 109                 

Author :  Shicheng Zu

Affiliation :  Fordham University

Country :  USA

Category :  Computer Science & Information Technology

Volume, Issue, Month, Year :  1, 1, May, 2022

Abstract :


Compact facial landmark sequences have been proven to characterize the complex dynamics associated with facial expressions effectively. We formulated driver drowsiness detection under the multivariate time series classification (MTSC) paradigm. Assigning drowsiness labels to short time intervals is sensitive enough to recover drivers' vigilance. To accommodate the constrained computational demand on embedded devices, we propose DrowsyNet, a dilated LSTM-FCN, to tackle MTSC by featuring its dilated LSTM (Long Short-Term Memory) and dilated FCN (Fully Convolutional Network) with low computational complexity. The dilated LSTM focuses on modeling long-term dependencies, while the dilated FCN specializes in extracting interactive patterns from multivariate dimensions. Our empirical evidence indicates that facial landmark sequences of length 8 are sufficient to sort the driving behaviors into desired class labels unambiguously. Quantitative analysis demonstrates that DrowsyNet effectively classifies facial landmark sequences by achieving an impressive classification accuracy of 86.90% and efficiently yields an inference speed of 15 frames per second on Firefly RK3399pro embedded boards. Besides, the optimal facial landmark quantities and their relative feature importance were empirically determined. Finally, class activation maps (CAMs) visually confirm the most contributing regions on facial landmark sequences for driver drowsiness detection.

Keyword :  class activation map, driver drowsiness detection, dilated convolutional neural network, dilated LSTM, facial landmark sequence, multivariate time series classification

Journal/ Proceedings Name :  2022 8th International Conference on Control, Automation and Robotics (ICCAR)

URL :  https://ieeexplore.ieee.org/document/9782626

User Name : zsc198841
Posted 09-06-2022 on 00:15:47 AEDT



Related Research Work

  • Understanding The Worldwide Paths Towards The Creation Of True Intelligence For Machines
  • An Advantageous And User-friendly Mobile Program To Benefit Students In Seeking Their Suitable Colleges Through The Use Of Web Scraping, Machine Learning, And Frontend Design
  • An Overview Of Copy Move Forgery Detection Approaches
  • Scaled Quantization For The Vision Transformer

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals