Driver Monitoring System(DMS)

With Deep Learning Concept

I. Product description

DMS system:

※ DMS is applied to monitor vehicle’s internal status, including driver’s behavior and status, to execute risks prediction and precaution, thus to minimize the accident happening and make driving more safer.

※ With continuous functions upgrade and optimization, diversified developing of interaction modes and multi-mode integration of in-car perception, DMS becomes more and more important and carries more functions to achieve intelligent car through embedded artificial intelligence.

II. System Components

III. System Specs

IV. System Principle

Based on traditional computer vision and learning model, facial and cognitive state recognition technology consists of 3 steps:

1. Face recognition;
2. Facial areas such as eyes and mouth are positioned and broken down;
3. From a group of continuous images, to determine whether fatigue/phone call/distraction is achieved through angle and distance parameters of main areas of face, result is returned and warning is conducted according to the result.

Monocular IR camera → face recognition → use CNN model to position and track the eyes/mouth on the face → voice warning

Software workflow

V. System Functions

VI. Installation

Below is the installation position recommended.