DMSs continually watch the driver’s head movements to recognise signs of drowsiness and distraction, enabling systems in the vehicle to generate warnings that can preserve the safety of occupants.
Traffic agencies estimate that about 95% of road-traffic accidents result from human error, many of which could be avoided using systems such as DMSs. With almost 19,000 accident fatalities in Europe in 2020, recently enacted legislation will mandate DMS for all new car platforms in Europe in 2024 and for existing model platforms in 2026.
In fact, with traffic fatalities twice as high in the US, the National Transportation Safety Board (NTSB) has recommended DMS for all semi-autonomous vehicles.
“Drivers may not realise that they are unsafe to drive due to tiredness or distraction. DMS removes uncertainty by detecting the problem automatically, which protects all occupants as well as others traveling on the road,” said Eric Aussedat, Executive Vice President, Imaging Sub-Group General Manager, STMicroelectronics. “Our latest global-shutter sensors deliver sensitivity and compactness, simplifying DMS hardware and reducing the overall system cost. This enables our customers and partners to deliver high-performing and reliable DMS systems reaching the legislation expectations.”
The global-shutter sensor, the VB56G4A, leverages ST’s in-house investment in manufacturing advanced 3D-stacked back-side illuminated (BSI-3D) image sensors. These are more sensitive, smaller, and more reliable than conventional front-side illuminated (FSI) sensors typically used in first-generation DMSs.
ST is supplying samples of its new sensor to lead customers now and mass production is scheduled for the beginning of 2023 for adoption in model year 2024 vehicles.
Global-shutter sensor offer a number of advantages over rolling-shutter imagers. By simultaneously exposing all pixels to the image, a global-shutter sensor allows simple synchronisation with NIR illumination, improving the illumination-subsystem power budget. In addition, the sensor achieves high Quantum Efficiency (QE), reaching 24% at 940nm near-infrared wavelength, with linear dynamic range up to 60dB enabling a simple low-power, non-visible LED emitter to provide adequate illumination for the sensor.
Operating outside the visible spectrum also ensures consistent response in day or night driving and in bright or overcast conditions.
The sensor’s high QE, combined with a pixel size of just 2.6µm, also helps to optimise total power consumption and camera size. In addition, integrated automatic exposure control eases use and simplifies the application-software design by minimizing system interaction with the sensor.
The sensor also provides flexible operating modes that help optimise system features and performance. These include programmable sequences of 4-frame contexts, illumination control outputs synchronised with sensor integration periods, an input for an external frame-start signal, automatic dark calibration, dynamic defective-pixel correction, image cropping, and a mirror/flip-image readout.
External connections include eight programmable general-purpose I/O (GPIO) pins and a dual-lane MIPI CSI-2 transmitter interface operating up to 1.5 Gbps per lane. The sensor can operate at up to 88 frames per second (fps) at full resolution and typical power consumption is 145mW at 60 fps.
