Smart Eye is working with Texas Instruments on the development of automotive interior vision sensing running on TI’s new AM62A7-Q1 vision processor. Combined with TI’s new processor, Smart Eye’s Automotive Interior Sensing AI will provide improved performance and functionality safety features to upcoming car models going into production in 2023 and 2024. The new technology will be fully compliant with new General Safety Regulations (GSR) and European New Car Assessment Programme (Euro NCAP) requirements.

As GSR and Euro NCAP requirements make advanced sensing features mandatory in new vehicles in Europe, automakers now require advanced processing chips that deliver the right performance without sacrificing critical system resources, such as power, size, weight, and cost.

Smart Eye’s Automotive Interior Sensing AI combines its Driver Monitoring System (DMS) software with Cabin Monitoring System (CMS) software to provide intelligence on all occupants inside of a vehicle.

Smart Eye’s software solution supports the new AM62A7-Q1 vision processor and family of devices as well as the TDA4VM-Q1 automotive processor and family of devices for different use cases. Automakers can scale their designs and optimise performance from one car model to the next by reusing TI’s device IP and single software development kit across their vehicle line up.

The AM62A7-Q1 device offers integrated ISP that can handle 5 MP at 30 frames per second, support for up to two RGB-IR cameras and a highly efficient 2 TOPS deep learning accelerator. The TI systems on chip (SoCs) enable scalability and lower costs for advanced automotive platforms supporting multiple sensor modalities in centralised ECUs or stand-alone sensors, such as infrared cameras. Using these cameras, Smart Eye’s AI-based software detects various levels of driver distraction and drowsiness as well as the attention, emotions, and activities of all occupants in the vehicle, including the objects they use. This data lets automakers adapt safety measures and advanced driver assistance systems (ADAS) in real-time – improving road safety and enhancing the mobility experience for the driver and all other occupants in a vehicle.

“Smart Eye’s Interior Sensing AI is designed to run on a large variety of automotive SoCs,” said Martin Krantz, Founder and CEO of Smart Eye. “We are especially excited to collaborate with TI to combine their state-of-the-art chipsets with our deep learning expertise and deliver advanced safety and mobility features that run with the highest power efficiency and performance accuracy.”

“The collaboration of TI with Smart Eye allows automakers to design best-in-class driver and occupant monitoring systems, increasing the overall safety of the vehicle,” said Sameer Wasson, vice president and general manager of Processors at TI. “By leveraging our new family of vision processors—coupled with Smart Eye’s advanced AI software—automakers are able to create a powerful interior sensing solution that supports multiple modalities and runs at the highest levels of reliability and efficiency.”