Providing vision platform vendors with the technology necessary to meet NCAP 2020 test scenarios

NXP Semiconductors, LG Electronics, and HELLA Aglaia announced a strategic alliance for the development of automotive vision applications.

The vision platform, a collaboration between three powerhouses in automotive ADAS (Advanced Driver Assistance Systems), enables automakers to save lives by detecting and classifying road users at risk. Currently in use by one European OEM, this platform aims to replace existing proprietary vision platforms that limit automakers' choices. It is also designed to bring rapid innovation to critical areas of autonomous driving and ensures compliance with guidelines set by the global NCAP standards organization.

Most existing automotive vision platforms are closed and lack flexibility, leaving no room for automotive manufacturers to differentiate themselves in the global market. Furthermore, they limit additional software integration and innovation, and “block” the ability to optimally combine sensing technologies and software sources within the market. The joint development work by three companies, led by LG Electronics, is based on the belief that vision platforms must be open and safe to meet NCAP guidelines and pave the way for Levels 3–5 autonomous driving.

The camera-based vision system developed by LG Electronics together with NXP and Hella Aglaia is designed to detect and classify road users such as pedestrians and cyclists, and to activate AEB (Automatic Emergency Braking System). This camera can be attached to the car's windshield behind the rearview mirror.

In addition, this system detects traffic signals and informs the driver of speed limit information. It monitors lane keeping and enables the steering wheel to be corrected if it turns unintentionally. The combination of NXP's accelerated vision processing IP and algorithm experts from Hella Aglaia and LG enables the application to run at low latency and within a market-leading power range.

The new vision platform aims to provide automotive manufacturers and suppliers with the technology necessary to meet NCAP 2020 test scenarios. The goal of this solution is to rapidly detect and classify road users at risk, perform emergency braking and collision avoidance, and provide predictive detection of hazardous situations such as low light and obstructed visibility. This vision platform paves the way for new advanced capabilities that enhance autonomous driving tasks and smart AI networks.

LG Electronics is a leader in next-generation vision processing solutions for camera systems, which are key components of the autonomous vehicle and Advanced Driver Assistance Systems (ADAS) markets. Leveraging its extensive experience and comprehensive R&D capabilities in camera systems, computer vision algorithms, and electronics, LG Electronics aims to elevate existing ADAS systems to a new level. As an industry leader, it integrates the diverse vision SoCs, software, and IP components of Hella and NXP to create an environment where automotive manufacturers can utilize a wealth of solutions.

HELLA is a leading global automotive solutions provider that develops and manufactures lighting and electronic products for the automotive industry. Hella Aglaia, a Berlin-based subsidiary, is a global leader in developing intelligent visual sensor systems, leveraging its long-standing expertise in mono and stereo camera systems, image processing, and software programming. It specializes in developing innovative industrial solutions and effective products for driver assistance systems, electromobility, and people counting.

NXP is the optimal partner for the automotive vision field, possessing superior safety, security, quality, and vision processing capabilities. NXP's S32V vision processor family provides a powerful GPU for surround view image stitching. It also offloads advanced vision processing and machine learning algorithms to the APEX-D engine. It features a high-performance power envelope (GHz/mW) for low-power ADAS vision processing.

This provides additional functionality within the same system environment. This offers automotive manufacturers and suppliers the opportunity to reduce traffic accident casualties by deploying advanced sensing algorithms on secure, certified automotive ISO26262. NXP's SoC platform is built on an open software platform, enabling suppliers and OEMs to implement differentiated ADAS technologies.