As autonomous driving technology advances, advanced image processing technologies such as replacing vehicle mirrors, detecting drowsy driving, and pedestrian protection systems are being required for ADAS applications. Market research firm Strategy Analytics predicted that "the number of cameras required to implement the technology will increase," and that "most high-end cars will be equipped with up to 12 cameras within the next five years."

This type of complex camera technology must be able to rapidly process and analyze images even in the worst weather conditions, and must be designed to meet stringent automotive safety standards. It is impossible to integrate general camera technology used in smartphones or consumer video cameras.

 
Changes in the role of the Image Signal Processor (ISP)
An ISP converts raw pixels into high-definition images for display. As the number of cameras installed in vehicles increases and sensor fusion technology advances, ISP functions—which involve encoding and additional processing by computer vision algorithms—are becoming concentrated within ADAS SoCs. SoCs can not only manage multiple cameras but also provide reliability and safety to the automotive market. To achieve this, a new approach to virtual parallel processing for automotive functional safety and computer vision applications is required.

Automotive cameras must provide the highest level of clarity and reliability. The Mali-C71 offers an ultra-wide dynamic range (UWDR) with a difference in exposure values of up to 24 stops. In some cases, it provides detailed images that are invisible to the naked eye. It supports superior performance in clarity and reliability compared to high-performance DSLR cameras that offer a dynamic range of approximately 15 stops. In addition, it removes image noise and processes multiple camera exposures, as well as generates UWDR frames and transmits them to displays or computer vision engines.

When cameras are used for ADAS, such as pedestrian protection or drowsy driving detection systems, safety standards become even stricter. The Mali-C71 provides low latency and advanced fault detection capabilities through more than 300 dedicated fault detection circuits. This enables system-level certification for ISO26262, ASIL D, IEC 61508, and SIL3 standards.

An ARM official stated, "We plan to provide all software reference code to control ISPs, sensors, automatic white balance, automatic exposure, and more, and to develop comprehensive automotive software designed to comply with ASIL standards."

Tim Ramsdale, Executive Vice President of ARM’s Imaging and Vision Group, said, “The automotive industry is moving fast to realize autonomous driving. The ARM Mali-C71 will display the information necessary for the driver’s quick and accurate decisions on a high-level display, while simultaneously providing reliable data to the computer engine to control the vehicle.”