인피니언 8월20일부터
This page was machine-translated and may differ from the original. View original

On-device AI: Chip Optimization Key to Cost Efficiency

Google 우선 소스Published2024.06.03 16:33

The Korea Industrial Intelligence Association Launches its Industrial AI Technology Committee.
Embedded systems require miniaturized hardware-based performance optimization.

As the recent AI development trend shifts from using large-scale resources to efficiently utilizing small devices, MCU-based design solutions that support AI application development in industrial settings are attracting attention.

The launch ceremony for the "Industrial AI Technology Committee," launched by the Korea Industrial Intelligence Association on the 29th, provided a forum for sharing industrial AI-related technologies and industry trends. Gachon University Chairperson Cho Young-im introduced the committee and highlighted trends in international AI standardization. Speakers emphasized the use of industrial data for AI applications.

Hardware optimization is a key focus for the domestic AI industry. As computing performance grows and becomes more important, various types of semiconductor chips are being utilized. The CPUs and GPUs adopted by major global big tech companies generate annual demand of 200 to 400 million units, while the APs and GPUs used in mobile devices generate annual demand of 1.2 to 2 billion units. Recently, the demand for NPU (Neural Processing Unit) specialized in AI processing is increasing.

Recently, the trend has shifted from large-scale AI learning and inference based on the cloud (server) to on-device AI or edge AI, which improves data processing speed by incorporating AI functions into smart devices themselves.

In this trend, the "MCU (Microcontroller Unit)" is considered a cost-effective strategy for integrating AI chips into image sensors in embedded systems, reducing power consumption and enhancing the security of personalized devices. Recently, NPUs have also been incorporated into MCUs.

An MCU is a core component of an embedded system, a computer system designed to perform specific tasks. It can be viewed as a miniature computer that integrates a microprocessor unit (MPU), memory, and input/output interfaces on a single chip. MCUs perform basic calculations, input/output control, and data processing, ensuring low power consumption and security, making them primarily used in fields such as industrial automation, smart homes, and smart cities. Major MCU manufacturers include STMicroelectronics, NXP, and Microchip.

Gamba Labs CEO Park Se-jin emphasized the importance of cost reduction and development environment as key keywords for edge AI, saying, “The key is how small we can make it and how much we can optimize it.”

“Rather than uploading sensor data from industrial sites to the cloud and running large-scale models, we can achieve cost efficiency by focusing on specialized areas,” said CEO Park. “Major MCU companies already provide libraries for AI application development, supporting easy AI development.”

Research is already underway overseas, and development in Korea is still in its early stages. For example, NXP's new MCX A series MCUs are optimized for power architecture and software compatibility, making them suitable for a wide range of embedded applications, including industrial sensors, motor controllers, batteries, portable power system controllers, and IoT devices.

STMicroelectronics also supports a variety of AI solutions that accelerate the implementation and development of edge AI processing based on STM32 MCUs and MPUs. These solutions enable AI processing directly on STM32 MCUs and MPU devices, without cloud connectivity. STMicroelectronics also provides automated autoML programs, such as the STM32Cube.AI platform and NanoEdge.AI Studio.

Gamba Labs, a Korean startup, is collaborating with smart home device manufacturers, robots, and automotive parts companies and is currently in the validation stage for its voice speaker recognition solution. Gamba Labs provides hardware modules for testing and developing its TinyML models. It supports voice and motion recognition model testing based on ESP32S3 MCU and provides VIOLA automation framework.

“The future challenges in the on-device AI market are miniaturizing hardware, maximizing energy efficiency, securing price competitiveness, making models lightweight and optimized, automating the development environment, and enabling integration with NPUs,” said CEO Park. “This can be seen as an opportunity for domestic startups like Gamba Labs.”

본 기사에 대한 정정·반론·추후보도 청구는 보도 청구 안내를, 그간 게재된 보도문은 정정·반론보도 모아보기를 참고해 주세요.
김예지 기자
김예지 기자