As competition in AI services intensifies, companies are increasingly attempting to achieve higher accuracy by increasing the size of AI models or leveraging more data. This is driving increased demand for memory, and as companies add servers to increase memory capacity, their financial burden also increases.

Panesia announced on the 27th that it will unveil the world's first CXL-equipped AI cluster utilizing the CXL 3.1 switch at the 2024 OCP Global Summit.

The OCP Global Summit, which Panesia is participating in this year, is an event hosted by OCP, the world's largest data center hardware development association, and a large number of related global companies participate to discuss building cost-effective and resource-manageable data center IT infrastructure.

At this year's event, which will focus on AI-related topics, Panesia will unveil a demo of accelerating RAG, a next-generation AI application used in services such as ChatGPT, using a CXL-equipped AI cluster, and will expand its global customer base.

CXL enables flexible memory expansion to meet user demands in systems such as data centers. For example, if a user plans to expand memory, they can save money by purchasing only the CXL device specifically for memory expansion. For this reason, memory expansion via CXL is attracting significant interest from big tech companies.

At the 2024 OCP Global Summit, Panesia will showcase its CXL-equipped AI cluster, a culmination of its AI-oriented CXL technology. Panesia's CXL-equipped AI cluster consists of a CXL-memory node and a CXL-GPU node.

Among these, the CXL memory node is equipped with multiple CXL memory expansion devices to provide large-capacity memory, and the 'CXL-GPU node' is equipped with a large number of CXL-GPU devices to accelerate AI operations.

A Panesia official emphasized, “This AI cluster with CXL 3.1 switches is the world’s first to be released, and Panesia is also the world’s first to develop a complete system with CXL-GPU, an AI acceleration solution.” Additionally, it was revealed that “the CXL 3.1 switch chip is a core product of Panesia and is scheduled to be supplied to customers in the second half of next year.”

A Panesia official explained, “By utilizing our CXL 3.1 switch and high-performance CXL IP, we can connect tens or hundreds of devices, effectively accelerating the latest AI applications such as RAG at the data center level.” He also expressed his ambition, saying, “Through this OCP Global Summit participation, we aim to solidify our relationships with global companies with whom we have been collaborating and secure new customers.”

Meanwhile, Panesia has announced several CXL solutions for accelerating AI, and at the 2023 FMS (Flash Memory Summit) exhibition, it presented a demo of accelerating the recommendation system, one of the most commercially utilized AI applications, with CXL 3.0/3.1 capabilities.

At this year's CES 2024 exhibition, the company won a CES Innovation Award for an AI accelerator equipped with CXL that can perform calculations near memory to reduce data movement overhead.