AMD MI300X Oracle Cloud AI Inference and Training Support
Published2024.09.27 10:19
AMD Instinct MI300X accelerators will be integrated into Oracle Cloud Infrastructure to support demanding AI applications, and customers, including Firework AI, are expected to leverage the new OCI compute instances to power their AI inference and training workloads.
AMD today announced that Oracle Cloud Infrastructure (OCI) has selected ROCm™ open software and the AMD Instinct™ MI300X accelerator to power its latest OCI Compute Supercluster instance, BM.GPU.MI300X.8.
The OCI Supercluster, powered by AMD MI300X, supports up to 16,384 GPUs in a single cluster, leveraging the same high-speed network fabric technology as OCI’s other accelerators for configurable AI models with hundreds of billions of parameters.
OCI Bare Metal instances, which offer industry-leading memory capacity and bandwidth and are designed to run demanding AI workloads, including large-scale language model (LLM) inference and training that require high throughput, have already been adopted by companies such as Fireworks AI.
“AMD Instinct MI is a powerful, high-performance computing solution that is designed to meet the needs of today’s demanding workloads,” said Andrew Dieckmann, corporate vice president and general manager, AMD Data Center GPU Business Unit.“The 300X and ROCm open software support critical areas such as OCI AI workloads, and through this, we continue to grow as a trusted solution,” he explained.
“As these solutions expand into growing AI-intensive markets, the combination will benefit OCI customers by improving performance, efficiency and system design flexibility,” it added.
“The inference capabilities of the AMD Instinct MI300X accelerator add to Oracle Cloud Infrastructure’s broad range of high-performance bare metal instances, eliminating the overhead of virtualized compute commonly used for AI infrastructure,” said Donald Lu, senior vice president, Software Development, Oracle Cloud Infrastructure. “We are excited to provide more choice at an affordable price point for customers looking to accelerate their AI workloads.”
OCI focuses on AI inference and training capabilities that can support latency-optimized use cases even at larger batch sizes, and performance suitable for the largest LLM models on a single node. AMD Instinct MI300X has undergone extensive testing against these OCI criteria and is attracting attention from AI model developers.
Firework AI provides a fast platform designed to build and deploy generative AI. With over 100 models, Firework AI is leveraging the performance and benefits of OCI powered by AMD Instinct MI300X.
“Firework AI helps enterprises build and deploy complex AI systems across a wide range of industries and use cases,” said Lin Qiao, CEO of Firework AI. “The memory capacity available with the AMD Instinct MI300X and ROCm open software helps our customers continuously grow their models and scale their services.”
관련뉴스
Dell Launches Servers Equipped with AMD Instinct Accelerators
Dell Technologies is stepping up efforts to expand an open ecosystem for generative AI through the PowerEdge server XE9680, which is equipped with eight AMD Instinct MI300X accelerators.
2023.12.07by 배종인 기자
AMD vs Nvidia, Clash in AI GPU...MI300X vs H100
The server and ultra-high-performance GPU market that accelerates generative AI and ultra-large language models is burning hot. Since AMD launched its new MI300X GPU product on the 7th in response to Nvidia, which has monopolized the market, a battle of wits has unfolded between AMD and Nvidia.
2024.01.18by 명세환 기자
AMD MI300 Series AI Accelerators to Begin Full Delivery in May
인공지능(AI)은 업계 최고 화두로 등극하며 IT뿐 아니라 산업군 전반에서 강력한 파급력으로 혁신을 추동하고 있다. 이러한 가운데 AI 모멘텀의 중심에 선 AMD가 AI 비즈니스 전략을 공유하는 자리를 마련했다.
2024.03.20by 권신혁 기자
.jpg)
SalePoint Signs Multi-Year Partnership Agreement with AWS… Promoting Identity Security that Integrates Even AI Agents
Sailpoint has entered into a multi-year strategic partnership agreement with AWS and is moving forward with establishing an integrated governance system that manages both human and non-human identities together. The plan is to consistently manage access permissions in an environment where AI agents are increasing as work execution entities, while applying the principle of least privilege and automated policy enforcement. The two companies plan to jointly expand capabilities to manage the identities of various entities, including AI agents, within a single layer in the AWS environment. This collaboration is interpreted as a move to design security and governance together in corporate environments where AI adoption is expanding.
2026.03.26by 배종인 기자
.png)
Databricks Unveils Open AI Security Monitoring 'Lakewatch'
Databricks entered the security market on March 24 by unveiling LakeWatch, an open-source agentic SIEM. The core functionality of this product is to integrate and analyze security, IT, and business data in a single environment to support AI-based threat detection and investigation. The company explained that it reduces the limitations of existing security operations centers, which have had to forgo some data due to high cost structures, and enables large-scale data analysis and automation based on open formats and ecosystems. LakeWatch is currently offered as a private preview, with Adobe and Dropbox mentioned as early customers. Databricks also announced an expanded partnership with Anthropic as well as the acquisition of Antimatter and SiftD.ai.
2026.03.26by 배종인 기자
