Oracle has announced a new zettascale OCI Supercluster at the Oracle CloudWorld conference. The system will help enterprises train and deploy next-generation AI models using more than 100,000 of NVIDIA’s latest-generation GPUs. It is set for availability in the first half of next year.
The Blackwell-based systems can scale up to 131,072 Blackwell GPUs with networking to deliver 2.4 zettaflops of peak AI compute to the cloud. Oracle also previewed liquid-cooled bare-metal instances to help power applications. The instances are capable of large-scale training with Quantum-2 InfiniBand and real-time inference of trillion-parameter models within the expanded 72-GPU domain.
OCI will offer instances connecting eight in a single bare-metal instance via NVLink and NVLink Switch, and scaling to 65,536 H200 GPUs with NVIDIA ConnectX-7 NICs over RoCEv2 cluster networking. The instance is available to order for customers looking to deliver real-time inference at scale and accelerate their training workloads.
NVIDIA GPUs drive OCI Supercluster
Companies are using NVIDIA-powered OCI Superclusters to drive AI innovation. Foundation model startup Reka is using the clusters to develop advanced multimodal AI models to develop enterprise agents. Dani Yogatama, cofounder and CEO of Reka, said, “Reka’s multimodal AI models, built with OCI and NVIDIA technology, empower next-generation enterprise agents that can read, see, hear and speak to make sense of our complex world.
With NVIDIA GPU-accelerated infrastructure, we can handle very large models and extensive contexts with ease, all while enabling dense and sparse training to scale efficiently at cluster levels.”
Oracle Autonomous Database is gaining NVIDIA GPU support for Oracle Machine Learning notebooks to allow customers to accelerate their data processing workloads on Oracle Autonomous Database. NVIDIA and Oracle are partnering to demonstrate three capabilities that show how the NVIDIA accelerated computing platform could be used to accelerate key components of generative AI pipelines. NVIDIA and Oracle are also collaborating to deliver infrastructure worldwide, helping address the data residency needs of governments and enterprises.
Brazil-based startup Wide Labs trained and deployed Amazonia IA, one of the first large language models for Brazilian Portuguese, using OCI’s Brazilian data centers to help ensure data sovereignty. Enterprises can accelerate task automation on OCI by deploying NVIDIA software such as NIM microservices with OCI’s scalable cloud solutions. These solutions enable enterprises to quickly adopt generative AI and build agentic workflows for complex tasks like code generation and route optimization.
