Dell Technologies Develops AI Factory with NVIDIA GPUs to Support Elon Musk's xAI

Michael Dell, CEO and chairman of Dell Technologies, recently announced on X that the company is in the process of developing the Dell AI Factory. This new initiative will leverage NVIDIA GPUs to power Grok, the AI model created by Elon Musk’s company, xAI. Elon Musk has made significant investments in computational resources to advance xAI.

In 2023, Musk acquired tens of thousands of GPUs. Training the Grok 2 model required approximately 20,000 Nvidia H100 GPUs, and Musk has indicated that the Grok 3 model and future versions will necessitate around 100,000 Nvidia H100 chips. Reports suggest that Musk aims to have a new supercomputer operational by fall 2025.

The project may involve collaboration with Oracle to construct a large-scale system. Once completed, the interconnected array of NVIDIA H100 GPUs would be at least four times larger than the largest existing GPU clusters, as Musk noted during a presentation to investors in May.

In April 2023, xAI introduced Grok-1.5V, a first-generation multimodal model. Grok has strong text processing capabilities and can handle various types of visual information, including documents, diagrams, charts, screenshots, and photographs.

Meanwhile, Meta AI chief Yann LeCun revealed that Meta has acquired $30 billion worth of NVIDIA GPUs to train their AI models, highlighting the competitive landscape and significant investments in AI infrastructure.

Main Image: LinkedIn