Dell, Nvidia, and SMC Collaborate to Power Musk's Grok AI Factory
Dell Technologies Inc, led by CEO Michael Dell, has announced a partnership with NVIDIA Corporation to construct an AI Factory designed to boost the capabilities of Grok, an AI model developed by Elon Musk's company, xAI.
Grok, a generative AI chatbot, was created in response to the increasing popularity of ChatGPT, a product of OpenAI, which Musk co-founded. Grok is based on a large language model and has the ability to process a broad range of visual information. This includes documents, diagrams, charts, screenshots, and photographs in addition to its robust text capabilities.
First-Generation Model: Grok-1.5V
xAI introduced its first-generation multimodal model, Grok-1.5V, in April. The company emphasized Grok's ability to understand the physical world, outperforming its competitors in the RealWorldQA benchmark, a measure of real-world spatial understanding.
Role of Dell in the AI Factory
Dell is assembling half of the racks that will go into the supercomputer that xAI is building. This supercomputer, termed the "Gigafactory of Compute," is expected to enhance the capabilities of the Grok AI chatbot.
SMC's Contribution
When asked about another collaborator, Musk replied, "SMC" – an acronym for Super Micro Computer, a server manufacturer based in San Francisco. Super Micro Computer Inc is known for its strong relationships with chip companies like Nvidia and its innovative liquid-cooling technology. SMC has confirmed its partnership with xAI.
The Gigafactory of Compute
Earlier in June, xAI announced plans to construct this supercomputer. The Gigafactory of Compute is anticipated to be operational by fall 2025 and is a collaborative effort with Oracle. The upcoming supercomputer is set to utilize up to 100,000 Nvidia H100 GPUs based on the Hopper architecture. This could make it four times larger than existing largest GPU clusters.
Musk's Ambition
This move by Musk is seen as an attempt to outclass rival GPU clusters in terms of size and capabilities. The collaboration between Dell, Nvidia, and SMC marks a significant step towards achieving this ambition.