Elon Musk uses 100,000 NVIDIA H100 GPUs to train artificial intelligence

Businessman Elon Musk said he is using 100,000 NVIDIA H100 GPUs to train the third version of the Grok artificial intelligence – used on the “X” social network for premium users.

The announcement took enthusiasts and the public by surprise, considering that the second version – developed by the startup xAI – will be released in August. Still, the owner of the social network and companies such as SpaceX and Tesla already points out that its most advanced LLM is being trained by thousands of the most modern hardware available.

Elon Musk’s statement not only indicates that Grok 3 will be a more advanced artificial intelligence, but it will also be the only one to be developed with this number of NVIDIA H100 GPUs. In other words, the results that this could bring would be unprecedented for the industry and indicate the path that technology will take.

In terms of comparison, let’s take a look at the rumors related to OpenAI and ChatGPT. The GPT-4 language model, for example, reportedly used 40,000 NVIDIA A100 GPUs – which not only lags behind in quantity, but also has lower performance than the H100 version.

Furthermore, Elon Musk also claims that the Grok 3 is not being built from scratch. Apart from the 100,000 NVIDIA H100 GPUs, LLM is using the two previous versions as a base and promises an extremely advanced model.

See more:

Elon Musk’s plans for artificial intelligence

And if you think that Elon Musk’s plans will stop there or that he will slow down his efforts in AI, you’re mistaken. While Grok 3 will use 100,000 NVIDIA H100 GPUs, he also plans to invest $9 billion in purchasing Blackwell B200 accelerators for xAI.

The investment is huge and, for now, this AI model is only available to users who pay for the Premium plan on their platform. The offer also guarantees a check mark on the “X”, reduced number of ads, access to Media Studio and the ability to generate revenue through your account.

Fonte: WCCFTECH