Elon Musk recently took to X to reveal that his AI-focused team at xAI successfully brought their Colossus 100k H100 training cluster online, establishing it as the most powerful AI training system in existence.
Musk noted that the project, which involved extensive collaboration with Nvidia and other key partners, was completed in an impressive 122 days. Musk also highlighted the extraordinary capabilities of Colossus, emphasizing that it is only the beginning.
In his post, he revealed that the system is set to double in size within the next few months, growing to a staggering 200,000 units with the addition of 50,000 H200 processors. This expansion will not only reinforce Colossus’s position as the leading AI training system but also push the boundaries of what is possible in the field of artificial intelligence.
The rapid deployment of the Colossus cluster underscores the expertise of the xAI team, as well as the vital contributions from Nvidia and various other suppliers.
This weekend, the @xAI team brought our Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days.
Colossus is the most powerful AI training system in the world. Moreover, it will double in size to 200k (50k H200s) in a few months.
Excellent…
— Elon Musk (@elonmusk)
The Colossus system’s current configuration, with 100,000 H100 processors, already represents a monumental leap in AI training capabilities. These processors, provided by Nvidia, are among the most advanced available, designed to handle the enormous computational demands of training large-scale AI models.
As Colossus expands to include 50,000 more units, the system will be equipped to tackle even more complex and data-intensive AI tasks, setting new benchmarks in the industry.
Want to see more of our stories on Google?
P.S. Want to keep this site truly independent? Support us by buying us a beer, treating us to a coffee, or shopping through Amazon here. Links in this post are affiliate links, so we earn a tiny commission at no charge to you. Thanks for supporting independent Canadian media!
I am not sure I would trust this particular AI training system because it will definitely have built in bias according to the views of the man in charge
You think the other AIs don't have a bias?
I believe they do but that doesn’t wash this particular one from it. And the people that are behind the other AI engines are at least not grandstanding about the truth and fairness while doing the opposite
I sense you're ok with bias – at least against Elon Musk.
No, not really. But there are different flavours of bias. Some are more toxic and destructive and deserve more scrutiny. It is not necessary to treat Elon Musk with bias. He provides more than enough material to see him for what he is; at least by the people who want to see.