Saudi Arabia and the UAE buy a lot of Nvidia chips to enter AI
It is reported that insiders said that Saudi Arabia has purchased about 3,000 Nvidia H100 chips through the King Abdullah University of Science and Technology. This chip is a GPU chip with a new architecture released by Nvidia last year. .
It is reported that the H100 chip is based on the new-generation Hopper architecture and has 80 billion transistors, making it Nvidia's most powerful GPU to date. The chip will become the world's largest accelerator chip. Lao Huang once said that the chip is based on TSMC's 4nm process.
In addition, another Middle Eastern country, the United Arab Emirates, has also acquired thousands of Nvidia chips and developed its own open source large language model Falcon at the state-owned Science and Technology Innovation Institute in Masdar City, Abu Dhabi.
People familiar with the matter revealed that the UAE hopes to own and control its own computing power and computing talents as well as its own platform. What is important is that they have sufficient capital and energy to attract world-class talents.
Just when the world's top technology companies are scrambling to purchase Nvidia's AI chips, the addition of the above two undoubtedly exacerbated the shortage of the chip.
US companies such as OpenAI and Google have state-of-the-art large language models, and they are also major buyers of Nvidia's H100/A100 chips.
Estimates show that OpenAI only used 1024 A100 chips for more than a month to train a more advanced GPT-3 model, and in comparison, the performance of the previous generation of A100 chips is not as powerful as the latest H100.
In addition, people familiar with the matter revealed that King Abdullah University of Science and Technology is also using at least 200 A100s to develop a supercomputer called Shaheen III, which is said to be put into operation this year. This machine will use 700 Nvidia Grace Hoppers AI super chip.
The UAE government has purchased a batch of new Nvidia chips, aiming to pave the way for more applications and cloud services related to large language models. The Falcon model in the UAE is currently available online for free. It uses 384 A100 chips and takes 2 Months of training completed.
If you like this article, may wish to continue to pay attention to our website Oh, later will bring more exciting content. If you have product needs, please contact us
