Nvidia announces its top end AI chip H200. Check what’s new

Dion Harris, head of data center product marketing at NVIDIA, was quoted as saying by Bloomberg, “When you look at what’s happening in the market, model sizes are rapidly expanding…It’s another example of us continuing to swiftly introduce the latest and greatest technology.” 

Nvidia said that the introduction of H200 will lead to perform boost that will include almost doubling the interference speed on Meta’s Llama 2 language model while comparing to the H100 chipset.

After the launch of H200 chipset, Nvidia shared went up by as much as 1.5% in New York, one of only two semiconductor stock to rise, reported Bloomberg. Nvidia shares have gone up by around 200% this year, the best perfomer on the Philadelhia Stock Exchange Semiconductor index.

Performance upgrade in H200:

The major upgrade for the H200 chipset comes in the form of memory, becoming the first GPU to come with HBM3e technology. The H200 comes with 141GB of memory at 4.8 terabytes per second compared to 141 GB memory capacity on the H100.

Competition rises for Nvidia: 

Nvidia is currently the undisputed market leader in the AI chips segment and controls around 80% of the global market for the chips in this segment. 

However, competition is slowing rising for Nvidia with Advanced Micro Devices looking to announce its AI chip M1300 to the market in the fourth quarter while Intel claiming that its Gaudi 2 chipset is faster than the incumbent H100 chipset by Nvidia, reported Bloomberg. Moreover, a Reuters report earlier had noted that even Nvidia’s regular customers like ChatGPT maker OpenAI is considering manufacturing its own chipset and are even evaluating a potential acquisition target.

Milestone Alert!Livemint tops charts as the fastest growing news website in the world 🌏 Click here to know more.

Updated: 14 Nov 2023, 07:23 AM IST