H100 SXM5 96 GB: specs and benchmarks

VS

Summary

NVIDIA started H100 SXM5 96 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 5 nm manufacturing process and primarily aimed at designers. 96 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 5120 Bit memory interface this creates a bandwidth of 3.36 TB/s.

Compatibility-wise, this is a sxm module graphics card attached via PCIe 5.0 x16 interface. 8-pin EPS power connector is required, and power consumption is at 700 Watt.

Primary details

Some basic facts about H100 SXM5 96 GB: architecture, market segment, release date etc.

Place in the rankingnot rated
Place by popularitynot in top-100
ArchitectureHopper (2022−2024)
GPU code nameGH100
Market segmentWorkstation
Release date21 March 2023 (2 years ago)

Detailed specifications

H100 SXM5 96 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 SXM5 96 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.

Pipelines / CUDA cores16896of 960 (GeForce GTX 660)
Core clock speed1350 MHzof 980 (GeForce GT 755M SLI)
Boost clock speed1980 MHzof 1000 (HD Graphics (Haswell))
Number of transistors80,000 millionof 100,000 million (Data Center GPU Max 1100)
Manufacturing process technology5 nmof 0.003 MB (Arc Graphics 140V)
Power consumption (TDP)700 Wattof 235 (FirePro S9150)
Texture fill rate1,045of 1,968 (RTX PRO 6000 Blackwell)
Floating-point processing power66.91 TFLOPSof 126 (RTX PRO 6000 Blackwell)
ROPs24of 512 (Moore Threads MTT S4000)
TMUs528of 896 (Data Center GPU Max 1350)
Tensor Cores528of 896 (Data Center GPU Max 1350)
L1 Cache33 MBof 64 MB (Data Center GPU Max 1550)
L2 Cache50 MBof 408 MB (Data Center GPU Max 1350)

Form factor & compatibility

This section provides details about the physical dimensions of H100 SXM5 96 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).

InterfacePCIe 5.0 x16
WidthSXM Module
Supplementary power connectors8-pin EPS

VRAM capacity and type

Parameters of memory installed on H100 SXM5 96 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.

Memory typeHBM3
Maximum RAM amount96 GBof 288 GB (Radeon Instinct MI325X)
Memory bus width5120 Bitof 384 (GeForce GTX 980 Ti)
Memory clock speed1313 MHzof 16384000 MB (GeForce RTX 4050 Mobile)
Memory bandwidth3.36 TB/sof 983040 MB (GeForce RTX 5080)
Resizable BAR+

Connectivity and outputs

Types and number of video connectors present on H100 SXM5 96 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.

Display ConnectorsNo outputs

API and SDK support

APIs supported by H100 SXM5 96 GB, sometimes including their particular versions.

DirectXN/A
Shader ModelN/A
OpenGLN/Aof 4.6 (RTX PRO 5000 Blackwell)
OpenCL3.0
VulkanN/A
CUDA9.0
DLSS+

Benchmark performance

Synthetic benchmark performance of H100 SXM5 96 GB. The combined score is measured on a 0-100 point scale.



We have no data on H100 SXM5 96 GB benchmark results.


AMD equivalent

According to our data, the closest AMD alternative to H100 SXM5 96 GB is Radeon PRO W7900.

Similar GPUs

Here is our recommendation of several graphics cards that are more or less close in performance to the one reviewed.

Recommended processors

These processors are most commonly used with H100 SXM5 96 GB according to our statistics.

All comparisons with H100 SXM5 96 GB

Community ratings

Here you can see the user rating of the graphics card, as well as rate it yourself.


3.7 63 votes

Rate H100 SXM5 96 GB on a scale of 1 to 5:

  • 1
  • 2
  • 3
  • 4
  • 5

Comments

Here you can give us your opinion about H100 SXM5 96 GB, agree or disagree with our ratings, or report errors or inaccuracies on the site.