H100 SXM5 96 GB: specs and benchmarks
Contents
Summary
NVIDIA started H100 SXM5 96 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 5 nm manufacturing process and primarily aimed at designers. 96 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 5120 Bit memory interface this creates a bandwidth of 3.36 TB/s.
Compatibility-wise, this is a sxm module graphics card attached via PCIe 5.0 x16 interface. 8-pin EPS power connector is required, and power consumption is at 700 Watt.
Primary details
Some basic facts about H100 SXM5 96 GB: architecture, market segment, release date etc.
| Place in the ranking | not rated | |
| Place by popularity | not in top-100 | |
| Architecture | Hopper (2022−2024) | |
| GPU code name | GH100 | |
| Market segment | Workstation | |
| Release date | 21 March 2023 (2 years ago) |
Detailed specifications
H100 SXM5 96 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 SXM5 96 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.
| Pipelines / CUDA cores | 16896 | of 960 (GeForce GTX 660) |
| Core clock speed | 1350 MHz | of 980 (GeForce GT 755M SLI) |
| Boost clock speed | 1980 MHz | of 1000 (HD Graphics (Haswell)) |
| Number of transistors | 80,000 million | of 100,000 million (Data Center GPU Max 1100) |
| Manufacturing process technology | 5 nm | of 0.003 MB (Arc Graphics 140V) |
| Power consumption (TDP) | 700 Watt | of 235 (FirePro S9150) |
| Texture fill rate | 1,045 | of 1,968.0 (RTX PRO 6000 Blackwell Server) |
| Floating-point processing power | 66.91 TFLOPS | of 126 (RTX PRO 6000 Blackwell Server) |
| ROPs | 24 | of 512 (Moore Threads MTT S4000) |
| TMUs | 528 | of 896 (Data Center GPU Max 1350) |
| Tensor Cores | 528 | of 896 (Data Center GPU Max 1350) |
| L1 Cache | 33 MB | of 64 MB (Data Center GPU Max 1550) |
| L2 Cache | 50 MB | of 408 MB (Data Center GPU Max 1350) |
Form factor & compatibility
This section provides details about the physical dimensions of H100 SXM5 96 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).
| Interface | PCIe 5.0 x16 | |
| Width | SXM Module | |
| Supplementary power connectors | 8-pin EPS |
VRAM capacity and type
Parameters of memory installed on H100 SXM5 96 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.
| Memory type | HBM3 | |
| Maximum RAM amount | 96 GB | of 288 GB (Radeon Instinct MI325X) |
| Memory bus width | 5120 Bit | of 384 (GeForce GTX 980 Ti) |
| Memory clock speed | 1313 MHz | of 16384000 MB (GeForce RTX 4050 Mobile) |
| Memory bandwidth | 3.36 TB/s | of 983040 MB (GeForce RTX 5080) |
| Resizable BAR | + |
Connectivity and outputs
Types and number of video connectors present on H100 SXM5 96 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.
| Display Connectors | No outputs |
API and SDK support
APIs supported by H100 SXM5 96 GB, sometimes including their particular versions.
| DirectX | N/A | |
| Shader Model | N/A | |
| OpenGL | N/A | of 4.6 (RTX PRO 5000 Blackwell) |
| OpenCL | 3.0 | |
| Vulkan | N/A | |
| CUDA | 9.0 | |
| DLSS | + |
AMD equivalent
According to our data, the closest AMD alternative to H100 SXM5 96 GB is Radeon PRO W7900.
Similar GPUs
Here is our recommendation of several graphics cards that are more or less close in performance to the one reviewed.
Recommended processors
These processors are most commonly used with H100 SXM5 96 GB according to our statistics.
