NVIDIA H100 SXM5 64 GB: specs and benchmarks
Summary
NVIDIA started H100 SXM5 64 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 4 nm manufacturing process and primarily aimed at designers. 64 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 3072 Bit memory interface this creates a bandwidth of 1,008 GB/s.
Compatibility-wise, this is a sxm module graphics card attached via PCIe 5.0 x16 interface. 8-pin EPS power connector is required, and power consumption is at 700 Watt.
Primary details
Some basic facts about H100 SXM5 64 GB: architecture, market segment, release date etc.
| Place in the ranking | not rated | |
| Place by popularity | not in top-100 | |
| Architecture | Hopper (2022−2023) | |
| GPU code name | GH100 | |
| Market segment | Workstation | |
| Release date | 21 March 2023 (1 year ago) |
Detailed specifications
H100 SXM5 64 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 SXM5 64 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.
| Pipelines / CUDA cores | 16896 | of 21760 (GeForce RTX 5090) |
| Core clock speed | 1665 MHz | of 2670 MHz (Arc B580) |
| Boost clock speed | 1980 MHz | of 3599 MHz (Radeon RX 7990 XTX) |
| Number of transistors | 80,000 million | of 208,000 million (B200 SXM 192 GB) |
| Manufacturing process technology | 4 nm | of 3 nm (Arc Graphics 140V) |
| Power consumption (TDP) | 700 Watt | of 2400 Watt (Data Center GPU Max Subsystem) |
| Texture fill rate | 1,045 | of 2,554 (Radeon Instinct MI300X) |
| Floating-point processing power | 66.91 TFLOPS | of 109.7 (GeForce RTX 5090) |
| ROPs | 24 | of 192 (Radeon RX 7900 XTX) |
| TMUs | 528 | of 1280 (Data Center GPU Max NEXT) |
| Tensor Cores | 528 | of 1216 (Radeon Instinct MI300X) |
Form factor & compatibility
This section provides details about the physical dimensions of H100 SXM5 64 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).
| Interface | PCIe 5.0 x16 | |
| Width | SXM Module | |
| Supplementary power connectors | 8-pin EPS |
VRAM capacity and type
Parameters of memory installed on H100 SXM5 64 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.
| Memory type | HBM3 | |
| Maximum RAM amount | 64 GB | of 294912 (Radeon Instinct MI325X) |
| Memory bus width | 3072 Bit | of 8192 Bit (Radeon Instinct MI250X) |
| Memory clock speed | 1313 MHz | of 20000 (RTX 5000 Ada Generation Mobile) |
| Memory bandwidth | 1,008 GB/s | of 5,171 GB/s (Radeon Instinct MI300X) |
Connectivity and outputs
Types and number of video connectors present on H100 SXM5 64 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.
| Display Connectors | No outputs |
API compatibility
APIs supported by H100 SXM5 64 GB, sometimes including their particular versions.
| DirectX | N/A | |
| Shader Model | N/A | |
| OpenGL | N/A | of 4.6 (GeForce RTX 4090) |
| OpenCL | 3.0 | |
| Vulkan | N/A | |
| CUDA | 9.0 |
AMD equivalent
According to our data, the closest AMD alternative to H100 SXM5 64 GB is Radeon PRO W7900.
Similar GPUs
Here is our recommendation of several graphics cards that are more or less close in performance to the one reviewed.
Recommended processors
These processors are most commonly used with H100 SXM5 64 GB according to our statistics.
