H100 SXM5 64 GB: specs and benchmarks
Contents
Summary
NVIDIA started H100 SXM5 64 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 5 nm manufacturing process and primarily aimed at designers. 64 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 3072 Bit memory interface this creates a bandwidth of 2.02 TB/s.
Compatibility-wise, this is a sxm module graphics card attached via PCIe 5.0 x16 interface. 8-pin EPS power connector is required, and power consumption is at 700 Watt.
Primary details
Some basic facts about H100 SXM5 64 GB: architecture, market segment, release date etc.
| Place in the ranking | not rated | |
| Place by popularity | not in top-100 | |
| Architecture | Hopper (2022−2024) | |
| GPU code name | GH100 | |
| Market segment | Workstation | |
| Release date | 21 March 2023 (3 years ago) |
Detailed specifications
H100 SXM5 64 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 SXM5 64 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.
| Pipelines / CUDA cores | 16896 | of 57344 (Rubin Ultra GPU) |
| Core clock speed | 1665 MHz | of 2670 MHz (Arc B580) |
| Boost clock speed | 1980 MHz | of 3130 MHz (Radeon RX 9060 XT 16 GB) |
| Number of transistors | 80,000 million | of 670,000 million (Rubin Ultra GPU) |
| Manufacturing process technology | 5 nm | of 2 nm (Radeon Instinct MI455X) |
| Power consumption (TDP) | 700 Watt | of 3600 Watt (Rubin Ultra GPU) |
| Texture fill rate | 1,045 | of 4,062.5 (Rubin Ultra GPU) |
| Floating-point processing power | 66.91 TFLOPS | of 260 (Rubin Ultra GPU) |
| ROPs | 24 | of 512 (Moore Threads MTT S4000) |
| TMUs | 528 | of 1792 (Rubin Ultra GPU) |
| Tensor Cores | 528 | of 1792 (Rubin Ultra GPU) |
| L1 Cache | 33 MB | of 112 MB (Rubin Ultra GPU) |
| L2 Cache | 30 MB | of 408 MB (Data Center GPU Max 1350) |
Form factor & compatibility
This section provides details about the physical dimensions of H100 SXM5 64 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).
| Interface | PCIe 5.0 x16 | |
| Width | SXM Module | |
| Supplementary power connectors | 8-pin EPS |
VRAM capacity and type
Parameters of memory installed on H100 SXM5 64 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.
| Memory type | HBM3 | |
| Maximum RAM amount | 64 GB | of 432 GB (Radeon Instinct MI455X) |
| Memory bus width | 3072 Bit | of 32768 Bit (Rubin Ultra GPU) |
| Memory clock speed | 1313 MHz | of 16000 GB/s (GeForce RTX 4050 Mobile) |
| Memory bandwidth | 2.02 TB/s | of 3,277 GB/s (Radeon Instinct MI250X) |
| Resizable BAR | + |
Connectivity and outputs
Types and number of video connectors present on H100 SXM5 64 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.
| Display Connectors | No outputs |
API and SDK support
APIs supported by H100 SXM5 64 GB, sometimes including their particular versions.
| DirectX | N/A | |
| Shader Model | N/A | |
| OpenGL | N/A | of 4.6 (GeForce RTX 5090 D) |
| OpenCL | 3.0 | |
| Vulkan | N/A | |
| CUDA | 9.0 | |
| DLSS | + |
AMD equivalent
According to our data, the closest AMD alternative to H100 SXM5 64 GB is Radeon PRO W7900.
Similar GPUs
Here is our recommendation of several graphics cards that are more or less close in performance to the one reviewed.
Recommended processors
These processors are most commonly used with H100 SXM5 64 GB according to our statistics.
