NVIDIA H100 NVL 94 GB: specs and benchmarks
Contents
Summary
NVIDIA started H100 NVL 94 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 5 nm manufacturing process and primarily aimed at designers. 94 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 6016 Bit memory interface this creates a bandwidth of 3.94 TB/s.
Compatibility-wise, this is a dual-slot graphics card attached via PCIe 5.0 x16 interface. Its manufacturer default version has a length of 267 mm. 8-pin EPS power connector is required, and power consumption is at 400 Watt.
Primary details
Some basic facts about H100 NVL 94 GB: architecture, market segment, release date etc.
| Place in the ranking | not rated | |
| Place by popularity | not in top-100 | |
| Architecture | Hopper (2022−2024) | |
| GPU code name | GH100 | |
| Market segment | Workstation | |
| Release date | 21 March 2023 (2 years ago) |
Detailed specifications
H100 NVL 94 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 NVL 94 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.
| Pipelines / CUDA cores | 16896 | of 24064 (RTX PRO 6000 Blackwell) |
| Core clock speed | 1080 MHz | of 2670 MHz (Arc B580) |
| Boost clock speed | 1785 MHz | of 3230 MHz (Radeon RX 9060 XT) |
| Number of transistors | 80,000 million | of 185,000 million (Radeon Instinct MI350X) |
| Manufacturing process technology | 5 nm | of 3 nm (Arc Graphics 140V) |
| Power consumption (TDP) | 400 Watt | of 2400 Watt (Data Center GPU Max Subsystem) |
| Texture fill rate | 942.5 | of 2,554 (Radeon Instinct MI300X) |
| Floating-point processing power | 60.32 TFLOPS | of 126 (RTX PRO 6000 Blackwell) |
| ROPs | 24 | of 512 (Moore Threads MTT S4000) |
| TMUs | 528 | of 1280 (Data Center GPU Max NEXT) |
| Tensor Cores | 528 | of 1216 (Radeon Instinct MI300X) |
Form factor & compatibility
This section provides details about the physical dimensions of H100 NVL 94 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).
| Interface | PCIe 5.0 x16 | |
| Length | 267 mm | |
| Width | 2-slot | |
| Supplementary power connectors | 8-pin EPS |
VRAM capacity and type
Parameters of memory installed on H100 NVL 94 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.
| Memory type | HBM3 | |
| Maximum RAM amount | 94 GB | of 288 GB (Radeon Instinct MI325X) |
| Memory bus width | 6016 Bit | of 8192 Bit (Radeon Instinct MI250X) |
| Memory clock speed | 1310 MHz | of 16000 GB/s (GeForce RTX 4050 Mobile) |
| Memory bandwidth | 3.94 TB/s | of 5,171 GB/s (Radeon Instinct MI300X) |
| Resizable BAR | + |
Connectivity and outputs
Types and number of video connectors present on H100 NVL 94 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.
| Display Connectors | No outputs |
API and SDK compatibility
APIs supported by H100 NVL 94 GB, sometimes including their particular versions.
| DirectX | N/A | |
| Shader Model | N/A | |
| OpenGL | N/A | of 4.6 (GeForce RTX 5090 D) |
| OpenCL | 3.0 | |
| Vulkan | N/A | |
| CUDA | 9.0 | |
| DLSS | + |
AMD equivalent
According to our data, the closest AMD alternative to H100 NVL 94 GB is Radeon PRO W7900.
Similar GPUs
Here is our recommendation of several graphics cards that are more or less close in performance to the one reviewed.
