NVIDIA H100 NVL 94 GB: specs and benchmarks

Summary

NVIDIA started H100 NVL 94 GB sales 21 March 2023. This is a Hopper architecture desktop card based on 5 nm manufacturing process and primarily aimed at designers. 94 GB of HBM3 memory clocked at 1.31 GHz are supplied, and together with 6016 Bit memory interface this creates a bandwidth of 3.94 TB/s.

Compatibility-wise, this is a dual-slot graphics card attached via PCIe 5.0 x16 interface. Its manufacturer default version has a length of 267 mm. 8-pin EPS power connector is required, and power consumption is at 400 Watt.

Primary details

Some basic facts about H100 NVL 94 GB: architecture, market segment, release date etc.

Place in the ranking	not rated
Place by popularity	not in top-100
Architecture	Hopper (2022−2024)
GPU code name	GH100
Market segment	Workstation
Release date	21 March 2023 (2 years ago)

Detailed specifications

H100 NVL 94 GB's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 NVL 94 GB's performance, but for precise assessment you have to consider its benchmark and gaming test results.

Pipelines / CUDA cores	16896	of 960 (GeForce GTX 660)
Core clock speed	1080 MHz	of 980 (GeForce GT 755M SLI)
Boost clock speed	1785 MHz	of 1000 (HD Graphics (Haswell))
Number of transistors	80,000 million	of 100,000 million (Data Center GPU Max 1100)
Manufacturing process technology	5 nm	of 0.003 MB (Arc Graphics 140V)
Power consumption (TDP)	400 Watt	of 235 (FirePro S9150)
Texture fill rate	942.5	of 1,968 (RTX PRO 6000 Blackwell)
Floating-point processing power	60.32 TFLOPS	of 126 (RTX PRO 6000 Blackwell)
ROPs	24	of 512 (Moore Threads MTT S4000)
TMUs	528	of 896 (Data Center GPU Max 1350)
Tensor Cores	528	of 896 (Data Center GPU Max 1350)
L1 Cache	33 MB	of 64 MB (Data Center GPU Max 1550)
L2 Cache	50 MB	of 408 MB (Data Center GPU Max 1350)

Form factor & compatibility

This section provides details about the physical dimensions of H100 NVL 94 GB and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).

Interface	PCIe 5.0 x16
Length	267 mm
Width	2-slot
Supplementary power connectors	8-pin EPS

VRAM capacity and type

Parameters of memory installed on H100 NVL 94 GB: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.

Memory type	HBM3
Maximum RAM amount	94 GB	of 288 GB (Radeon Instinct MI325X)
Memory bus width	6016 Bit	of 384 (GeForce GTX 980 Ti)
Memory clock speed	1310 MHz	of 16384000 MB (GeForce RTX 4050 Mobile)
Memory bandwidth	3.94 TB/s	of 983040 MB (GeForce RTX 5080)
Resizable BAR	+

Connectivity and outputs

Types and number of video connectors present on H100 NVL 94 GB. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.

Display Connectors

No outputs

API and SDK support

APIs supported by H100 NVL 94 GB, sometimes including their particular versions.

DirectX	N/A
Shader Model	N/A
OpenGL	N/A	of 4.6 (RTX PRO 5000 Blackwell)
OpenCL	3.0
Vulkan	N/A
CUDA	9.0
DLSS	+

Benchmark performance

Synthetic benchmark performance of H100 NVL 94 GB. The combined score is measured on a 0-100 point scale.

---

---