H100 PCIe: specs and benchmarks

Summary

NVIDIA started H100 PCIe sales 22 March 2022. This is a desktop graphics card based on a Hopper architecture and made with 4 nm manufacturing process. It is primarily aimed at gamer market. 80 GB of HBM2e memory clocked at 2 GB/s are supplied, and together with 5120 Bit memory interface this creates a bandwidth of 1,280 GB/s.

Compatibility-wise, this is dual-slot card attached via PCIe 5.0 x16 interface. Its manufacturer default version has a length of 267 mm. 8-pin EPS power connector is required, and power consumption is at 350 Watt.

General info

Some basic facts about H100 PCIe: architecture, market segment, release date etc.

Place in performance ranking	not rated
Place by popularity	not in top-100
Architecture	Hopper (2022)
GPU code name	GH100
Market segment	Desktop
Release date	22 March 2022 (2 years ago)
Current price	$35000	of 168889 (A100 PCIe 80 GB)

Technical specs

H100 PCIe's specs such as number of shaders, GPU base clock, manufacturing process, texturing and calculation speed. These parameters indirectly speak of H100 PCIe's performance, but for precise assessment you have to consider its benchmark and gaming test results.

Pipelines / CUDA cores	7296	of 20480 (Data Center GPU Max NEXT)
Boost clock speed	1650 MHz	of 3599 (Radeon RX 7990 XTX)
Number of transistors	80,000 million	of 14400 (GeForce GTX 1070 SLI Mobile)
Manufacturing process technology	4 nm
Power consumption (TDP)	350 Watt	of 2400 (Data Center GPU Max Subsystem)
Texture fill rate	752.4	of 969.9 (H100 SXM5 96 GB)

Size and compatibility

This section provides details about the physical dimensions of H100 PCIe and its compatibility with other computer components. This information is useful when selecting a computer configuration or upgrading an existing one. For desktop graphics cards, it includes details about the interface and bus (for motherboard compatibility) and additional power connectors (for power supply compatibility).

Interface	PCIe 5.0 x16
Length	267 mm
Width	2-slot
Supplementary power connectors	8-pin EPS

Memory

Parameters of memory installed on H100 PCIe: its type, size, bus, clock and resulting bandwidth. Note that GPUs integrated into processors have no dedicated memory and use a shared part of system RAM instead.

Memory type	HBM2e
Maximum RAM amount	80 GB	of 192 (Radeon Instinct MI300X)
Memory bus width	5120 Bit	of 8192 (Radeon Instinct MI250X)
Memory clock speed	2 GB/s	of 23000 (GeForce RTX 4080 SUPER)
Memory bandwidth	1,280 GB/s	of 3276 (Aldebaran)

Video outputs and ports

Types and number of video connectors present on H100 PCIe. As a rule, this section is relevant only for desktop reference graphics cards, since for notebook ones the availability of certain video outputs depends on the laptop model, while non-reference desktop models can (though not necessarily will) bear a different set of video ports.

Display Connectors

No outputs

API support

APIs supported by H100 PCIe, sometimes including their particular versions.

DirectX	N/A
Shader Model	N/A
OpenGL	N/A	of 4.6 (GeForce RTX 4090)
OpenCL	3.0
Vulkan	N/A
CUDA	9.0

Benchmark performance

Synthetic benchmark performance of H100 PCIe. The combined score is measured on a 0-100 point scale.

---