A100 PCIe 40 GB vs H100 PCIe

#ad 
Buy on Amazon
VS

Primary details

GPU architecture, market segment, value for money and other general parameters compared.

Place in the rankingnot ratednot rated
Place by popularitynot in top-100not in top-100
ArchitectureHopper (2022−2023)Ampere (2020−2024)
GPU code nameGH100GA100
Market segmentWorkstationWorkstation
Release date22 March 2022 (2 years ago)22 June 2020 (4 years ago)

Detailed specifications

General parameters such as number of shaders, GPU core base clock and boost clock speeds, manufacturing process, texturing and calculation speed. Note that power consumption of some graphics cards can well exceed their nominal TDP, especially when overclocked.

Pipelines / CUDA cores72966912
Core clock speed1065 MHz765 MHz
Boost clock speed1650 MHz1410 MHz
Number of transistors80,000 million54,200 million
Manufacturing process technology4 nm7 nm
Power consumption (TDP)350 Watt250 Watt
Texture fill rate752.4609.1
Floating-point processing power24.08 TFLOPS19.49 TFLOPS
ROPs24160
TMUs456432
Tensor Cores456432

Form factor & compatibility

Information on compatibility with other computer components. Useful when choosing a future computer configuration or upgrading an existing one. For desktop graphics cards it's interface and bus (motherboard compatibility), additional power connectors (power supply compatibility).

InterfacePCIe 5.0 x16PCIe 4.0 x16
Length267 mm267 mm
Width2-slot2-slot
Supplementary power connectors8-pin EPS8-pin EPS

VRAM capacity and type

Parameters of VRAM installed: its type, size, bus, clock and resulting bandwidth. Integrated GPUs have no dedicated video RAM and use a shared part of system RAM.

Memory typeHBM2eHBM2e
Maximum RAM amount80 GB40 GB
Memory bus width5120 Bit5120 Bit
Memory clock speed1000 MHz1215 MHz
Memory bandwidth1,280 GB/s1,555 GB/s

Connectivity and outputs

Types and number of video connectors present on the reviewed GPUs. As a rule, data in this section is precise only for desktop reference ones (so-called Founders Edition for NVIDIA chips). OEM manufacturers may change the number and type of output ports, while for notebook cards availability of certain video outputs ports depends on the laptop model rather than on the card itself.

Display ConnectorsNo outputsNo outputs

API compatibility

List of supported 3D and general-purpose computing APIs, including their specific versions.

DirectXN/AN/A
Shader ModelN/AN/A
OpenGLN/AN/A
OpenCL3.03.0
VulkanN/AN/A
CUDA9.08.0

Pros & cons summary


Recency 22 March 2022 22 June 2020
Maximum RAM amount 80 GB 40 GB
Chip lithography 4 nm 7 nm
Power consumption (TDP) 350 Watt 250 Watt

H100 PCIe has an age advantage of 1 year, a 100% higher maximum VRAM amount, and a 75% more advanced lithography process.

A100 PCIe 40 GB, on the other hand, has 40% lower power consumption.

We couldn't decide between H100 PCIe and A100 PCIe 40 GB. We've got no test results to judge.


Should you still have questions concerning choice between the reviewed GPUs, ask them in Comments section, and we shall answer.

Vote for your favorite

Do you think we are right or mistaken in our choice? Vote by clicking "Like" button near your favorite graphics card.


NVIDIA H100 PCIe
H100 PCIe
NVIDIA A100 PCIe 40 GB
A100 PCIe 40 GB

Comparisons with similar GPUs

We selected several comparisons of graphics cards with performance close to those reviewed, providing you with more options to consider.

Community ratings

Here you can see the user ratings of the compared graphics cards, as well as rate them yourself.


3.7 68 votes

Rate H100 PCIe on a scale of 1 to 5:

  • 1
  • 2
  • 3
  • 4
  • 5
3.4 8 votes

Rate A100 PCIe 40 GB on a scale of 1 to 5:

  • 1
  • 2
  • 3
  • 4
  • 5

Questions & comments

Here you can ask a question about this comparison, agree or disagree with our judgements, or report an error or mismatch.