NVIDIA H100: Variants, System Requirements and Purchase Checks
The H100 name covers different installation paths. Confirm the exact variant, memory per GPU and contents of the offer before comparing the price of a card, a pair or a full server.
What changes with H100
H100 is based on NVIDIA's Hopper architecture and includes a Transformer Engine with FP8 support. Whether a workload benefits depends on its software path and numerical format; an architecture-level claim is not a measured speedup for your application.
Read the variant and bundle description
NVIDIA's published SXM specification lists up to 700 W configurable power. Its NVL specification lists 350-400 W. These are GPU figures, not total server draw. Two 94 GB GPUs represent 188 GB installed across two devices; application access depends on the execution method.
| Variant or description | What to establish |
|---|---|
| H100 SXM | 80 GB per GPU; requires a supported SXM system |
| H100 NVL | 94 GB per GPU; state how many GPUs and links the offer contains |
| H100 PCIe listing | Request the exact part number and its own specification sheet |
Choose a complete execution path
Start with the model release, precision, context and target traffic. Check whether the runtime supports the relevant kernels and how it uses multiple devices. A higher peak compute figure does not settle time to first token, throughput or cost per completed job.
If the model needs multiple GPUs, include the interconnect and host configuration in the decision. If one device is enough, compare an appropriately configured single-GPU system with the full cost of a larger platform.
Confirm the server and facility
Request CPU, RAM, boot and data storage, networking, management, firmware and all GPU identities. Check the approved chassis configuration, airflow, rack depth, connector types and electrical capacity with whoever operates the facility. A nominal PSU rating is not the same as a measured operating requirement.
For used hardware, ask for diagnostic output tied to the installed serial numbers and a clear acceptance process. Where hardware is sold as unused, confirm the warranty provider and start date rather than assuming manufacturer coverage transfers.
Prepare a useful sourcing enquiry
State variant or acceptable alternatives, quantity, card-only or complete-system preference, condition and installation country. We can compare the equipment and commercial terms in one enquiry. Any export review must apply to the actual equipment, parties and intended use.
Sources and documentation
- NVIDIA H100 product specifications ↗NVIDIA · checked 17 Nov 2026
Product Specifications: H100 SXM and H100 NVL; Hopper and Transformer Engine sections