Equipment / DOCUMENTATION & ENGINEERING CONTEXT

NVIDIA A100: Memory, Form Factors and Buying Requirements

An A100 purchase starts with the memory capacity and physical variant. A PCIe accelerator and an SXM module require different host systems, even when their product names look similar.

Identify the exact A100

The A100 family includes 40 GB and 80 GB products in PCIe and SXM form factors. Ask for the manufacturer part number and photograph of the identification label. A seller's short description should not be used to infer the memory capacity or the platform required.

References [1]

Reference specifications: 80 GB variants

The SXM power figure describes the standard configuration; NVIDIA documents a separate custom-thermal SKU with a higher limit. Use the exact SKU and platform power specification when planning an installation.

SpecificationA100 80 GB PCIeA100 80 GB SXM
Memory80 GB HBM2e80 GB HBM2e
Memory bandwidth1,935 GB/s2,039 GB/s
Standard maximum TDP300 W400 W
InstallationCompatible PCIe serverCompatible SXM/HGX platform
References [2]

Where an A100 belongs on a shortlist

Evaluate it when its memory, software support and delivered system cost fit the intended workload. Its position in an older generation can be commercially useful, but age is not evidence of either a bargain or poor condition. Compare a real quotation with alternatives using the same workload and support requirements.

For larger models, first check the artifact and execution method. Being able to load weights is different from meeting the required response time or concurrent user count.

Check the host before buying a card

Confirm the server's supported GPU list, slot arrangement, airflow, power connections and firmware. A passive accelerator depends on an appropriate cooling path. For an SXM offer, establish whether the sale includes only the module, the accelerator assembly or a complete working server.

In a multi-GPU configuration, document the installed links and the topology visible to the application. A photograph showing several accelerators does not establish the communication capabilities of the system.

Specify the acceptance conditions

Request serial-numbered inventory, diagnostic evidence, a defined load test and a written warranty. For a used server, the scope should cover all installed accelerators and the host system. Agree who bears the cost of a failed acceptance test or return shipment before payment.

For a quote, send the required memory, PCIe or SXM preference, quantity, condition preference, deployment country and whether you need cards or complete systems.

Sources and documentation

  1. NVIDIA A100 family datasheet, June 2021 ↗NVIDIA · checked 17 Nov 2026

    Page 1, 40 GB and 80 GB PCIe/SXM specifications

  2. NVIDIA A100 80 GB datasheet ↗NVIDIA · checked 17 Nov 2026

    Page 1 specification table; standard and custom thermal SKU footnote