NVIDIA A100: Memory, Form Factors and Buying Requirements
An A100 purchase starts with the memory capacity and physical variant. A PCIe accelerator and an SXM module require different host systems, even when their product names look similar.
Identify the exact A100
The A100 family includes 40 GB and 80 GB products in PCIe and SXM form factors. Ask for the manufacturer part number and photograph of the identification label. A seller's short description should not be used to infer the memory capacity or the platform required.
Reference specifications: 80 GB variants
The SXM power figure describes the standard configuration; NVIDIA documents a separate custom-thermal SKU with a higher limit. Use the exact SKU and platform power specification when planning an installation.
| Specification | A100 80 GB PCIe | A100 80 GB SXM |
|---|---|---|
| Memory | 80 GB HBM2e | 80 GB HBM2e |
| Memory bandwidth | 1,935 GB/s | 2,039 GB/s |
| Standard maximum TDP | 300 W | 400 W |
| Installation | Compatible PCIe server | Compatible SXM/HGX platform |
Where an A100 belongs on a shortlist
Evaluate it when its memory, software support and delivered system cost fit the intended workload. Its position in an older generation can be commercially useful, but age is not evidence of either a bargain or poor condition. Compare a real quotation with alternatives using the same workload and support requirements.
For larger models, first check the artifact and execution method. Being able to load weights is different from meeting the required response time or concurrent user count.
Check the host before buying a card
Confirm the server's supported GPU list, slot arrangement, airflow, power connections and firmware. A passive accelerator depends on an appropriate cooling path. For an SXM offer, establish whether the sale includes only the module, the accelerator assembly or a complete working server.
In a multi-GPU configuration, document the installed links and the topology visible to the application. A photograph showing several accelerators does not establish the communication capabilities of the system.
Specify the acceptance conditions
Request serial-numbered inventory, diagnostic evidence, a defined load test and a written warranty. For a used server, the scope should cover all installed accelerators and the host system. Agree who bears the cost of a failed acceptance test or return shipment before payment.
For a quote, send the required memory, PCIe or SXM preference, quantity, condition preference, deployment country and whether you need cards or complete systems.
Sources and documentation
- NVIDIA A100 family datasheet, June 2021 ↗NVIDIA · checked 17 Nov 2026
Page 1, 40 GB and 80 GB PCIe/SXM specifications
- NVIDIA A100 80 GB datasheet ↗NVIDIA · checked 17 Nov 2026
Page 1 specification table; standard and custom thermal SKU footnote