nvidia-logo

Nvidia B100

Blackwell-based data center GPU designed for large-scale AI training, high-performance inference, and next-generation generative AI workloads.

Release

2024

GPU Class

Data Center / AI Accelerator

Architecture

Blackwell

PRICE SNAPSHOT

Loading price comparison...
Loading live GPU prices...

On-premise Module

~$25k–$40k*

Turnkey System

~$400k–$600k†

Cloud Pricing
(per GPU/hr)

~$2.00–$7.00/hr‑

chip identity

nvidiaB100

On-premise Module

B100

GPU Class

Data Center / AI Accelerator

Release

2024

Architecture

Blackwell

Target Workload

  • Large-scale LLM training
  • Generative AI model development
  • Multi-modal AI workloads
  • High-throughput inference systems
  • Distributed deep learning clusters

Compatible Platforms

  • HGX B100 baseboards
  • DGX-class AI training systems
  • OEM high-density GPU servers
  • Large-scale AI cloud infrastructure

Interconnect: NVLink 5

Software Stack: CUDA, cuDNN, TensorRT, NVIDIA AI Enterprise

Ideal Buyer Profile

Organizations that typically deploy B100 GPUs include:

  • Hyperscale cloud providers operating large AI clusters
  • AI research labs developing foundation models
  • Enterprises building generative AI platforms
  • Institutions training large transformer-based models

The GPU is particularly attractive for buyers requiring cutting-edge AI training hardware with high cluster scalability.

Availability Notes

The B100 is deployed primarily through high-end AI training systems and large cloud infrastructure platforms. Availability may initially be limited due to the complexity of advanced semiconductor manufacturing and the strong demand for Blackwell-based GPUs.

Because of its positioning in large-scale AI infrastructure, the B100 is typically deployed in multi-GPU server nodes and hyperscale AI clusters.

Recent Developments

  • Announcement of Blackwell-based GPU platforms targeting generative AI workloads.
  • Integration of B100 GPUs into next-generation AI training systems and cloud infrastructure.

Increasing adoption of Blackwell architecture for large-scale generative AI deployments.

overview

The NVIDIA B100 is a high-performance data center GPU built on the Blackwell architecture, designed to support next-generation AI training and inference workloads. It represents a major evolution beyond the Hopper architecture, delivering substantial improvements in tensor performance, memory bandwidth, and energy efficiency.

Blackwell GPUs introduce fifth-generation Tensor Cores, optimized for modern deep learning workloads including large language models, generative AI systems, and multi-modal models. These improvements enable higher throughput for low-precision AI operations such as FP8 and FP4, which are increasingly used in large-scale training pipelines.

The B100 is typically deployed in large AI training clusters that require high compute density and fast GPU-to-GPU communication. Through technologies such as NVLink 5 interconnects and advanced memory subsystems, the architecture enables efficient scaling across multi-GPU and multi-node training environments.

Key specifications

B100 GPU Specifications

B100 GPU Specifications

Specification Value
Architecture NVIDIA Blackwell
CUDA Cores ~15,000+ (estimated configuration)
Tensor Cores 5th Gen Tensor Cores
Memory 192 GB HBM3e
Memory Bandwidth ~8 TB/s
Interconnect NVLink 5
Form Factor SXM
Max TGP ~700-1000 W
Precision Support FP64, TF32, FP32, FP16, BF16, FP8, FP4
Typical AI Compute ~10-15 PFLOPS (FP4 Tensor, estimated)
Process Node TSMC 4NP
Transistor Count ~200+ Billion
MIG Support Supported
NVLink (Peer) ~1.8 TB/s bidirectional

Performance Summary

  • AI Training: The B100 is optimized for training large transformer-based models, including multi-trillion parameter language models.
  • Tensor Performance: Fifth-generation Tensor Cores accelerate low-precision formats such as FP8 and FP4 for efficient generative AI training.
  • Memory Bandwidth: High-bandwidth HBM3e memory supports large model parameters and high-throughput training workloads.
  • Cluster Scaling: NVLink 5 provides extremely high bandwidth for communication between GPUs in large training clusters.

Compared with Hopper GPUs such as the H100 and H200, the B100 delivers significantly improved tensor throughput and memory capacity for large-scale AI workloads.

primary use case

  • AI Training: The B100 is optimized for training large transformer-based models, including multi-trillion parameter language models.
  • Tensor Performance: Fifth-generation Tensor Cores accelerate low-precision formats such as FP8 and FP4 for efficient generative AI training.
  • Memory Bandwidth: High-bandwidth HBM3e memory supports large model parameters and high-throughput training workloads.
  • Cluster Scaling: NVLink 5 provides extremely high bandwidth for communication between GPUs in large training clusters.

Compared with Hopper GPUs such as the H100 and H200, the B100 delivers significantly improved tensor throughput and memory capacity for large-scale AI workloads.

Alternatives & Upgrade Path

Comparable NVIDIA GPUs:

  • H100: Hopper-generation GPU widely used for AI training.
  • H200: Hopper refresh with increased memory capacity.
  • B200: Higher-end Blackwell GPU with expanded compute and memory capabilities.

Competitor Accelerators:

These accelerators compete in the market for large-scale AI training infrastructure.

Related Chips & Providers

Related NVIDIA GPUs:

  • B200
  • H200
  • H100

Competing AI Hardware:

  • AMD MI300X
  • Intel Gaudi 3

SUMMARY

The NVIDIA B100 is a high-performance data center GPU designed for large-scale AI training and inference workloads. Built on the Blackwell architecture, it introduces major improvements in tensor performance, memory bandwidth, and multi-GPU interconnect capabilities.

With support for advanced precision formats such as FP8 and FP4, the B100 enables highly efficient training of modern generative AI models and large language models. As part of NVIDIA’s Blackwell GPU lineup, it serves as a key accelerator for next-generation AI infrastructure and hyperscale training clusters.

The next GPU to add should be NVIDIA GB200.

This is important because:

  • It’s the Grace + Blackwell β€œsuperchip”
  • Appears in GB200 NVL72 racks, one of the most talked-about AI cluster systems
  • Used in hyperscaler AI infrastructure announcements
  • Completes the Blackwell ecosystem pages alongside B100 and B200

Below is the page written in the same structure as your other GPU pages.

Newsletter

Stay Ahead in Cloud
& Data Infrastructure

Get early access to new tools, insights, and research shaping the next wave of cloud and storage innovation.