The semiconductor industry has long understood that dynamically varying voltage droop exists in high-performance processors and has designed circuits and systems to monitor such supply voltage variations. What it has not had is an ability to visualize, pre-silicon, how cumulative voltage droops form and propagate in a large multi-core chip's 3D power delivery network under realistic workloads allocated to the cores. A 158-grid model of the NVIDIA® H100 built in PDNLab™ changes that situation considerably.

The Complexity of Modern AI Silicon

The NVIDIA® H100[4] is perhaps the most widely deployed AI accelerator in production. The Hopper-architecture GPU contains ~80 billion transistors on an 814 mm² die, fabricated on TSMC's 4N process, consuming up to 700 watts in its SXM5 configuration at a supply voltage of 1.1 V. These are extraordinary numbers. Every characteristic that makes the H100 a powerful AI training engine[1] also makes it a challenging power delivery and management problem. Supply current levels are extreme, and voltage margins are thin. The switching activity is temporally and spatially complex.

The industry has historically lacked the ability to model what actually happens inside such a chip when block current demand changes rapidly and spatiotemporally[6]. Full-chip extraction tools that work with the physical design exist, but they are slow, expensive, and generally inaccessible to architects making early-stage decisions about power delivery or power management. The result is that voltage droop analysis has remained a specialized design verification activity, performed late in the design cycle, producing results that are difficult to employ in optimization and nearly impossible to iterate on quickly.

Using published architectural specifications and TSMC process-node data[2], a full-stack power delivery network model of the H100 was constructed in PDNLab. The model captures the complete path from board-level capacitors through the package substrate and bump array down to all 144 individual Streaming Multiprocessor cores on the die. It contains 158 interconnected grids, 175 current sources, 146 decoupling capacitors, 794 transmission lines, and over 1,500 connection nodes. This model is simulated in minutes in PDNLab rather than hours or days as is typical with 'IR Drop' tools. This article describes how it was built, what assumptions were made, and what the simulation results reveal about the spatiotemporal behavior of voltage droop in modern chips.

Power Delivery Path from Board to Transistors

Power supply energy does not arrive at the transistor in ideal form. It passes through a series of conversion and distribution stages, each with distinct electrical characteristics, each introducing impedance that shapes how voltage responds to transient current demand. Understanding the structure of this path is essential to understanding why droop occurs where and when it does.

The H100's power delivery system spans four physical layers. At the outermost level, the SXM5 carrier board supplies power from more than thirty voltage regulator modules through heavy copper planes. The package substrate, based on TSMC's CoWoS-S technology, routes power from edge-mounted connectors through a multi-layer organic PCB to the silicon. A dense array of approximately five thousand solder bumps connects the package to the die, each with a resistance on the order of 0.15 mΩ. On the die itself, a hierarchical power grid distributes current across the full 28.5 mm × 28.5 mm die area, from thick top-metal global straps down through intermediate layers to the local grids feeding individual computing cores and their transistors.

Board PDN (SXM5 Carrier) 30+ VRMs · Heavy copper planes · Modeled as lumped impedance V V Package Substrate (CoWoS-S) Multi-layer organic · Land-side decaps · HBM3 integration ~5,000 bumps Global On-Die PDN (est. M14–M15) 28.5 mm × 28.5 mm · 0.03 Ω/□ sheet resistance Via stacks Core Power Grid (est. M7–M8) 144 SMs ~1.1–0.6 V Level 1 Level 2 Level 3 Level 4 Current flow ← Increasing spatial resolution · Decreasing electrical distance to transistors →
Cross-section of the H100 power delivery stack as modeled in PDNLab. Current flows from board-level VRMs through the package substrate and bump array into the on-die global and core power grids feeding 144 individual SM cores.

This layered structure is not unique to the H100. Every modern high-performance processor uses some version of it. What makes the H100 particularly interesting as a modeling subject is the scale. The die size is large, and integrated core count is high. Its power demand is extreme. The result is a power delivery network where the spatial distribution and temporal activation of current demand directly determines the severity and location of voltage droop.

The GH100 die measures approximately 28.5 mm × 28.5 mm. It contains 144 Streaming Multiprocessors organized into 8 Graphics Processing Clusters, along with memory controllers, NVLink engines, and a PCIe block. Given TSMC's 4N process with up to 15 metal layers, the die almost certainly uses a hierarchical power delivery network. The uppermost thick metal layers, likely M14–M15, provide low-resistance global power distribution across the full die area. Intermediate semi-global layers, likely M7–M8, distribute power locally within individual SM core regions. Dense arrays of stacked vias connect these grid levels, with millions of vias in parallel across each SM core area reducing the effective vertical resistance to the sub-micro-Ω range. NVIDIA does not publish exact metal layer assignments, but this two-level hierarchy is consistent with standard practice at advanced nodes.

Constructing the Model

The modeling approach begins where the droop events that matter most actually occur: on the die. The 814 mm² GH100 die is decomposed into functional blocks — SM cores, L2 cache, memory controllers, and NVLink I/O — each represented as a grid element with physically derived electrical parameters. The board and package are represented as lumped impedance feeding into this on-die network. This abstraction is a deliberate choice. Voltage droop events often occur in nanosecond timescales. At those frequencies, the board PDN cannot respond quickly enough to influence the droop waveform because of its electrical distance from the die. A spatially resolved board grid would add computational cost without changing the results. The lumped board representation does not change the accuracy of relevant die-level behavior.

PDNLab™
The H100 power delivery network as rendered in PDNLab. The hierarchical model decomposes the full delivery path — from board-level VRMs through the package substrate and bump array down to 144 individual SM core grids on the die — into tractable grid elements, each with physically derived electrical parameters.

Die-Level Block Decomposition

The first step in constructing the model is dividing the die into functional blocks with estimated area allocations. Using an approximate 60/15/15/10 power budget split as a proxy for area, the 814 mm² die is partitioned as follows:

Functional BlockArea AllocationEstimated AreaGrid Dimensions in Model
144 SM Cores~60% (~488 mm²)~3.39 mm² per SM1.84 mm × 1.84 mm each
L2 Cache (2 partitions)~10% (~81 mm²)~40.5 mm² per partition1.04 cm × 0.18 cm each
HBM3 Memory Controllers (10)~15% (~122 mm²)~12.2 mm² per controllerDistributed along die edges
NVLink + PCIe I/O~15% (~122 mm²)Combined I/O blockGrid along bottom edge

Each block in the model is represented as a two-dimensional power grid with its own sheet resistance, inductance, capacitance, and attached current sources. The grid dimensions are derived from the area estimates above. Beyond the 144 SM cores, the model includes dedicated grids for every major functional block: two L2 cache grids flanking the SM array, ten grids along the left and right die edges for first-generation HBM3 memory controller pairs, and a NVLink bus grid along the bottom edge carrying 18 current sources representing the fourth-generation NVLink engine PHYs. This level of functional decomposition ensures that the current distribution across the die reflects the actual H100 architecture, not just the compute cores but the memory subsystem and high-speed I/O that together account for 30 to 40 percent of total power consumption.

Deriving On-Die Capacitance from Transistor Physics

Perhaps the most important parameter for each block is its on-die decoupling capacitance. This is the intrinsic charge storage that resists voltage droop during current transients. In any real processor, this capacitance comes from multiple sources: the gate oxide of transistors themselves, Metal-Insulator-Metal decoupling capacitors integrated within upper metal layers, inter-wire coupling capacitance in the power grid and signal wires, and junction capacitance of transistors.

The derivation begins with TSMC 4N transistor physics. The gate capacitance at this node is approximately 0.18 to 0.22 fF per transistor. With 80 billion transistors across 814 mm², the total intrinsic transistor gate capacitance is approximately 16 µF, yielding a unit capacitance density of roughly 19.66 nF/mm². Incidentally, this device capacitance number yields ~350 W power consumption at a supply voltage of 0.6 V, operating frequency of 690 MHz, and an activity factor of ~0.1 (this used to be 0.05, but since interconnect power consumption equals or exceeds device capacitance contributions, it is doubled in this simplification).

StepCalculationResult
Gate capacitance per min-sized transistor~0.2 fF (midpoint of 0.18–0.22 fF)0.2 × 10-15 F
Total transistor capacitance80 × 109 × 0.2 × 10-15 F~16 µF
Area device capacitance density16 µF ÷ 814 mm²~19.66 nF/mm²

This unit density lets us estimate intrinsic capacitance for any block based on its area. However, the model values are intentionally set higher than pure transistor-capacitance calculations, because the on-die power grid includes additional capacitance sources beyond gate oxide. The adjusted values reflect a physically reasonable total that accounts for all contributions:

BlockAreaCalculated C (area × 19.66 nF/mm²)Model Value (adjusted)Notes
SM Core (each)~3.39 mm²~66.6 nF110 nFAdjusted upward for MiM decoupling capacitors in upper metal layers
L2 Cache (each partition)~40.5 mm²~796 nF2 µFSRAM structures have higher per-area capacitance than logic
HBM3 Memory Controller (each)~12.2 mm²~240 nF300 nFI/O circuitry with moderate decoupling
NVLink I/O~122 mm²~2.4 µF2.5 µFHigh-speed SerDes PHYs with local decoupling

Power Grid Electrical Parameters

Beyond capacitance, each grid element is characterized by wire geometry and electrical properties. The model uses two distinct grid tiers, each derived from published TSMC process-node characteristics for the 5nm/4N family.

The global on-die power distribution network covers the full 28.5 mm × 28.5 mm die area using the uppermost metal layers:

ParameterValueSource / Rationale
Grid size2.85 cm × 2.85 cmGH100 die dimensions (814 mm²)
Wire width3 µmWide power straps in top global metal
Wire spacing15 µmPower strap pitch for HPC designs
Sheet resistance0.03 Ω/□TSMC 4N top global metal (~0.8–1.2 µm thick Cu)
Inductance3 nH/cmClosely spaced Vdd/Vss in M14 & M15
Capacitance2 pF/cmGlobal power wire self-capacitance

All 144 Streaming Multiprocessors are modeled as individual grids with their own current sources and decoupling capacitors:

ParameterValueSource / Rationale
Grid size1.84 mm × 1.84 mmSM core area ≈ 3.39 mm² (488 mm² ÷ 144)
Wire width1 µmSemi-global metal routing width
Wire spacing10 µmLocal power distribution pitch
Sheet resistance0.3 Ω/□TSMC 4N semi-global layers (estimated M7–M8)
Inductance5 nH/cmSemi-global layer pair
Capacitance3 pF/cmCore grid self-capacitance

Current profiles and Cumulative Voltage Droop

A power delivery network model on its own is complex but static. What brings it to life is the varying current demand that flows through it. In PDNLab, every current source is assigned a piece-wise linear waveform specifying current draw as a function of time. The simulator steps through these profiles at each timestep in each simulation resolution area element taking into consideration the change in currents from the previous timepoint. The resulting voltage response across the entire network includes not only the static response (i ·r) but also the dynamic L ·di/dt and the (1/C) ∫i(t) ·dt components.

Generating a current profile requires two pieces of information: the average current a block draws, derived from its power budget and supply voltage, and the temporal shape of switching activity within each clock cycle. The average current sets the total charge per cycle. The shape determines the di/dt — the rate of change of charge draw that drives inductive voltage droop.

The derivation begins with publicly available data. The H100 in its PCIe configuration has a rated TDP (thermal design power) of 350 W. Based on available performance analysis and general GPU architectural trends, a reasonable power budget split allocates approximately 60% of total chip power to the SM cores, with the remainder distributed among I/O, HBM3 memory, and L2 cache. NVIDIA® does not publish exact per-block power, but these assumptions provide a working basis.

StepCalculationResult
SM core power budget60% × 350 W210 W
Power per SM210 W ÷ 144 SMs1.458 W
Average current per SM1.458 W ÷ 0.6 V (Vdd)2.43 A

The supply voltage of approximately 0.6 V is consistent with TSMC 4N nominal operating voltage for high-performance transistors. The H100 base clock of approximately 690 MHz gives a clock period of roughly 1.45 ns. At 2.43 A average current, the charge per clock cycle delivered to each SM is approximately 3.52 nC.

Each SM's current profile is constructed as a triangular waveform: two back-to-back triangular pulses per clock cycle, each with a peak of 5 A and a base width of half the clock period. The area under these two triangles in one clock cycle equals the required 3.52 nC of charge. This triangular shape is a preferred representation of time-distributed transistor switching rather than switching limited to clock edges; gate charge and discharge follow smooth RC transitions rather than instantaneous changes, signal evaluations occur between clock edges, and clock skew and jitter spread switching around clock edges. The result is a waveform that draws the correct total charge with much lower di/dt than an equivalent narrow Gaussian profile.

Where available, block current profiles are replaced by actual current consumption waveforms derived from transient simulations. Real current waveforms including leakage, which provides a measure of negative feedback, tend to be less demanding[3] on the chip PDN, though such effects as voltage-dependency of load current are challenging to incorporate into a passive component modeling and simulation environment. The triangular load current profiles are a reasonable early assumption for qualitative studies of CVD.

The Voltage Margin Problem

Before examining simulation results, it is worth understanding the margins within which the H100 power delivery system must operate. At a nominal Vdd of approximately 0.6 V, the H100 must maintain voltage at switching transistors within tight bounds to ensure correct logic operation. Industry practice typically allows a maximum supply voltage deviation of 5% of Vdd.

Droop BudgetVoltage DropMinimum Vdd
5% of Vdd30 mV0.570 V
7% of Vdd42 mV0.558 V
10% of Vdd60 mV0.540 V

A 30 mV droop on a 0.6 V supply is a 5% event. If supply voltage drops below the minimum operating level, logic timing violations can cause silent data corruption or functional failure. The guardband required to absorb this droop directly reduces the maximum achievable clock frequency. For the H100, even small improvements in droop management translate to measurable frequency and throughput gains, or lower power through incremental supply voltage reduction.

But it is not just droop that is a problem; there are often significant voltage overshoots that affect transistor reliability and aging. Resonant circuits swing in both directions, and the sudden turn-OFF of a large switching block, despite soft-switching techniques, can subject transistors to relatively high voltages that degrade their performance over time. This aspect of voltage margin excursion, that could conceivably lead to Silent Data Corruptions over time, is entirely missed by static i ·r drop approximations.

4D Simulation results view on the H100 model

The H100 model uses PDNLab's Scenario Manager to define multiple workload configurations, each assigning different current profiles and activation patterns to current sources across the die. Two scenarios are examined here, while PI analysis and optimization may require many hundreds of them. The first represents "worst-case" synchronous switching. The second represents a more realistic pattern of sequential activation within a local compute cluster.

Full-Synchronous Activation: All 144 SM Cores Firing

The most electrically stressful scenario is often assumed to be full activation: all 144 SM cores drawing current simultaneously with the triangular (or Gaussian) profile described above. Each SM uses a triangular current profile of time period 1.45 ns repeated 3 times, for a total activation window of approximately 4.35 ns. Because every SM draws current in phase, the voltage noise propagating outward from each current source overlaps constructively across the GLOBAL grid, especially near SM cluster centers where the density of active sources is highest and the electrical distance to the nearest bump and lumped capacitor is greatest.

Despite what is thought of as the worst-case synchronous switching scenario, the simulation reveals a peak voltage droop of ~5.9 mV in the GLOBAL power grid (SM-Core-level droop seen in local grids associated with functional blocks is far greater). Constructive interference of simultaneous voltage waves from all 144 SM sources produces a smooth, spatially broad droop envelope rather than a sharp localized spike, because the uniform activation maintains symmetry across the grid and there are no regions demanding more or less charge through the GLOBAL grid impedance.

PDNLab voltage droop simulation results for the H100 with all cores active
Full synchronous activation. The dynamic voltage heatmap shows spatial droop across the die over time. SM cores at cluster centers experience the deepest droop, as their current path through the global grid to the nearest bump array is longest. (Click to expand)

Staggered Local Activation

The second scenario examines what happens when individual SMs within a single Graphics Processing Cluster fire at slightly offset delays from one another; this scenario attempts to emulate Data Locality ensured by software. SM1 through SM6 and SM8 each use the same triangular current profile, but with artificially staggered start times, and the activation repeats 6 times for an overall simulation window ending at approximately 12 ns. This models the compute wave rippling through the SM pipeline within a GPC, a pattern characteristic of real AI workloads where warp schedulers dispatch work in rapid succession rather than in perfect lockstep.

The result may seem counterintuitive. This staggered activation in a small local cluster produces a larger peak voltage droop of ~7.4 mV in 12 ns of simulation duration in the GLOBAL grid, compared to 5.9 mV in 4.35 ns in the full-synchronous activation case. A reason could be constructive interference of time-staggered voltage waves within a localized region in the larger activation and simulation duration.

This ability to create varied activation scenarios and run Maxwell-accurate simulations in a Full-Stack, true-physical 3D power delivery network is unique to PDNLab™.

PDNLab voltage droop simulation results for staggered SM activation within a local GPC
Staggered SM activation within a single GPC. Despite lower instantaneous di/dt per timestep, the phase-offset firing pattern produces constructive interference of voltage waves in the local region, resulting in a deeper peak droop (~7.4 mV) than the full synchronous scenario (~5.9 mV). (Click to expand)

Simulations conducted with different intra-SM-Core workload scenarios on a single SM Core show noise on the fractional GLOBAL grid of the SM Core model (seen highlighted at the top of the simulation animation) varying between the two scenarios as below. Voltage droop is many times larger on the fractional grid as compared with the full GLOBAL grid in the H100 model because it is limited in size (and intrinsic capacitance) to the area of the SM Core, isolated with higher impedance, and only connects to a single ideal package/board capacitance.

A fractional GLOBAL grid over an SM Core
Fractional GLOBAL grid droop under intra-SM workload Scenario-1
A fractional GLOBAL grid over an SM Core
Fractional GLOBAL grid droop under intra-SM workload Scenario-2

Voltage droop on any individual SM Core grid (on lower metal layers, M7/M8), in the full-stack H100 simulation, is far more than what is seen on the full GLOBAL grid and correlates with our prior SM Core grid simulations. Similar voltage droop numbers have been measured in NVIDIA® A100 hardware at low loads under resonant excitation[7]. A single SM Core grid can be seen highlighted above the GLOBAL grid in the simulation animation of localized full-stack H100 activation below. Note that the H100 GLOBAL grid, in our model, is strongly coupled to a large array of ideal capacitors which limits voltage droop in this layer of the 3D model.

Voltage droop in an individual SM Core in the full H100 simulation
Voltage droop in an individual SM Core in the full H100 simulation with local activation of SM Cores

The Qualitative Advantage of True PI[5] Awareness

The value in models and simulations like these is not in specific droop numbers derived, although those do matter. It is in the questions the modeling and simulation environment enables engineers to ask and answer quickly. What happens to the droop envelope if global or SM Core grid wire width are increased or power bus spacing reduced? How much additional MIM capacitance is needed to keep peak cumulative droop within 5% of Vdd? How can we optimize a floorplan for the least noise and, correspondingly, the least supply voltage and power consumption? What is the droop impact of migrating from lateral to vertical (or 'Backside') power delivery? How does the noise distribution change if the SM count is reduced for a lower-power variant? What is the comparative droop behavior of a training workload versus inferential activity? Each of these questions can be answered by modifying model structure, parameters, and scenarios, running simulations, and observing results in tens of minutes rather than hours or days.

We created PDNLab™ with high levels of abstraction and Physics-based simulation capability for this very purpose: to inform designers, early in the physical design flow, of holistic and accurate PI degradation during design, floorplan development, and physical and electrical optimization.

Backside Power Delivery implications to CVD →

References

  1. V. Naumov et al., "NVIDIA Hopper H100 GPU: Scaling Performance," Hot Chips 34, IEEE, 2022.
  2. TSMC, "N4P and N4X Technology," TSMC 2022 Technology Symposium.
  3. Anasim Corp., Active Noise Regulation, Technical Article, 2006.
  4. NVIDIA, "NVIDIA H100 Tensor Core GPU Architecture," NVIDIA Whitepaper, 2022; NVIDIA, "NVIDIA Hopper Architecture In-Depth," NVIDIA Technical Blog, March 2022.
  5. Anasim Corp., Power Integrity Analysis and Management for Integrated Circuits , Prentice-Hall PTR Signal Integrity Series, 2010; and Power Integrity for Nanoscale Integrated Systems, McGraw-Hill, 2014.
  6. Anasim Corp., "Time, Frequency, and Spatiotemporal Domains," engineering article. Anasim pi-fp Spatiotemporal Analysis, 2014 [will open in our LEGACY page view]
  7. Z. Jiang, J. Garrigus, A. Seigler, E. Syed, Y.-L. Huang, M. Sadi, T. Rahal-Arabi, and L. K. John, "Exploration of LLM Workload Reliability based on di/dt Effects and Voltage Droops," 2026 IEEE International Symposium on High-Performance Computer Architecture (HPCA), University of Texas at Austin & AMD, 2026.