Methodology / 03
Correlating Simulation and Measurement
Correlation is the act of deciding what it means when a simulation and a measurement disagree. That is harder than it sounds, because both have uncertainty, and a disagreement smaller than the combined uncertainty is not evidence of anything at all.
The ultimate sign-off of any signal or power integrity engineering is not a polished PDF report or a clean synthetic eye diagram — it is whether physical copper and silicon behave as predicted when powered on in the laboratory. If a 32 GT/s link runs error-free on the bench, but your simulation predicted total eye closure, your model was uselessly pessimistic. If your simulation promised 40 millivolts of eye margin, but the prototype drops packets every ten minutes, your model was dangerously optimistic.
Closing this gap is the discipline of correlation: the systematic, side-by-side reconciliation of electromagnetic simulations against bench measurements taken with vector network analyzers (VNAs), time-domain reflectometers (TDRs), and real-time oscilloscopes.
Engineers new to the lab almost universally make the same initial mistake: whenever hardware disagrees with a simulation, they assume the simulation failed and immediately begin tweaking dielectric constants or copper roughness values to force the simulator's curves onto the measured plot. In practice, however, bench measurements are laden with physical artifacts — probe ground-lead inductance, worn calibration standards, cable flex phase errors, and imperfect fixture de-embedding. True correlation is not curve-fitting; it is a methodical process of diagnosing the physical signature of the discrepancy.
What a disagreement can mean
A simulation says one thing, hardware says another. There are four possibilities and they have completely different consequences:
- The model is wrong — a geometry, a material, a missing structure.
- The measurement is wrong — calibration, de-embedding, fixture, probe loading.
- They are measuring different things — different reference planes, different conditions, different corners.
- Neither is wrong — the difference is inside the uncertainty of both, and there is nothing to explain.
The fourth is the one people skip, and skipping it produces weeks of investigation into noise. So the first question in any correlation exercise is not "why do they differ?" but "by more than what?"
Three instruments, three questions
- VNA. Frequency-domain S-parameters. The primary tool for channel characterisation, because it is what the simulation produces too. Needs careful calibration and de-embedding, and its accuracy at the extremes of its range is worse than the middle.
- TDR. Impedance versus distance. Unbeatable for locating a discontinuity — it tells you which via or which connector, which a frequency-domain plot cannot. Its resolution is set by the step's rise time, so a slow TDR merges features that a fast one separates.
- Real-time or sampling scope. Eyes, jitter decomposition, and the actual behaviour of a running link. The only instrument that measures what the receiver experiences, and the only one that includes the transmitter, the PDN and the protocol.
Deciding what a disagreement means
When simulation and measurement disagree, work through this order — it is roughly the order of how often each turns out to be the cause:
- Are they the same question? Same reference planes, same ports, same reference impedance, same de-embedding applied on both sides. Most disagreements die here.
- Is the measurement clean? Check the calibration, check the de-embedded file for passivity, look for a ripple whose period matches the fixture length. An over-de-embedded measurement disagrees with a correct simulation and the simulation is right.
- Does the disagreement have a shape? A constant offset is usually a length or a material property. A divergence growing with frequency is usually roughness or a Df that is optimistic. A narrow discrepancy at one frequency is a resonance the model omitted — typically a stub or a cavity mode.
- Only then, suspect the model. And when you do, the shape from step 3 usually names the missing physics.
Agree the tolerance in advance, in writing: something like insertion loss within a stated fraction of a decibel up to the Nyquist frequency, and impedance within a stated percentage. Without a number agreed beforehand, “correlated” becomes a matter of whoever is more insistent, and the first time it matters is the worst time to negotiate it.
Why this decides how your board behaves
- It is how a model earns the right to be trusted. Every predictive decision later — a stackup choice, a reach limit — rests on a model that was correlated once, somewhere.
- Fitting is not validating. Adjusting parameters until a model matches one measurement proves the model has enough free parameters, not that it is right. The test is whether it then predicts a different structure correctly.
- The domain of the disagreement names the cause. A constant offset, a growing gap, and a localised ripple point at three different things.
- Uncertainty is not symmetric across frequency. A VNA is least accurate at the extremes of its range, so a disagreement there deserves less weight than one in the middle.
What to do about it
Quantify the measurement uncertainty before comparing. Repeat the measurement — same fixture, different day; different fixture, same board; different board, same design. The spread you get is the floor below which a disagreement means nothing.
Match the reference planes explicitly. This is the single most common source of apparent disagreement, and it is bookkeeping rather than physics. See de-embedding.
Correlate a structure you can vary. A single comparison is one data point. A family — three trace lengths, two via styles — lets you check that the model gets the trend right, which is a far stronger claim than matching one curve.
Validate on something you did not fit to. Fit on one structure, predict another, then measure it. That is the difference between a fitted model and a validated one.
- A constant dB offset. A discrete structure missing from the model — a launch, a connector, a transition.
- A gap that grows with frequency. Distributed: roughness, Df, or a material parameter quoted at the wrong frequency.
- Ripple present in one and not the other. A reflection pair. Either the model is missing a discontinuity or the de-embedding introduced one.
- Disagreement only in the tails of a jitter or BER comparison. A random contributor absent from the model — supply noise is the usual one.
- Agreement that is suspiciously perfect. Check that the comparison is against independent data and not against something the model was fitted to.
Go deeper — three instruments, three questions, and their blind spots
- VNA — frequency-domain S-parameters, and the primary tool because it is what simulation produces too. Needs careful calibration and de-embedding, and is least accurate at the extremes of its range.
- TDR — impedance versus distance. Unbeatable for locating a discontinuity: it says which via, which a frequency plot cannot. Its spatial resolution is set by the step's rise time, so a slow TDR merges features a fast one separates.
- BERT / scope — the actual link, running. It is the only instrument that measures the thing the specification is about, and the only one that cannot reach a low BER in reasonable time.
Those three answer different questions, and a good correlation exercise uses the redundancy. A TDR and a VNA measure the same structure in two domains, and they must be consistent — the TDR trace is the step response of S11. If they are not, one of the measurements is wrong, and you have found that out without needing a simulation at all.
Model sensitivity is the other half. Before blaming a parameter, check how much the answer moves when you change it. If a plausible ±10% on Df covers the disagreement, then Df is a candidate — and if it takes ±200%, it is not, whatever the disagreement looks like. Sensitivity analysis turns a list of suspects into a short list.
And a caution about averaging. Comparing a simulated nominal against a measured single board compares a mean to a sample. Either measure several boards or compare the simulation's corners against the measurement's spread — but do not treat one board as the population.
Diagnostic playbook: reading the shape of a discrepancy. When an S-parameter simulation diverges from a calibrated VNA measurement, the mathematical shape of the divergence identifies the underlying mechanism immediately:
- Uniform vertical dB offset across all frequencies: Points to bulk DC conductor loss or contact resistance. Check trace length book-keeping, copper plating thickness (e.g. 0.5 oz vs 1 oz), or a 50 to 100 mΩ contact resistance at a launch connector.
- Discrepancy grows linearly with frequency (∝ f): Dielectric loss tangent (Df) error. If measured loss is steeper than simulated loss, the dielectric material is lossier than the vendor's datasheet quoted, or ambient moisture has been absorbed into the resin matrix.
- Discrepancy grows as √f above 5–10 GHz: Copper surface roughness under-prediction. Smooth conductor models fail above a few gigahertz; switch the solver's roughness model from smooth to a calibrated Cannonball-Huray or modified Hammerstad formulation.
- Periodic ripple in S21 and S11: Cavity or standing-wave reflection between two impedance discontinuities. Calculate the physical distance between the reflectors using the ripple frequency spacing: Δf = v / (2 × L). The resulting distance will land directly on the culprit features (e.g., the distance from the SMA connector launch to the first via transition).
- Sharp resonant notch at a discrete frequency: An unmodeled or inaccurately sized via stub acting as a quarter-wave open circuit resonator (fnotch ≈ v / (4 × hstub)), or an unstitched power plane resonance.
- Unphysical gain (|S21| > 0 dB or |S11| > 1): Never believe hardware violating thermodynamics. This indicates an invalid VNA calibration, a damaged port cable, temperature-induced cable phase drift, or an over-subtracted 2x-thru de-embedding coupon.
In the real world
Correlation is where engineering judgement is least substitutable. The arithmetic is easy; the hard part is deciding which of four explanations a discrepancy supports, and resisting the pull towards whichever one is cheapest to act on.
The discipline that helps most is writing down what would change your mind before you look. "If the gap grows with frequency, I will suspect roughness; if it is flat, I will suspect the launch." That costs nothing and it prevents a long afternoon of fitting a model to a measurement error.