Read 0%PDF
Calibration in practiceCDS settings7 min read

What your CDS calibration settings actually compute: Empower, Chromeleon and OpenLab.

Fit type, weighting and origin are three dropdowns in your processing method. Each one changes the equation behind every reported result, and the same name does not always mean the same math.

The short version
  1. Fit type, weighting and origin handling each change the equation behind every reported result.
  2. The same name can mean different math: Chromeleon’s LIN is forced through the origin, while Empower’s and OpenLab’s Linear are not.
  3. Record all three settings for every analyte, and judge the curve on back-calculated percent error, not the default statistics.

Same name, different calibration curve.

The fit type names look interchangeable. They are not.

What you wantWaters Empower 3Thermo Chromeleon 7Agilent OpenLab CDS
Straight line with an interceptLinearLinear WithOffset (LOFF)Linear, origin set to Ignore
Straight line through the originLinear through ZeroLINLinear, origin set to Force
Quadratic with an interceptQuadraticQuadratic WithOffset (QUOFF); QUAD is the through-origin formQuadratic, origin set to Ignore
Average response factorResponse factorAverage calibration factors (ACF)Average RF
1/x² weightingNot stated in public documentation1/Amount²1/Amount²

In Chromeleon, LIN is the straight line forced through the origin. The line with an intercept is Linear WithOffset [5]. In Empower, Linear has an intercept, and the forced versions sit in a separate group of “through zero” fits [2]. In OpenLab, Linear is a curve model, and the origin is a separate setting: Ignore, Include, Force or Connect [7].

So “use a linear fit” is not a complete instruction. A method that says only “linear” can produce two different equations depending on the system it is rebuilt in.

The same fit type name can describe two different equations.

One data set, three CDS settings.

Here is the eight-level calibration from Insights 01, 0.5 to 100 ppb, run through three settings an analyst could reasonably pick. Each standard is back-calculated against its own curve.

Level (ppb)Linear with intercept
(Empower Linear, OpenLab Linear + Ignore)
Linear through origin
(Chromeleon LIN)
Average response factor
0.5−36.7%+9.0%+6.2%
1−20.8%+1.9%−0.7%
2−5.7%+5.4%+2.7%
5−5.8%−1.5%−4.0%
10+2.5%+4.4%+1.8%
25−1.3%−0.7%−3.3%
50+3.2%+3.3%+0.7%
100−0.7%−0.8%−3.4%

Illustrative data set from Insights 01, unweighted fits. Column labels give the setting names that produce each equation, per vendor documentation. Every value is computed from the responses in Insights 01.

−36.7%
Error at 0.5 ppb, linear with intercept
+9.0%
Error at 0.5 ppb, linear through origin
46 points
Swing at the low standard from one setting
Figure 1 Percent error by level: intercept vs. through the origin Linear with intercept Linear through origin
−40%−30%−20%−10%0%+10%0.5125102550100−36.7%Calibration level (ppb)

Same data, same instrument, same word “linear”. At the lowest standard, the line with an intercept reports −36.7%. The line through the origin reports +9.0%. That is a 46-point swing at the reporting limit, caused by one dropdown. Above 10 ppb the two settings agree within a few percent, which is why the difference is easy to miss.

Neither setting is wrong in itself. Whether the origin should be forced is a question for the data, covered in Insights 08. What matters here is that the choice is made deliberately and recorded, because it decides the low-level results.

Weighting: the default is none.

All three systems offer weighting. In Empower it is set in the Weighting column of the processing method’s Components tab, and the default is None [3]. OpenLab lists None, 1/Amount, 1/Amount², 1/Response and 1/Response², and normalizes amount weights to the smallest amount [7]. Thermo’s technical note on Chromeleon uses 1/Amount² [5].

The default matters. An unweighted fit favors the top of the range, so a method built without a deliberate weighting choice is usually least accurate where accuracy matters most. Insights 07 shows how to pick the weight from your own data.

One more detail: OpenLab offers weighting by amount or by response. They are not the same weight. If your SOP says 1/x, confirm which axis x is in your system.

Origin: four options, one of them adds a point.

OpenLab makes the origin its own setting with four options. Ignore fits the standards only. Force passes the curve through zero. Connect draws a line to the origin without using it in the calculation. Include adds a point at zero amount and zero response to the calibration levels [7].

That last option deserves care in regulated work. EPA Method 8000D states that an X value of zero should not be included as a calibration point, whatever the model [9]. If a method transferred into OpenLab uses Include, the curve contains a standard that was never run.

In Empower and Chromeleon the origin is part of the fit type name rather than a separate field, which is one more reason the names in the table above need reading closely [2][5].

What the CDS reports, and what it does not.

SystemFit statistics named in vendor documentationBuilt-in curve check described
Empower 3R, R², standard error of calibration, RSD, RSD(E), RSS, and % Deviation for each calibration pointNone found in public documentation
Chromeleon 7r², RSE (computed on amounts, including weights), RSD for average calibration factor curves, and relative amount deviationNone found in public documentation
OpenLab CDSr, R², residual standard deviation, standard deviation, RSD, and residual and relative residual per levelWarnings for too few points, a zero, negative or infinite slope, or a curve that cannot be calculated

Three things stand out.

First, r and R² are everywhere, and RSE is not. Chromeleon reports RSE [5]. The Empower and OpenLab documentation we reviewed describes RSD and residual statistics, but no statistic named RSE [2][8].

Second, per-point error is computed differently. Empower’s % Deviation formula depends on a System Policy. With the policy off, the default, it is the calculated value minus the standard’s value, divided by the standard’s value. With it on, the subtraction and the denominator change [4]. OpenLab defines its residuals on the fitted variable, which is normally the response [8]. For the line with an intercept in the example above, the lowest standard misses its response by −25.1% but its amount by −36.7%. Method 8000D’s 30% limit applies to the amount [9].

Third, the built-in checks are structural, not statistical. OpenLab’s “verification of the calibration curve” warns when there are too few points, when the slope is zero, negative or infinite, or when the curve cannot be calculated [6]. Those are useful guards. They do not test whether the curve is accurate at the reporting limit. We found no automatic acceptance check described in the public Empower or Chromeleon documentation.

A statistic can also look perfect by construction. Empower notes that a point-to-point fit always reports a correlation coefficient of 1 and a standard error of 0 [2].

A checklist for documenting CDS calibration settings.

  1. Name the equation, not just the fit type. Write “linear with intercept” or “linear through the origin” in the method, not “linear”.
  2. Record the weighting and its axis. 1/x² by amount is not 1/y² by response.
  3. Record the origin setting. And confirm no zero point is being added to the calibration.
  4. Re-check on transfer. When a method moves between systems, rebuild the settings from the written equation, then compare low-level results.
  5. Know which per-point error your CDS reports. Response residual or amount error, and which sign convention.
  6. Judge the curve on amount error and RSE. Calculate them if your system does not report them, and keep the calculation with the record.

Where WLTR fits.

Most labs accept the statistics their CDS reports by default and rarely compare one setting against another. Few can show, for a given analyte, what the result would have been under the alternatives.

WLTR is calibration data integrity infrastructure for regulated analytical laboratories. For each analyte, it derives nine calibration regression models: average response factor, plus linear and quadratic fits across four weightings each. It scores every model against fifteen ICAL parameters, including RSE. All of it is computed orthogonally to the CDS, under U.S. Patent 12,038,448 B2 [P].

Calibration verification

Detect calibration failures before audit exposure.

See every fit type, weighting and origin option computed side by side for your own ICAL data, orthogonally to your CDS.

Get Compliance Gap Assessment Download the white paper
White paper · PDF
CDS calibration settings · Letter size · October 2026
Sources
  1. Waters, “How do I change the calibration curve fit type from linear to quadratic or other in Empower,” Knowledge Base WKB61055. support.waters.com/KB_Inf/Empower_Breeze/WKB61055_How_do_I_change_the_calibration_curve_fit_type_from_linear_to_quadratic_or_other_in_Empower
  2. Waters, Empower help, “Analyzing calibration curve data” (processing documentation), and Empower Tips of the Week WKB235191 and WKB233785 on calibration fit types. support.waters.com/KB_Inf/Empower_Tips_of_the_Week/WKB235191_Calculating_Amount_Concentration_Calibration_Curve_Fit_Types
  3. Waters, “How do you change the weighting to 1/x for the calibration curve in Empower,” Knowledge Base WKB12384. support.waters.com/KB_Inf/Empower_Breeze/WKB12384_How_do_you_change_the_weighting_to_1_x_for_the_calibration_curve_in_Empower
  4. Waters, “Calculating the % Deviation for Points in the Calibration Curve Table,” Empower Tips of the Week WKB258605. support.waters.com/KB_Inf/Empower_Tips_of_the_Week/WKB258605_Calculating_the_viation_for_Points_in_the_Calibration_Curve_Table
  5. Thermo Fisher Scientific, Technical Note TN003551, “Enhanced calibration precision: Leveraging RSE and WLS for optimal function optimization,” Chromeleon CDS 7.3.2. labrulez.com/pdf/TN_003551_Enhanced_calibration_precision_Leveraging_RSE_and_WLS_for_optimal_function_optimization_184ab5a2c1.pdf
  6. Agilent, OpenLab CDS help, “Verification of the calibration curve.” openlab.help.agilent.com/en/mergedProjects/DataAnalysis/3404938635.htm
  7. Agilent, OpenLab CDS help, calibration parameters: curve model, origin and weighting. openlab.help.agilent.com/en/mergedProjects/DataAnalysis/iDA_DataAnalysis_Method_CalibrationParameters.htm
  8. Agilent, OpenLab CDS 2.8 help, “Calibration curve statistics.” openlab.help.agilent.com/2.8/en/mergedProjects/DataAnalysis/DA_CalibrationCurveStatistics.htm
  9. U.S. EPA, SW-846 Test Method 8000D, Determinative Chromatographic Separations, Revision 5, March 2018, Secs. 11.5 and 11.5.4. www.epa.gov/hw-sw846/sw-846-test-method-8000d-determinative-chromatographic-separations
  10. U.S. Patent 12,038,448 B2, inventor Walter “Chip” Hinchman Sr. patents.google.com/patent/US12038448B2
WLTRWLTR, Inc. · Nevada C-Corp · 2026