When Is a 0.1 mg/L Difference Acceptable?

In water quality testing, repeat measurements of total phosphorus (TP) often produce slightly different results. A difference of 0.1 mg/L between two readings raises a common question: is this normal fluctuation or a sign of trouble?

The answer is not a simple yes or no. It depends primarily on the concentration level of the sample being tested. The key to judging repeatability is not the absolute difference but the relative deviation—the difference expressed as a percentage of the measured value.

High Concentrations (≥ 1.0 mg/L)

For samples with total phosphorus at 1.0 mg/L or above, a 0.1 mg/L difference typically represents a relative deviation of 10% or less. Industry standards generally require repeatability—measured as relative standard deviation—to be no greater than 5%. Some instruments even achieve 3% or better. In this range, 0.1 mg/L is usually within acceptable limits and can be attributed to normal instrumental variation.

Low Concentrations (0.1 – 0.5 mg/L)

Here the picture changes dramatically. A 0.1 mg/L difference at this level corresponds to a relative deviation of 20% to 100%. Quality control requirements typically specify that for samples above 0.03 mg/L, the relative deviation between duplicate measurements should be controlled within 25%. A 0.1 mg/L discrepancy in this range likely exceeds acceptable limits and warrants investigation.

Trace Concentrations (≤ 0.03 mg/L)

For samples near the detection limit, the requirements are even stricter. When total phosphorus is at or below 0.03 mg/L, the allowed relative deviation between duplicates is typically ≤ 10%. At such low levels, even tiny absolute differences can cause the relative deviation to exceed the acceptable threshold.

Instrument and Method Considerations

Different analytical methods and instrument models have varying precision specifications. For example, common total phosphorus analyzers often specify repeatability of ≤3% or ≤5%. Some standards also provide more detailed allowable absolute errors based on concentration ranges—for the low range (0–0.5 mg/L), the permitted absolute error may be as tight as ±0.05 mg/L. If the relative deviation exceeds the instrument's stated repeatability range, it signals a potential problem.

What to Do When Deviation Is Excessiv

When repeat measurements show unacceptable discrepancies, a systematic check is recommended:

Sample factors: Ensure the sample is thoroughly mixed and homogenized; check for suspended solids or turbidity interference.

Operational factors: Verify that digestion temperature, time, reagent volumes, and color development time are strictly consistent.

Instrument factors: Check the optical system stability and cleanliness of the cuvette.

Environmental factors: Confirm that laboratory temperature and power supply are stable.