 Research
 Open Access
 Published:
An Improvement on the Standard Linear Uncertainty Quantification Using a LeastSquares Method
Journal of Uncertainty Analysis and Applications volume 3, Article number: 15 (2015)
Abstract
Linear uncertainty analysis based on a first order Taylor series expansion, described in ASME PTC (Performance Test Code) 19.1 “Test Uncertainty” and the ISO Guide for the “Expression of Uncertainty in Measurement,” has been the most widely technique used both in industry and academia. A common approach in linear uncertainty analysis is to use local derivative information as a measure of the sensitivity needed to calculate the uncertainty percentage contribution (UPC) and uncertainty magnification factors (UMF) due to each independent variable in the measurement/process being examined. The derivative information is typically obtained by either taking the symbolic partial derivative of an analytical expression or the numerical derivative based on central difference techniques. This paper demonstrates that linear multivariable regression is better suited to obtain sensitivity coefficients that are representative of the behavior of the data reduction equations over the region of interest. A main advantage of the proposed approach is the possibility of extending the range, within a fixed tolerance level, for which the linear approximation technique is valid. Three practical examples are presented in this paper to demonstrate the effectiveness of the proposed leastsquares method.
Introduction
The topic of estimation of experimental uncertainty is covered in a wide variety of forums. The American Society of Mechanical Engineers publishes an uncertainty standard as part of the performance test codes: ASME PTC 19.11998 “Test Uncertainty” [1]. The International Organization for Standardization (ISO) also publishes a guide on uncertainty calculation and terminology entitled “Guide to the Expression of Uncertainty in Measurement” [2]. These two approaches are compared by Steele et al. [3]. Most textbooks on experimental measurements include a section on uncertainty propagation as well (for example, Refs. [4–6]). Some textbooks specialize in uncertainty [7, 8]. The technical literature also has numerous treatments of uncertainty estimation and propagation in specific applications (for example, Refs. [9–12]). Although there are more sophisticated uncertainty quantification methods, including Monte Carlo [13], Bayesian [14], Latin square sampling techniques [15, 16], by far ASME PTC 19.11998 “Test Uncertainty” standard [1] is the most widely adopted in the current industrial applications. A main goal of this paper is to provide a simple improvement to the practical method provided by the ASME standard.
One element of experimental uncertainty analysis deals with the manner in which uncertainty in measurements propagates into a final result. The validity of the uncertainty estimate of the result rests on both the validity of the measurement uncertainties and the method of propagation of those uncertainties through the analysis equation. A 2D example of the uncertainty analysis concept is presented in Fig. 1. Point (x*,y*) has a probability, P*, obtained from the probability density function, pdf_{xy}, i.e., P* = pdf_{xy}(x*,y*). This point is evaluated through the function of f to find a value of z* = f(x*,y*) and the probability, P _{z}*, of z* is obtained from pdf_{z}(z*). The objective is to find the confidence interval (95 % is commonly used in engineering applications) for the output of z.
Most approaches [Coleman and Steele [7], Abernethy et al. [17], International Organization for Standardization (ISO) Guide [2], etc. to engineering uncertainty propagation are based on the assumption of linear behavior for small perturbations in the measured variables. These approaches rely on a first order Taylor series approximation at a nominal location obtained from the mean of the measured variables. The problem with the first order Taylor series approximation arises when large truncation errors are present. While the Taylor series approximation is usually quite good over regions of high probability, it can give a very poor estimate of the 95 % confidence interval for highly nonlinear functions. This is illustrated conceptually in Fig. 2. In this paper, the authors describe a leastsquares approach to obtain better sensitivity coefficients that result in better predictions for the 95 % confidence interval.
Background
Total Uncertainty and Covariance Matrix
For Gaussian distributed variables, the total uncertainty can be obtained by summing the square of bias and precision uncertainties [7];
where U _{T}, U _{B}, and U _{P} are the total, bias, and precision uncertainty, respectively. The bias and precision uncertainties are obtained separately at a prescribed confidence interval (i.e., at 95 % confidence interval). The total bias and precision uncertainties are then calculated using the sensitivity coefficient (gradient) of each variable in the analysis equation. The total bias uncertainty is obtained from: [7]
where θ _{i} is the gradient \( \left(\frac{df\left({X}_i\right)}{d{X}_i}\right) \) of each variable, B _{i} is the bias uncertainty of each variable, and B _{ik} is the correlation among variables. The bias uncertainties of each variable are generally given by the manufacturer or are estimated by engineering judgment. Bias uncertainties of some variables may be correlated, e.g., when two thermistors are calibrated by the same thermometer, they will share a common error due to the uncertainties in the thermometer. The total precision uncertainty is obtained from: [7]
where P _{i} is the precision uncertainty of each variable. Precision uncertainties represent the random scattering of each variable and are assumed to be uncorrelated.
Alternatively, the total uncertainty can be determined using covariance matrices. For a Gaussian distribution, covariance matrices of the bias and precision propagations for 2D case can be determined as
where ρ is the correlation coefficient of the bias errors and σ is the standard deviation. Guidelines for bias errors and correlation coefficients for realistic experimental situations are given by Coleman and Steele [7]. Since bias and precision errors are statistically independent, their covariance matrices can be added to obtain the covariance matrix of the combined error.
The total standard deviation is
where A is an nx1 matrix which contains sensitivity coefficients of each variable, e.g., B = [θ_{1} θ_{2}]^{T} _{,} and C is an nxn covariance matrix (Eq. (6)) and is assumed symmetric and positive definite. The total uncertainty is then determined as
where t is the value obtained from the tdistribution corresponding to a particular confidence level (i.e., 95 % confidence level corresponds to 1.96 t value) [2].
Covariance Matrix Based on Uncorrelated Bias Errors
Consider a scalar function \( f\left(\overline{x}\right) \) of n variables. The errors, ē, can be expressed in terms of sources of error that are assumed to be uncorrelated. In such a case, the covariance matrix can be obtained as follows:First the errors in \( \overline{x} \) are expressed as:
where ē _{ p } are the precision errors, ē _{ b } are the bias errors associated with \( \overline{x} \), I is the nxn identity matrix and A is an nxm matrix where m is the number of uncorrelated bias terms. Matrix A is made up of zeros and ones and determines how each source of bias error influences a particular input. The covariance matrix is then given by:
or
where [σ _{ p }]^{2} and [σ _{ b }]^{2} are diagonal nxn and mxm matrices, respectively. In the example section, Eq. (10) is used to estimate the 95 % of confidence interval of a convective heat transfer coefficient (h).
Gaussian multivariate probability density function
The Gaussian multivariate probability density function (pdf) in two dimensions is given by
A 3D plot of this pdf(x,y) is shown in Fig. 3. For dimensions larger than two, Eq. (11) can be expanded to account for the additional dimensions.
Development
Geometrical Interpretations
Covariance matrices can be decomposed as [18]
where S is an orthonormal matrix (rotation matrix) containing a set of orthonormal eigenvectors of C, and Λ is a diagonal matrix containing the eigenvalues of C. \( \sqrt{\varLambda_{0,0}} \) and \( \sqrt{\varLambda_{1,1}} \) represent the principal standard deviations about the rotated coordinates, e.g., the x and y coordinate system shown in the 3D example in Fig. 3. Using the tdistribution, major and minor axes for an ellipse that bounds the 95 % probability region in 2D are obtained by multiplying \( \sqrt{\varLambda_{0,0}} \) and \( \sqrt{\varLambda_{1,1}} \) by t = 1.96. The resulting ellipse can then be divided into small sections. One way to partition the sections is to ensure that each section has the same probability. Another way to create sections is to ensure that each section has the same area.
Roberts et al. [19] suggest that the uniform space approach requires fewer function evaluations compared to the uniform probability approach to obtain comparable results for 1D cases. Therefore, uniformspace geometry is used to describe the uncertainty region in this paper. An easy way to generate a uniformspace grid is to inscribe the elliptical area within a rectangular area. Furthermore, to generate a large number of samples for an increased accuracy of the uncertainty results, an efficient sampling technique, such as Latin hypercube sampling technique [15, 16], can be employed to reduce computational cost.
LeastSquares Approach
The first order Taylor series approximation at a nominal point in the measured variables is often used to determine engineering uncertainty. However, this approach fails when applied to systems that are nonlinear in the uncertainty region so that the large truncation errors occur. A leastsquares approximation minimizes the truncation errors. Therefore, the leastsquares approximation can provide better representation of the analysis equation, especially in the region of the confidence interval, as shown in Fig. 4.
Figure 4 shows that the leastsquares approach yields larger truncation errors near the high probability region, but improves the truncation errors over the entire the interval of interest leading to a better estimate of the 95 % confidence interval. Although Fig. 4 illustrates a conceptual comparison, the results of the examples represented in the following section support this idea.
For a two dimensional problem, the data reduction function is fit with a plane. The 2D leastsquare plane can be obtained as follows.
where a, b, and c are the leastsquare coefficients.
The uncertainty values can be obtained by applying Eqs. (1), (2), and (3) using the sensitivity coefficients based on the leastsquares approximation:
Note that the sensitivity coefficients in Eq. (14) are equal to the values of a and b from Eq. (13). Alternatively, Eqs. (7) and (8) can be used to find the uncertainty bands which must be centered about the mean of the leastsquares approximation. This latter mean is given by
Piecewise approach
The piecewise approach is a method used to estimate probability distribution by sorting discrete probabilities cumulatively. This method was described in detail for one dimension in [20]. The extension to multiple dimensions can be used to estimate accurate values for the confidence interval in cases where the exact solution is not available.
Examples
Three simple examples will be presented to illustrate the leastsquares approach to uncertainty estimation.
The first example uses a simple onedimensional parabola as the data reduction equation. This equation has the benefits of extreme simplicity and a readily accessible exact result for calculating the confidence interval. The equation is:
The asymmetric 90 % confidence interval was calculated over a range of values in the independent variable, x, using 20 points for the leastsquare fit. In all cases, the leastsquare result was closer to the exact solution for the upper and lower bounds of the 90 % confidence interval than the Taylor series estimate. Figure 5 shows the results of the calculations between 1 < x < 2.5.
The second example uses a moment of inertia calculation for the rectangular area shown in Fig. 6. It is desired to find the moment of inertia about the x axis along with the associated uncertainty. The analysis function is:
where b and h are the base and height lengths of the rectangular. Assume that a ruler is used to measure the lengths of b and h. For this example, the nominal values of b and h are measured as 5 and 3 cm, respectively. Since both measurements of b and h are measured from the same device, the values are correlated. The bias uncertainty of the ruler is given by 0.5 cm from the manufacturer. The correlation in the bias, ρ, is 1 since the same ruler is used to measure b and h. We assume that bias uncertainty has 95 % confidence level, so the standard deviation for bias uncertainty is 0.255 cm (=0.5/1.96). Suppose that 20 measurements each of b and h are taken in order to find precision uncertainty. Standard deviations of each variable b and h are calculated as 0.2 and 0.3 cm, respectively, based on these measurements. These values are summarized in Table 1.
Bias and precision covariance matrices are determined by Eqs. (4) and (5).
\( {C}_B=\left[\begin{array}{cc}\hfill {0.255}^2\hfill & \hfill (1)\cdot (0.255)\cdot (0.255)\hfill \\ {}\hfill (1)\cdot (0.255)\cdot (0.255)\hfill & \hfill {0.255}^2\hfill \end{array}\right] \) and \( {C}_P=\left(\begin{array}{cc}\hfill {0.2}^2\hfill & \hfill 0\hfill \\ {}\hfill 0\hfill & \hfill {0.3}^2\hfill \end{array}\right) \)
The covariance matrix, linearly combined by C _{B} and C _{P}, is then defined by Eq. (6).
The matrices Λ and S are then determined from eigenvalue decomposition of the covariance matrix:\( \varLambda =\left[\begin{array}{cc}\hfill 0.06\hfill & \hfill 0\hfill \\ {}\hfill 0\hfill & \hfill 0.2\hfill \end{array}\right] \) and \( S=\left[\begin{array}{cc}\hfill 0.824\hfill & \hfill 0.566\hfill \\ {}\hfill 0.566\hfill & \hfill 0.824\hfill \end{array}\right] \)
A set of six points shown in Fig. 7 is sampled based on the uniform space approach [19] as discussed in Section 3.1 and these points represent an uncertainty region for Eq. (17). The points shown in Fig. 7 are evaluated using the original function, Eq. (17), and its result is used to perform a leastsquares fit to determine the equation of the leastsquares plane, Eq. (13). The result of this fit is shown below.
where x and y represent the deviation from the nominal values of b and h.
The total uncertainty at 95 % confidence level is obtained using Eqs. (7) and (8) to obtain
The mean of the leastsquares fit is given by
The 95 % confidence region is then given by
Finally, the nominal value is obtained from the original function:
and it is seen that the 95 % confidence bounds are not symmetrical about the nominal value from the original function.
The results of the above method are compared to a more accurate solution obtained by the piecewise approach which sections the input XY probability region into a thousand points.
The results of 95 % confidence interval for Taylor series approximation, leastsquares, and piecewise approaches are compared in Fig. 8. The results are compared as the correlation coefficient, ρ, changes from −1 to 1. Figure 8 shows that the confidence interval for the leastsquares approach provides a better approximation to the more realistic (but much more computationally intensive) piecewise approach than does the Taylor series approach.
The third example demonstrates application of the leastsquares approach to a 3dimensional problem. A gas temperature measurement system is used for this example. A thermocouple is used to measure the exhaust gas temperature of a diesel engine. The thermocouple is 3.175 mm (1/8 in.) diameter. The system is illustrated in Fig. 9. Assuming the system is at steadystate and that the thermocouple and wall are both at uniform temperature and neglecting heat conduction through the thermocouple wires, the equation used to determine the gas temperature is
(convection to the probe = radiation from the probe)
where
 T _{g} :

gas temperature (K)
 T _{t} :

thermocouple temperature (K)
 T _{w} :

pipewall temperature (K)
 ε :

emissivity of the thermocouple
 σ :

StefanBoltzmann constant (2.043 × 10^{−7} kJ/hrm^{2}K^{4})
 h :

convective heat transfer coefficient (kJ/hrm^{2}K).
It is desired to investigate whether it is a good idea to use Eq. (18) to determine the convective heat transfer coefficient. To this effect, Eq. (18) can be rewritten as
Assume that a thermocouple calibration block which introduces an error with standard deviation of 3 K is used to calibrate both the thermocouple shown in Fig. 9 and a thermocouple used to measure the temperature of the pipewall. It follows that these thermocouples are correlated, and the common bias error is found to have a standard deviation of 3 K. Assume that a thermometer is used to measure the gas temperature and the standard deviation of the bias is given from the manufacturer as 4 K. The nominal, bias, and precision values of each variable are listed in Table 2.
The precision and bias standard deviations shown in Table 2 are used to determine the covariance matrix in Eq. (10). The covariance is then obtained as
Note that correlation of the variables can be determined in the matrix \( \left[\begin{array}{cc}\hfill I\hfill & \hfill A\hfill \end{array}\right]. \)
The same procedure presented in the previous example is applied to this problem after obtaining the covariance matrix. The result of the leastsquares fit is determined as
The total uncertainty at 95 % confidence level is obtained using Eqs. (7) and (8) to obtain
The mean of the leastsquares fit is given by
The 95 % confidence region is then given by
Since the value of the convective heat transfer coefficient cannot be negative, the 95 % confidence region can be reevaluated as
The nominal value of the convective heat transfer coefficient is
The 95 % confidence region obtained from the leastsquares approach is compared to the 95 % confidence regions obtained by the piecewise approach and by Taylor series approximation, and the comparison is presented in Table 3.
The comparison of the results in Table 3 shows that the confidence interval of the convective heat transfer coefficient (h) for the leastsquares approach provides a better approximation to the more realistic (but much more computationally intensive) piecewise approach than the Taylor series approach. Furthermore, the narrow uncertainty interval produced by the Taylor series approximation can lead to a “false sense of security” regarding the numerical value of the heat transfer coefficient.
Conclusions
A leastsquares approach to linear uncertainty analysis has been described and illustrated. This approach can provide improved results over ordinary uncertainty propagation using a first order Taylor series approximation by minimizing the truncation errors in the linear approximation of the equation being analyzed. A drawback of this approach is that there is no explicit formula to find the sensitivity coefficients. However, in many instances the sensitivity coefficients are obtained through numerical derivatives. In such cases, there is little or no additional computational effort in obtaining the leastsquares solution. This paper also shows a simple way to obtain the covariance matrix used in the uncertainty analysis. In many engineering applications, it is cumbersome to determine the correlation coefficients of the bias errors (ρ), i.e., reasonable engineering judgment is required. Therefore, the authors recommend using covariance matrix expressed in terms of uncorrelated bias errors as shown in the third example. The results in the examples illustrate the advantages of using the leastsquares approach.
References
ASME PTC 19.11998, Test uncertainty, ASME. 1998.
International Organization for Standardization: Guide to the Expression of Uncertainty in Measurement. ISO, Geneva (1993) [Corrected and reprinted, 1995]
Steel, WG, et al.: Comparison of ANSI/ASME and ISO models for calculation of uncertainty. ISA Trans. 33, 339–352 (1994)
Dally, JW, Riley, WF, McConnell, KG: Instrumentation for Engineering Measurements, 2nd edn. Wiley, New York (1993)
Figliola, RS, Beasley, DE: Theory ad Design for Mechanical Measurements, 2nd edn. Wiley, New York (1995)
Holman, JP: Experimental Methods for Engineers, 5th edn. McGrawHill, New York (1989)
Coleman, HW, Steele, WG: Experimentation and Uncertainty Analysis for Engineers, 2nd edn. Wiley, New York (1999)
Barry, BA: Engineering Measurements. Wiley, New York (1964)
Moffat, RJ: Contributions to the theory of a singlesample uncertainty analysis. J. Fluids Eng. 104, 250–260 (1982)
Kline, SJ, McClintock, FA: Describing uncertainties in single sample experiments. ASME 75, 3–8 (1953)
Coleman, HW, Steele, WG: Engineering application of experimental uncertainty analysis. AIAA J. 33, 1888–1896 (1995)
Wyler, JS: Estimating the uncertainty of spatial and time average measurements. J. Eng. Power 97, 473–476 (1975)
Dubi, A: Monte Carlo Applications in Systems Engineering. Wiley, New York (2000)
Schmitt, SA: Measuring Uncertainty: an Elementary Introduction to Bayesian Statistics. AddisonWesley, Reading (1969)
Iman, R.L.: Latin Hypercube Sampling. John Wiley & Sons. (2008)
Mckay, MD: Latin Hypercube Sampling as a Tool in Uncertainty Analysis of Computer Models, Proceedings of the 1992 Winter Simulation Conference, pp. 557–564, New York (1992) http://dl.acm.org/citation.cfm?id=167637
Abernethy, RB, Benedict, RP, Dowdell, RB: ASME measurement uncertainty. J. Fluids Eng. 107, 161–164 (1985)
Papoulis, A: Probability, Random Variables, and Stochastic Process, 2nd edn. McGrawHill, New York (1984)
Roberts, ML, Stevens, JW, Luck, R: Evaluation of parameter effects in estimating nonlinear uncertainty propagation. J. Int. Meas. Conf. 40, 15–20 (2007)
Luck, R, Stevens, JW: A simple numerical procedure for estimating nonlinear uncertainty propagation. ISA Trans. 43(4), 491–497 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Cho, H., Luck, R. & Stevens, J.W. An Improvement on the Standard Linear Uncertainty Quantification Using a LeastSquares Method. J. Uncertain. Anal. Appl. 3, 15 (2015). https://doi.org/10.1186/s4046701500419
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s4046701500419
Keywords
 Uncertainty
 Sensitivity analysis
 Linear regression
 Covariance