Advances in the Standards & Applied Sciences

Advances in the Standards & Applied Sciences

Metrological Implications of Statistical Estimator Selection on Laboratory Performance Classification: Evidence from an Electrical Materials Proficiency Testing Program

Document Type : Original Article

Authors
1 Zobe Ahan blvd., Standard Sq.,Iranian National Standard Organization Standard Research Institute
2 metrology department, Standard Research Institute
10.22034/asas.2026.585565.1109
Abstract
In proficiency testing (PT), laboratory performance classifications are used to support conformity assessment and accreditation-related decisions. This study performed an Electrical Materials PT Program and investigated the effect of four commonly used estimators on laboratory performance classifications using the data related to the tensile strength of cable sheathing. To evaluate classification stability, performance categories obtained from the complete dataset were compared with those obtained after removal of two outlying results. Laboratories were classified as satisfactory, warning, or action signal according to their z-scores, and changes in classification were examined for each estimator. The results showed that estimator selection can influence conformity assessment outcomes even when the underlying measurement results remain unchanged. The arithmetic mean exhibited the greatest classification instability, resulting in changes in the performance status of 2 out of 50 laboratories (4%) following outlier removal. Hampel and median estimators each produced one classification change, whereas Algorithm A maintained identical classifications for all laboratories before and after outlier removal, demonstrating the highest classification stability. Furthermore, Hampel showed a slightly more conservative behavior near decision limits, increasing the likelihood of assigning borderline laboratories to the action category. These findings demonstrate that the choice of statistical estimator is not merely a computational consideration but a factor that can affect laboratory classifications and introduce decision uncertainty in proficiency testing. The results highlight classification stability as an important criterion in the selection of statistical methods for PT evaluation and support the use of robust estimators when participant results are close to decision thresholds.
Keywords
Subjects

[1] ISO/IEC 17043:2023, Conformity assessment — General requirements for the competence of proficiency testing providers, Published (Edition 2).
[2] Thompson, M., Ellison, SLR., Wood, R., (2006) The international harmonized protocol for the proficiency testing of analytical chemistry laboratories. Pure Appl Chem 78(1):145-196.
[3] Iglesias-Gonzalez et al (2021) Proficiency test in mt-respiration: A necessary tool for reliable and reproducible results, MitoFit Preprints.
[4] M Thompson, SLR Ellison, 1.02 - Proficiency Testing in Analytical Chemistry, Editor(s): Steven Brown, Romà Tauler, Beata Walczak, Comprehensive Chemometrics (Second Edition), Elsevier, 2020, Pages 53-69.
[5] ISO 13528:2022, Statistical Methods for Use in Proficiency Testing by Interlaboratory Comparison, Published (Edition 3).
[6] Cofino, W.P., Crum, S., van Vark, W. et al. Robustness comparison of three statistical methods commonly used in Proficiency Tests. Accred Qual Assur 30, 507–519 (2025). https://doi.org/10.1007/s00769-025-01669-3
[7] Tsamatsoulis, D., (2022). Comparing the Robustness of Statistical Estimators of Proficiency Testing Schemes for a Limited Number of Participants. Computation, 10(3), 44.
[8] Cordeiro, F., Emons, H. & Robouch, P. Is the z score sufficient to assess participants’ performance in proficiency testing? The hidden corrective action. Accred Qual Assur 27, 145–153 (2022). https://doi.org/10.1007/s00769-022-01496-w
[9] Hogg, R. V., McKean, J., & Craig, A. T., (2019), Introduction to Mathematical Statistics, 8th edition, Pearson.
[10] Rousseeuw, P. J., & Leroy, A. M., (1987) Robust Regression and Outlier Detection., John Wiley & Sons.
[11] Hubert, M. and Debruyne, M. (2010), Minimum covariance determinant. WIREs Comp Stat, 2: 36-43.
[12] Hampel, F., Ronchetti, E., Rousseeuw, P. & Stahel, W., (1986), Robust Statistics: The Approach Based on Influence Functions. John Wiley & Sons.