Postanalytical External Quality Assessment of Blood Glucose and Hemoglobin A 1c : An International Survey

Similar documents
Introduction. Noklus. Opinion Paper

Should HbA1C measured by POC instruments be used for diagnosis of diabetes? Sverre Sandberg, Norwegian Quality Improvement of Primary Care

REVIEW Global standardisation of HbA 1c

Dubrovnik 2014 Sverre Sandberg, Norwegian Quality Improvement of Primary Care Laboratories Noklus, Bergen, Norway

Biological Variation The logical source for analytical goals

ADAG Study Group Data Links A1C Levels with Empirically Measured Blood Glucose Values - New Treatment Guidelines Will Now be Needed

Quality Control of Self-Monitoring of Blood Glucose: Why and How?

Guide to Fulfillment of Measurement Uncertainty

assay Introduction Conclusions: The D-100 TM system proved to be a robust and reliable method for HbA 1c

Uncertainty vs. total error in judging performance of participants Milano th International Meeting, CIRME

(a) y = 1.0x + 0.0; r = ; N = 60 (b) y = 1.0x + 0.0; r = ; N = Lot 1, Li-heparin whole blood, HbA1c (%)

Monitoring Diabetes Mellitus with HBA 1 C: The Abakaliki, Nigeria Experience

EQA in POCT The Norwegian experience. Nina Gade Christensen Head of EQA, Noklus, Norway

Postanalytical External Quality Assessment of Warfarin Monitoring in Primary Healthcare

Svein Skeie M.D. Ph.D., 1,2 Gunn B. B. Kristensen, 2 Siri Carlsen M.D., 1,2 and Sverre Sandberg, M.D. Ph.D. 2

Analysis of Hemoglobin A1c from Dried Blood Spot Samples with the Tina-quant II Immunoturbidimetric Method

Defining HbA1c: the indispensable decision to approach measurement standardization

External Quality Assessment of HbA 1c for Point of Care Testing

What information on measurement uncertainty should be communicated to clinicians, and how? Mario Plebani

Maintaining Quality in Laboratory Medicine. Glycated Haemoglobin Scheme Guide

A COMPARATIVE EVALUATION OF HBA1C MEASUREMENT IN DIFFERENT ANTICOAGULANT VIALS AND ITS STABILITY ON STORAGE

Standardisation: History, Science and Politics

Quality of Life Assessment of Growth Hormone Deficiency in Adults (QoL-AGHDA)

BIOLOGICAL VARIABILITY: THE CIRME CONTRIBUTION. F. Braga Centre for Metrological Traceability in Laboratory Medicine (CIRME)

Programme of community action in the field of health ( ) 2012 ACTIVITY REPORT DELIVERABLE 8: EVALUATION REPORT

Electrolyte-balanced heparin in blood gas syringes can introduce a significant bias in the measurement of positively charged electrolytes

What I will talk about

Clinica Chimica Acta

Clinical Chemistry 54: (2008)

Background. Opinion Paper

SKUP Scandinavian evaluation of laboratory equipment for primary health care

State of the Art of HbA1c Measurement

Evaluation of biological variation of glycated hemoglobin and glycated albumin in healthy Chinese subjects

HbA1c enzymatic assay evaluation at AN academic

Sandra Božičević dipl. ing. med. biochem, Marijana Vučić Lovrenčić, PhD Vuk Vrhovac University Clinic, Zagreb, Croatia

Evaluation of the Analytical Performance of the Coulometry-Based Optium Omega Blood Glucose Meter

Evaluation of haemoglobin A1c measurement by an enzymatic method using an automated analyser that has an on-board haemolysis system

Hemoglobin A1c: Comparison of Pointe Scientific s 2-Part Direct Hemoglobin A1c with the Bio-Rad Variant II and the Tosoh G8

Elements of analytical quality a historical review

New Guidelines for the Diagnosis of Diabetes Mellitus

The influence of sample freezing at 80 C for 2 12 weeks on glycated haemoglobin (HbA 1c

Software Version 1.0. User s Manual

Analytical performance specifications two years after Milan conference. Prof Mauro Panteghini CIRME Scientific Coordinator

COMPARISON OF CATION EXCHAGE HPLC AND IMMUNOTURBIDIMETRIC METHOD FOR DETERMINATION OF HbA1c

Use and Interpretation of Urinary Albumin and Estimated Glomerular Filtration Rate Findings in Primary Health Care

Analytical Goal-Setting for Monitoring Patients When Two Analytical Methods Are Used

HbA 1c Measurement by IDMS Current Situation and Future Development

Selecting a Risk-Based SQC Procedure for a HbA1c Total QC Plan

Study of correlation of severity of diabetic retinopathy with levels of haemogloelbin A1c in patients with type II Diabetes Mellitus

Bio-Rad Laboratories. Hemoglobin Testing. VARIANT II Hemoglobin Testing System For HbA 1c

How accurately does the Brief Job Stress Questionnaire identify workers with or without potential psychological distress?

Analytical Performance in the The Test Evaluation Cycle

Title:Decisions on statin therapy by patients' opinions about survival gains: Cross sectional survey of general practitioners.

Method Precision and Frequent Causes of Errors Observed in Point-of-Care Glucose Testing. A Proficiency Testing Program Perspective

Received: June 06, 2016 Accepted: September 10, /bm Biochem Med (Zagreb) 2017;27(3):

Calibration of ion-exchange HPLC measurements of glycohemoglobin: effect on interassay precision

Quality Specifications for POCT

Special issue: External Quality Assessment in Laboratory Medicine Review

Objectives of genetic counselling: differing views of purchasers, providers and users

FIELD SAFETY NOTICE (FSN) (Please refer to Annex 5 of the Guideline: MEDDEV REV.8 Guideline Vigilance)

Bio-Rad Laboratories HEMOGLOBIN Testing Bio-Rad A1c. VARIANT II TURBO Link System. Fully-Automated HbA 1c Testing

Bio-Rad Laboratories HEMOGLOBIN Testing Bio-Rad A1c. VARIANT II TURBO Link. Fully-Automated HbA 1c Testing

Annual Report 2005 of the Mortality Forum

The challenges of quality assessment for point-of-care testing. Anne Stavelin. EQALM Symposium, Bergen 8 October General challenges

Tosoh Automated Glycohemoglobin Analyzer HLC-723GX

It is a requirement of ISO that laboratories shall determine the uncertainty of measurement of results, where relevant and possible. (5.6.

Performance criteria based on biological variation. Reliability of available biological variation information: need for improvement

Interventions to Improve Follow-up of Positive Results on Fecal Blood Tests

Implementation of HbA1c as a Diagnostic Test in New Zealand

CRITICAL APPRAISAL OF CLINICAL PRACTICE GUIDELINE (CPG)

Quality Initiative In Pathology. Harmonisation of Laboratory Testing

A validation study of after reconstitution stability of diabetes: level 1 and diabetes level 2 controls

Evaluation Report. Eurolyser HbA1c Test Kit on Smart and Cube Analyser

Patricia C. Fallest-Strobl, 1 Elin Olafsdottir, 2 Donald A. Wiebe, 1 and James O. Westgard 1 * Lipoproteins

The Integrated Cardiovascular Clinical Network CHSA

Clinical outcomes of HbA1c standardisation

Student Performance Q&A:

Equalis user meeting Protein HbA1c the mean patient values might have been constant since 2007!

Week 17 and 21 Comparing two assays and Measurement of Uncertainty Explain tools used to compare the performance of two assays, including

South Australian Research and Development Institute. Positive lot sampling for E. coli O157

Afinion system for HbA1c

QUANTIFYING THE EFFECT OF SETTING QUALITY CONTROL STANDARD DEVIATIONS GREATER THAN ACTUAL STANDARD DEVIATIONS ON WESTGARD RULES

Correlation between eag Values Calculated from HbA1C Values and Fasting Plasma Glucose Levels for Diagnosis and Prognosis of Diabetes

Demonstrating the Value of Laboratory Medicine Making the case for a value proposition

: EQA in Germany, Belgium and the Netherlands using fresh whole blood samples with target values assigned with the IFCC reference system

Welcome to our e-course on research methods for dietitians

Improving the Accuracy of Hemoglobin A 1c. : Your Help Is Needed

Downloaded from:

HELPING RESHAPE SHARED DECISION MAKING WITH THE DIABETES MEDICATION OPTIONS DECISION AID

Diabetes Diagnosis 2011 Does your patient have diabetes?

Biological Variation Estimates Obtained from 91 Healthy Study Participants for 9 Enzymes in Serum

SKUP Scandinavian evaluation of laboratory equipment for primary health care. FreeStyle Lite

CONTOUR NEXT and CONTOUR XT

SCIENTIFIC STUDY REPORT

Review Article. Abstract

Serum fructosamine and glycated haemoglobin

LIPASE liquicolor. Design Verification. Multipurpose Reagent

liquicolor (AMP Buffer, IFCC) Design Verification

Assessment of latest LFT guidelines from American College of Gastroenterology. Gus Koerbin

Transcription:

Clinical Chemistry 51:7 1145 1153 (2005) Evidence-Based Laboratory Medicine and Test Utilization Postanalytical External Quality Assessment of Blood Glucose and Hemoglobin A 1c : An International Survey Svein Skeie, 1* Carmen Perich, 2 Carmen Ricos, 2 Agnes Araczki, 3 Andrea R. Horvath, 3 Wytze P. Oosterhuis, 4 Tanya Bubner, 5 Gunnar Nordin, 6 Rhena Delport, 7 Geir Thue, 1 and Sverre Sandberg 1 Background: Diabetes mellitus (DM) is diagnosed and monitored worldwide by blood glucose (BG) and glycohemoglobin A 1c (HbA 1c ) testing, respectively. Methods for quality assessment of clinician interpretations of changes in these laboratory results have been developed. This study uses survey responses from general practitioners (GPs) in different countries to investigate possible differences in interpretation of results, as well as the feasibility of performing international postanalytical external quality assessment surveys (P-EQAS). Methods: GPs recruited from 7 countries received questionnaires requesting interpretation of changes in a potentially diagnostic capillary BG result and an HbA 1c value obtained during monitoring of a patient with type 2 DM. GPs were asked to estimate clinically significant differences between 2 consecutive laboratory results [critical difference (CD)/reference change value] for both BG and HbA 1c. The CDs reported by GPs were used to calculate the analytical variation (CV a ), which was taken as the quality specification for analytical 1 NOKLUS, Norwegian Centre for Quality Improvement of Primary Care Laboratories, Section for General Practice, Department of Public Health and Primary Health Care, University of Bergen, Bergen, Norway. 2 Laboratori Clínic Bon Pastor Barcelona and the Analytical Quality Commission of the Spanish Society of Clinical Biochemistry and Molecular Pathology (SEQC), Barcelona, Spain. 3 Department of Clinical Chemistry, University of Szeged, Albert Szent- Gyorgyi Medical and Pharmaceutical Centre, Szeged, Hungary. 4 Department of Clinical Chemistry, St. Elisabeth Hospital, Tilburg, The Netherlands. 5 The Department of General Practice, The University of Adelaide, Adelaide, Australia. 6 EQUALIS AB, Uppsala, Sweden. 7 Faculty of Natural Sciences, University of Pretoria, Pretoria, South Africa. *Address correspondence to this author at: Department of Medicine, Stavanger University Hospital, PO Box 8100, 4068 Stavanger, Norway. Fax 47-51-519-9-06; e-mail svskeie@online.no. Received January 19, 2005; accepted May 2, 2005. Previously published online at DOI: 10.1373/clinchem.2005.048488 imprecision. Participants received national benchmarking feedback reports after the survey. Results: The study included responses from 2538 GPs. CDs in BG results showed the same pattern and were comparable among countries. Calculated median CV a values would be possible to attain at 80% confidence but not at the conventional 95% confidence. For HbA 1c, the same pattern was shown across countries, but with lower changes considered true when HbA 1c increased than when it decreased. Despite the consistent pattern, variations among GPs were considerable in all countries. Conclusions: Assessments of CDs for BG and HbA 1c were similar internationally, and quality specifications for these analytes based on clinicians opinions are therefore interchangeable among countries. International P-EQAS may contribute to a more rational use of laboratory services and clinical guidelines. 2005 American Association for Clinical Chemistry Because of the rapid worldwide increase in diabetes mellitus (DM), 8 there is a growing need for quality diabetes care (1). Blood glucose (BG) and hemoglobin A 1c (HbA 1c ) measurements are the most common and important DM laboratory tests. Fasting BG measurement is the basis for diagnosing DM (2), and BG testing enables people with diabetes to monitor their daily metabolic control (3). HbA 1c is the key measurement for monitoring overall metabolic control over an 80- to 120-day time 8 Nonstandard abbreviations: DM, diabetes mellitus; BG, blood glucose; HbA 1c, hemoglobin A 1c ; NOKLUS, Norwegian Centre for Quality Improvement of Primary Care Laboratories; P-EQAS, postanalytical external quality assessment survey; GP, general practitioner; CD, critical difference, NGSP, National Glycohemoglobin Standardization Program; SEQC, Spanish Society of Clinical Chemistry and Molecular Pathology; POC, point-of-care; and NACB, National Academy of Clinical Biochemistry. 1145

1146 Skeie et al.: International P-EQAS for Blood Glucose and HbA 1c period (3). It is therefore crucial for both patients and diabetes caregivers to be able to interpret clinically important changes in these test results. In the Norwegian Centre for Quality Improvement of Primary Care Laboratories (NOKLUS), a model for distributing case histories together with regular quality assessment material has been developed and is used systematically as an educational postanalytical external quality assessment survey (P-EQAS). General practitioners (GPs) are asked to respond to a few questions assessing the interpretation of test results in an important and recognizable clinical situation. This approach is used to put external quality assessment into clinical context and to emphasize the importance of analytical quality for medical decision making. NOKLUS has used this approach among Norwegian GPs and in DM patients (4 6). To our knowledge, studies comparing the interpretation of laboratory tests in diabetes care in different countries have not been performed. Our study was designed to assess the clinical judgment of practicing GPs in different countries concerning BG and HbA 1c in the diagnosis and monitoring of DM. We also aimed to investigate whether our model, as a tool for postanalytical quality assessment, is feasible in other countries. Materials and Methods GPs were recruited for the study from 7 countries. The process for recruiting GPs is described separately in the following country-specific sections. All GPs responded to the same questionnaire, developed by NOKLUS (Fig. 1). No reminders were sent after the GPs received the questionnaire. The questionnaire included 2 short case histories describing typical scenarios in general practice/family medicine. The first case history described a situation related to capillary measurement of BG and the diagnosis of DM, investigating the testing retesting strategy of GPs. The second case history described a typical type 2 DM patient with a certain HbA 1c value at a follow-up visit and investigated the monitoring practices of GPs. Before international distribution, both case histories were reviewed by Norwegian GPs and diabetes specialists with skills in survey methodology. The cases were based on real patient encounters, and care was taken to present them in a form familiar to GPs. The Norwegian questionnaire was translated into English and then into the appropriate native languages. The translated questionnaires were distributed to practicing primary healthcare GPs recruited in each country. Responses from GPs were collected by the national study coordinators, and individual responses were coded and sent anonymously to NOKLUS. Analysis of data was not performed for countries with fewer than 50 responses. The doctors were asked to state higher and lower BG or HbA 1c values denoting a true change compared with a preset baseline value, so that both clinical improvement and deterioration would seem plausible to the GPs. However, participants in Sweden and a majority of Norwegian participants carried out the baseline HbA 1c measurement themselves in their own office laboratories, using regular EQAS material sent with the questionnaire. The mean baseline HbA 1c value was 9.0% in Norway and 8.6% in Sweden, whereas a preset value of 9.1% was used for the other countries. The study was performed in 2002 in all countries but Norway and Sweden, where the original studies had been performed earlier (see below). Methodologic differences among countries are described in the following country-specific sections. The change between 2 consecutive laboratory results, stated by the GPs, is denoted the critical difference (CD) and is similar to the reference change value (7). The CD is defined as the minimum difference needed between 2 consecutive test results to be certain (with a given degree of confidence) that the 2 results are truly different and not simply a result of analytical imprecision (CV a ) or intraindividual biological variation (CV i ). The formula for CD is: CD z-value 2 CV a 2 CV i 2, with z-values for 1-sided tests and a given probability (8). Random bias is here included in the CV a, which then also will comprise long-term variations. Thus, with CV i known from the literature and the CD of BG or HbA 1c stated by doctors, the analytical imprecision (CV a ) needed can be calculated. We rearranged the formula to calculate the CV a as an estimate of the quality goal for analytical imprecision, assuming the bias component to be 0 (9). Calculations of CV a were performed with a CV i of 5% for BG (10 12) and 4% for HbA 1c (13), with z-values corresponding to 80% (z 0.84) and 95% (z 1.64) levels of probability. The 80% probability value was included based on the judgment that the semantics of the questionnaire corresponded better with an 80% probability than the 95% probability most frequently used. All participants received a feedback report after the survey. The results for each GP were benchmarked in comparison with national results. The feedback report contained a discussion of the clinical situation and the concept of CD. From the CV i and CV a in the literature, the true CD was given in the feedback report as 14% for BG and 12% for HbA 1c. A parametric t-test and ANOVA were used for comparisons of responses among the countries (because the data generally and for each country showed a gaussian distribution). The Pearson test was used for correlation analysis. norway In Norway, the study included GPs participating in 2 different EQAS performed by NOKLUS (one for BG and one for HbA 1c ). Approximately 70% of the GPs returned the questionnaires. The case history and questionnaire on DM diagnosis (Fig. 1, patient A) was mailed to all Norwegian GPs participating in the NOKLUS system in October 1998 (almost all GPs in Norway). At this point, the new criteria for diagnosing DM had not been implemented, and the old criterion specifying a fasting capillary

Fig. 1. Case histories presented to responding GPs. Clinical Chemistry 51, No. 7, 2005 1147

1148 Skeie et al.: International P-EQAS for Blood Glucose and HbA 1c glucose of 6.7 mmol/l as the cutoff was used, in contrast to the new criterion specifying 6.1 mmol/l. The Norwegian data are interpreted accordingly. A corresponding survey was performed in November 1997 for HbA 1c with quality assessment materials, a case history (Fig. 1, patient B), and the questionnaire. For the case history, 262 of 444 GPs analyzed the control material in their office laboratory, and the others were given a preset value of 9.4% for HbA 1c, with a resulting mean HbA 1c value of 9.1%. Details on the materials and methodology for this HbA 1c survey have been published previously (4). the netherlands GPs were recruited from the region covered by the participating laboratory (St. Elisabeth Hospital, Tilburg). The survey letter was sent by mail to 168 GPs in May 2002; the response rate was 36%. sweden Sweden participated only in the HbA 1c survey. The HbA 1c questionnaires were distributed in August 2001 to 249 primary healthcare centers in connection with an ordinary national EQAS for HbA 1c. The response rate was 83%. The EQAS material had a target value for HbA 1c [National Glycohemoglobin Standardization Program (NGSP)] of 8.6%, similar to the mean HbA 1c result achieved by the primary healthcare centers in the ordinary HbA 1c survey. All measurements of HbA 1c performed in Sweden were traceable to the Mono S method. Conversion equations for different regional HbA 1c standardization procedures and the IFCC reference method have been published recently (14). From these equations, the relationship between NGSP and Mono S HbA 1c concentrations can be described by the equation: HbA 1c (NGSP) 0.92 HbA 1c (Mono S) 1.33 (14, 15). This relationship has therefore been used to transfer all HbA 1c data reported from the Swedish participants in this project to corresponding NGSP concentrations. hungary In Hungary, the study questionnaires were posted to 220 GPs randomly selected from the continuous medical education register of GPs all across the country. The response rate was 31%. The study was carried out in collaboration by the Department of Clinical Chemistry of the University of Szeged, the National Institute of Primary Health Care, and the Hungarian Board of General Practitioners. The survey with preset baseline BG and HbA 1c values and no quality assessment materials was carried out in the period of February to April 2002. In most laboratories in Hungary, HbA 1c values were traceable to the NGSP standard at the time of the survey. australia In Australia, the Department of General Practice of the University of Adelaide sent the 2 questionnaires to 300 GPs. The questionnaires were posted to the GPs in June 2002, and 110 were returned, giving a 37% response rate. GP participants were selected randomly through Divisions of General Practice, both urban and rural, within South Australia. spain In Spain, the questionnaires were sent in May 2002 to all participating laboratories in the external quality assessment program performed by the Spanish Society of Clinical Chemistry and Molecular Pathology (SEQC). A total of 296 responses were received, of which 291 were included in this study (15.7% of all possible responses). Every laboratory received 2 questionnaires with an explanatory cover letter. Each laboratory was asked to recruit 2 doctors involved in diabetes care to respond to the questionnaire. Responses were returned by participating laboratories to the Secretary of SEQC together with the EQAS monthly response. The period to receive the responses was 4 months, and no reminders were sent. Participating doctors were 61% GPs and 35% endocrinologists. Data from endocrinologists were excluded from the analysis. In Spain, at the time of the study, clinical guidelines used for doctors followed the old criterion for diagnosing DM, specifying a fasting capillary glucose of 6.7 mmol/l, and the Spanish data must be interpreted accordingly. south africa South Africa initially participated, but because of logistic problems, monetary restrictions, and continuous emigration of GPs, only 29 valid responses (response rate, 7%) were received, and the data were excluded from further analysis and comparison. Results We analyzed responses from 2538 GPs, which are summarized in Table 1. Most GPs were 30 70 years of age, with Spain having the lowest mean age (43.5 years). A total of 1881 GPs responded to the BG questions and 1102 to the HbA 1c questions. A total of 55 answers were obviously wrong and were excluded from analysis. Response rates showed considerable variation among countries and were highest in Norway and Sweden. The responses of the GPs rating the importance of repeated BG measurement for questionnaire case patient A are displayed in Fig. 2. Hungary reported the highest score of 7.6 (mean) and The Netherlands the lowest of 4.3. The overall country results were significantly different (P 0.001); comparisons of means, stratified by country, also showed differences (Fig. 2). The cumulative reported absolute CDs for BG and HbA 1c as percentage deviations from the preset value, stratified by country, are shown in Figs. 3 and 4. As can be seen from Figs. 3 and 4, GPs from all countries responded similarly to all questions except when the decrease in HbA 1c had to be estimated. We were unable to demonstrate any correlation between the responses on impor-

Clinical Chemistry 51, No. 7, 2005 1149 Country GPs, n Table 1. Overview of study responders. Response rate, % Responders on BG questions, n Responders on HbA 1c questions, n Mean (range) GP age, years Norway 1880 70 1436 444 51.4 (24 74) Sweden 249 83 No data 249 No data The Netherlands 60 36 60 60 47.9 (30 62) Hungary 69 31 69 69 50.5 (26 72) Spain 177 16 177 177 43.5 (29 60) Australia 110 37 110 110 48.1 (29 73) Fig. 2. GP responses rating importance of further testing to establish a diagnosis of DM, based on history of patient A. Rating scale: 1 unnecessary; 10 definitely required. Error bars represent 95% confidence interval (95% CI) of the mean. tance of BG retesting and the responses on clinically significant changes in BG values, including all results, for individual countries or in relation to GP age. However, within each country there was wide variation among the responses of individual GPs, pointing to practice variations of possible clinical significance within each country. The analytical quality specifications based on CDs were calculated for BG and HbA 1c, and the results are summarized in Tables 2 and 3. Results calculated with 80% and 95% confidence levels are included. As shown in Table 2, median responses for BG from the different countries were very similar. The HbA 1c responses (Table 3) showed the same pattern as for BG but with more variation among countries. CV a calculations showed lower changes in values and different interpretation patterns for increased HbA 1c compared with decreased HbA 1c in all countries. Compared with participants in the other countries, participants in Spain and Hungary responded with significantly higher percentage decreases. In Norway and Sweden, participants also performed HbA 1c assays to obtain the baseline value, but the responses from these were not different from other countries. Discussion Laboratory testing is a key tool in diabetes management. Evaluation of the use and interpretation of important laboratory results is one way to assess practice variations and to look for opportunities for improvement in diabetes care. When such evaluations are conducted internationally, several variables may influence survey validity, among them semantics, the quality of translations, and the use of different methods for analysis of laboratory tests, all of which can make it difficult to assess whether results are interpreted differently in different countries. In this study, however, we found that methodologic variables seemed to be consistent. GP responses showed a rather similar pattern, and the questions seemed to be interpreted in a similar fashion in different countries; therefore, the likelihood of such variables impacting on the conclusions seems rather low. Response rates showed considerable variation among countries. The highest rates were in Norway and Sweden, perhaps because in these countries the quality assessment material was circulated together with the case studies and in Norway P-EQAS has been performed on a regular basis among GPs for several years. The main goal in diabetes care is to keep BG and HbA 1c as close to reference values as possible. Recommendations for BG concentrations in daily diabetes care are almost identical among countries. The issue of HbA 1c is more complex because differences in methods of analysis and standardization may lead to different cutoffs for treatment recommendations (16 19). However, the survey questions focused on changes in HbA 1c and not on absolute values of HbA 1c ; therefore, country responses can be compared in a relevant manner. As pointed out in the literature (7, 20), the semantics of the questions is of great importance when interpreting answers to survey questions. We phrased the BG and HbA 1c questions so that neither related to a specific confidence level; we therefore used both 80% and the conventional 95% level when performing calculations for both case histories. We think 80% is closer to the confidence level used by GPs in the 2 situations. The first question concerning patient A raised the issue of retesting or performing additional tests in diagnosing

1150 Skeie et al.: International P-EQAS for Blood Glucose and HbA 1c Fig. 3. Cumulative CDs, as a percentage of the desired value, for a decrease (A) or an increase (B) in BG, as reported by the participants. The results are stratified by country. DM. The BG value 5.8 mmol/l is only 0.3 mmol/l below the diagnostic limit for DM in capillary whole blood (2) and is well within possible error limits of point-of-care (POC) instruments used in GP offices (21 23). We would therefore expect most GPs to recommend additional tests in this situation (preferably in a hospital laboratory), as best shown in the responses from Hungary (Fig. 2). Some GPs may have remembered the diabetes diagnostic limit of 7.0 mmol/l for venous plasma/serum and made their interpretations accordingly, i.e., they did not recommend additional tests. If so, this finding exemplifies a problem of establishing the diagnosis of DM based on criteria using different types of specimens. In a casefinding situation such as this, the use of a capillary specimen is common in all countries in this study. When a DM diagnosis is to be made, a venous sample should be used. The importance of specimen type was also emphasized in our feedback report particularly because it may be potentially harmful to the patient if a diagnosis of DM is postponed. In the feedback reports we stated that BG measured on an instrument with a reasonable quality will have a CD of 14% and a CV a of 4% 5% (10, 11). In the future, this quality should be attainable by POC instruments. At present, however, many POC instruments have higher CVs (21 23). As can be seen from our data (Table 2 and Fig. 3A), 80% of the GPs (including all countries) responded with changes lower than 14% for a decrease in BG from 5.8 mmol/l. Calculations at the 80% confidence level (Table 2) for increases in BG led to more attainable CV a values in all countries studied. The National Academy of Clinical Biochemistry (NACB) recommendations (24) suggest that glucose should be measured with an imprecision 3.5% and a bias 2.5%. An imprecision of 3.5% is close to what the most demanding 25% of the GPs expected when using a confidence level of 80% (Table 2), and an imprecision of 3.5%, including random bias, therefore seems to be in accordance with the analytical expectations of the GPs. Use of a 95% confidence level in calculation of CV a thus leads to values that will be impossible to calculate (Table 2). For increases in BG (Fig. 3B), the same percentage of GPs ( 80%) responded with changes 14%, with Norway and The Netherlands accounting for the lowest percentages. These results demonstrate that most GPs seem to interpret changes in BG when using POC instruments in accordance with quality specifications set by the NACB. Similar expectations of high instrument quality have also been shown in other studies on BG, with doctors and patients as responders (5, 25). GPs with high (Hungary) or low (The Netherlands) scores on the question of retesting did not seem to set other cutoffs when judging the differences between consecutive BG results. The retesting pattern therefore does not seem to be linked to considerations of analytical and biological variation, but rather to clinical judgment of

Clinical Chemistry 51, No. 7, 2005 1151 Fig. 4. Cumulative CDs, as a percentage of the desired value, for a decrease (A) or an increase (B) inhba 1c, as reported by the participants. The results are stratified by country. borderline BG values and awareness that capillary samples in this situation are not appropriate for confirming or ruling out the diagnosis of DM. For interpretation of HbA 1c in monitoring DM, a CD of 12% was quoted as reasonable in the feedback to participants (13), assuming a CV i of 4.0% and a CV a of 3% 4% (26). The NACB guidelines (24) state that HbA 1c should have an interassay imprecision 5% or ideally 3%. An imprecision of 3% 5% is in accordance with the quality demands for 50% of the GPs using a confidence of 80% for an increase in HbA 1c, except for Hungarian GPs, who expected a lower quality (Table 3). The quality demands Table 2. Calculated analytical quality specifications for BG based on CDs given in GP responses. CV a calculated from the responses, % Responses from the GPs, nmol/l 80% confidence a 95% confidence b BG value truly lower than 5.8 mmol/l Norway 5.4 5.3 5.2 5.8 8.1 10 NC c NC NC The Netherlands 5.5 5.3 5.0 2.8 8.1 14 NC NC 3.2 Hungary 5.5 5.2 5.0 2.8 10 14 NC NC 3.2 Spain 5.5 5.3 5.0 2.8 8.1 14 NC NC 3.2 Australia 5.5 5.3 4.9 2.8 8.1 16 NC NC 4.2 BG value truly higher than 5.8 mmol/l Norway 6.2 6.4 6.5 5.8 10 12 NC NC 1.5 The Netherlands 6.1 6.3 6.5 2.8 8.1 12 NC NC 1.5 Hungary 6.1 6.3 6.8 2.8 8.1 18 NC NC 5.5 Spain 6.2 6.4 6.7 5.8 10 16 NC NC 4.0 Australia 6.1 6.5 6.8 2.8 12 18 NC 1.5 5.5 a CV a s (CD 2 /2z 2 ) CV 2 i ; z 0.84 (80%). CV a s (CD 2 /2z 2 ) CV 2 i ; z 1.64 (95%). c NC, not possible to calculate.

1152 Skeie et al.: International P-EQAS for Blood Glucose and HbA 1c Table 3. Calculated analytical quality specifications for HbA 1c based on responses by GPs. Responses given as true changes in HbA 1c, mmol/l CV a calculated from the responses 80% confidence a 95% confidence b HbA 1c start value, mmol/l Truly lower HbA 1c Norway 9.1 8.5 8.0 7.7 6.7 11 16 NC c 2.2 5.0 Sweden 8.2 7.8 7.6 7.3 5.5 7.4 13 NC NC 3.7 The Netherlands 9.1 8.6 8.0 7.1 3.5 12 24 NC 3.4 8.8 Hungary 9.1 8.0 7.0 6.5 12 25 31 3.4 9.1 12 Spain 9.1 8.0 7.5 7.0 12 19 25 3.4 6.5 9.1 Australia 9.1 8.5 8.0 8.0 5.3 12 12 NC 3.4 3.4 Truly higher HbA 1c Norway 9.1 9.5 9.9 10 1.8 5.0 11 NC NC 2.2 Sweden 8.2 8.4 8.7 8.8 2.8 5.5 7.7 NC NC NC The Netherlands 9.1 9.5 9.6 10 NC 3.5 9.7 NC NC 1.5 Hungary 9.1 9.4 10 10 NC 9.7 9.7 NC 1.5 1.5 Spain 9.1 9.5 9.6 10 NC 3.5 9.7 NC NC 1.5 Australia 9.1 9.5 9.6 10 NC 3.5 9.7 NC NC 1.5 a CV a s (CD 2 /2z 2 ) CV 2 i ; z 0.84 (80%). b CV a s (CD 2 /2z 2 ) CV 2 i ; z 1.64 (95%). c NC, not possible to calculate. were lower for a decrease in HbA 1c. Interpretations at the 95% level were unrealistically strict for up to 50% of the GPs for decreases in HbA 1c and for almost all of the GPs for increases in HbA 1c (Fig. 4 and Table 3). Similar results have been shown when patients assess changes in HbA 1c (6). Thus, GPs act at a lower threshold when HbA 1c increases than when it decreases, probably because increases in HbA 1c indicate an increased risk of future diabetes complications. What lessons can be learned from comparing laboratory data interpretation skills of GPs in different countries? It was recently demonstrated that there is wide variation among laboratory professionals regarding how they interpret test results, in line with our findings of variation among GPs, and that inappropriate interpretation may do harm to patients (27). However, we found that GP responses were surprisingly similar, seemingly irrespective of differences in social, cultural, and organizational aspects of the healthcare systems of the countries involved in this survey. This finding suggests that the method (9) of using familiar situations for case histories for P-EQAS is fairly robust, even when applied in different countries. Similar studies using case histories and responses collected in P-EQAS may be used to establish international clinically acceptable analytical quality specifications. However, some of the response rates and the South African experience underline the need for an organization to deal with P-EQAS. We believe that our results support the establishment of a P-EQAS of similar design, both for clinicians and laboratory professionals. Such schemes may also serve as an educational tool and a communication channel among laboratories and GPs and could be used to actively disseminate evidence-based best practice. Our study demonstrates the feasibility of performing P-EQAS on an international scale. Finally, the study highlights the need for better communication with the users of laboratory results and increased awareness by clinicians of how analytical and biological variation can influence interpretation of results. Improved laboratory reports could be instrumental in this function. Research is needed to investigate how better reporting and P-EQAS could reduce the misinterpretation of laboratory test results and thus improve patient and healthcare outcomes. The present study is part of the Global Campaign on Diabetes Mellitus launched by the IFCC. References 1. King H, Aubert RE, Herman WH. Global burden of diabetes, 1995 2025: prevalence, numerical estimates, and projections. Diabetes Care 1998;21:1414 31. 2. World Health Organization. Definition, diagnosis and classification of diabetes mellitus and its complications. Report of a WHO Consultation. Geneva: WHO, 1999. 3. American Diabetes Association. Tests of glycemia in diabetes. Diabetes Care 2000;24:S80 2. 4. Skeie S, Thue G, Sandberg S. Use and interpretation of HbA1c testing in general practice. Implications for quality of care. Scand J Clin Lab Invest 2000;60:349 56. 5. Skeie S, Thue G, Sandberg S. Patient-derived quality specifications for instruments used in self-monitoring of blood glucose. Clin Chem 2001;47:67 73. 6. Skeie S, Thue G, Sandberg S. Interpretation of hemoglobin A 1c (HbA 1c ) values among diabetic patients: implications for quality specifications for HbA 1c. Clin Chem 2001;47:1212 7.

Clinical Chemistry 51, No. 7, 2005 1153 7. Fraser CG. Biological variation: from principles to practice. Washington: AACC Press, 2001:151pp. 8. Fraser CG, Harris EK. Generation and application of data on biological variation in clinical chemistry. Crit Rev Clin Lab Sci 1989;27:409 37. 9. Sandberg S, Thue G. Quality specifications derived from objective analyses based upon clinical needs. Scand J Clin Lab Invest 1999;59:531 4. 10. Sebastian-Gambaro MA, Liron-Hernandez FJ, Fuentes-Arderiu X. Intra- and inter-individual biological variability data bank. Eur J Clin Chem Clin Biochem 1997;35:845 52. 11. Widjaja A, Morris RJ, Levy JC, Frayn KN, Manley SE, Turner RC. Within- and between-subject variation in commonly measured anthropometric and biochemical variables. Clin Chem 1999;45: 561 6. 12. Ricos C, Alvarez V, Cava F, Garcia-Lario JV, Hernandez A, Jimenez CV, et al. Current databases on biological variation: pros, cons and progress. Scand J Clin Lab Invest 1999;59:491 500. 13. Phillipou G, Phillips PJ. Intraindividual variation of glycohemoglobin: implications for interpretation and analytical goals. Clin Chem 1993;39:2305 8. 14. Hoelzel W, Weykamp C, Jeppsson JO, Miedema K, Barr JR, Goodall I, et al. IFCC reference system for measurement of hemoglobin A1c in human blood and the national standardization schemes in the United States, Japan, and Sweden: a methodcomparison study. Clin Chem 2004;50:166 74. 15. Eckerbom S, Bergqvist Y, Jeppsson JO. Improved method for analysis of glycated haemoglobin by ion exchange chromatography. Ann Clin Biochem 1994;31:355 60. 16. American Diabetes Association. Standards of medical care for patients with diabetes mellitus. Diabetes Care 2003;26:S33 50. 17. Attvall S, Smith U. [Approved national guidelines for diabetic care. Diabetes Center, Sahlgrenska University Center, Gothenburg, Sweden]. Lakartidningen 1999;96:3994 5. 18. Burgers JS, Bailey JV, Klazinga NS, Van Der Bij AK, Grol R, Feder G. Inside guidelines: comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care 2002;25:1933 9. 19. Claudi T, Cooper JG, Midthjell K, Daae C, Furuseth K, Hanssen K, eds. NSAM s action program for diabetes in general practice. Oslo: Norsk Selskap for Allmennmedisin, Norges Diabetesforbund, Statens Institutt for Folkehelse, Den Norske Lægeforening, 2000. 20. Jones TV, Gerrity MS, Earp J. Written case simulations: do they predict physicians behavior? J Clin Epidemiol 1990;43:805 15. 21. Johnson RN, Baker JR. Analytical error of home glucose monitors: a comparison of 18 systems. Ann Clin Biochem 1999;36:72 9. 22. Johnson RN, Baker JR. Error detection and measurement in glucose monitors. Clin Chim Acta 2001;307:61 7. 23. Skeie S, Thue G, Nerhus K, Sandberg S. Instruments for selfmonitoring of blood glucose: comparisons of testing quality achieved by patients and a technician. Clin Chem 2002;48:994 1003. 24. Sacks DB, Bruns DE, Goldstein DE, Maclaren NK, McDonald JM, Parrott M. Guidelines and recommendations for laboratory analysis in the diagnosis and management of diabetes mellitus. Clin Chem 2002;48:436 72. 25. Weiss SL, Cembrowski GS, Mazze RS. Patient and physician analytic goals for self-monitoring blood glucose instruments. Am J Clin Pathol 1994;102:611 5. 26. Hawkins RC. Comparison of four point-of-care HbA1c analytical systems against central laboratory analysis. Singapore Med J 2003;44:8 11. 27. Lim EM, Sikaris KA, Gill J, Calleja J, Hickman PE, Beilby J, et al. Quality assessment of interpretative commenting in clinical chemistry. Clin Chem 2004;50:632 7.