Valuation of the SF-6D Health States Is Feasible, Acceptable, Reliable, and Valid in a Chinese Population

Similar documents
Is the standard SF-12 Health Survey valid and equivalent for a Chinese population? Citation Quality Of Life Research, 2005, v. 14 n. 2, p.

How is the most severe health state being valued by the general population?

Mapping the EORTC QLQ C-30 onto the EQ-5D Instrument: The Potential to Estimate QALYs without Generic Preference Data

This is a repository copy of The estimation of a preference-based measure of health from the SF-36.

Cross-cultural adaptation of the SF-36 and SF-12 Physical and Mental Summary Scales on a Chinese Population (abstract)

Valuing health using visual analogue scales and rank data: does the visual analogue scale contain cardinal information?

Effects of Mode and Order of Administration on Generic Health-Related Quality of Life Scoresvhe_

This is a repository copy of A comparison of the EQ-5D and the SF-6D across seven patient groups.

To what extent can we explain time trade-off values from other information about respondents?

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.

Validity of the EuroQoL (EQ-5D) Instrument in a Greek General Population

HEDS Discussion Paper 05/05

Psychometric properties of the Chinese quality of life instrument (HK version) in Chinese and Western medicine primary care settings

EuroQol Working Paper Series

Mapping EORTC QLQ-C30 onto EQ-5D for the assessment of cancer patients

Department of Medicine,Yong Loo Lin School of Medicine, National University of Singapore, Singapore

Learning Effects in Time Trade-Off Based Valuation of EQ-5D Health States

Mapping the Positive and Negative Syndrome Scale scores to EQ-5D- 5L and SF-6D utility scores in patients with schizophrenia

Impact of Chronic Liver Disease and Cirrhosis on Health Utilities Using SF-6D and the Health Utility Index

Validation of the Russian version of the Quality of Life-Rheumatoid Arthritis Scale (QOL-RA Scale)

To what extent do people prefer health states with higher values? A note on evidence from the EQ-5D valuation set

The EuroQol and Medical Outcome Survey 36-item shortform

DAZED AND CONFUSED: THE CHARACTERISTICS AND BEHAVIOROF TITLE CONFUSED READERS

Comparison of Value Set Based on DCE and/or TTO Data: Scoring for EQ-5D-5L Health States in Japan

Final Report. HOS/VA Comparison Project

This is a repository copy of Estimating an EQ-5D population value set: the case of Japan.

Original Research Article Pain Quality of Life as Measured by Utilities

Economic evaluation of end stage renal disease treatment Ardine de Wit G, Ramsteijn P G, de Charro F T

How Does the SF- 36 Perform in Healthy Populations? A Structured Review of Longitudinal Studies

Longitudinal Assessment of Health-Related Quality of Life (HRQL) of Patients With Multiple Sclerosis

UCLA UCLA Previously Published Works

This is a repository copy of Deriving a preference-based measure for cancer using the EORTC QLQ-C30.

Work in progress: please do not quote without authors permission

Prepared by: Assoc. Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies

Funnelling Used to describe a process of narrowing down of focus within a literature review. So, the writer begins with a broad discussion providing b

Using Discrete Choice Experiments with duration to model EQ-5D-5L health state preferences: Testing experimental design strategies

LIHS Mini Master Class

Time Trade-Off and Ranking Exercises Are Sensitive to Different Dimensions of EQ-5D Health States

CHAPTER - III METHODOLOGY

Development of a self-reported Chronic Respiratory Questionnaire (CRQ-SR)

The Chinese University of Hong Kong The Nethersole School of Nursing. CADENZA Training Programme

Assessment of Health State in Patients With Tinnitus: A Comparison of the EQ-5D and HUI Mark III

HEALTH STATUS QUESTIONNAIRE 2.0

Assessment of the SF-36 version 2 in the United Kingdom

STATISTICS 8 CHAPTERS 1 TO 6, SAMPLE MULTIPLE CHOICE QUESTIONS

Supplementary Appendix

Interchangeability of the EQ-5D and the SF-6D in Long-Lasting Low Back Pain

Is EQ-5D a Valid Quality of Life Instrument in Patients With Parkinson s Disease? A Study in Singapore

Japan Journal of Medicine

Validation of the Chinese Juvenile Victimisation Questionnaire

Course Instructors: Mark S. Roberts, MD, MPP Ken Smith, MD, MS Stanley Kuo, MS

Using HAQ-DI to estimate HUI-3 and EQ-5D utility values for patients with rheumatoid arthritis in Spain

Screening for psychiatric morbidity in an accident and emergency department

Comparison of the standard gamble, rating scale, AQLQ and SF-36 for measuring quality of life in asthma

When does quality-adjusting life-years matter in cost-e ectiveness analysis? y

Carol M. Mangione, MD NEI VFQ-25 Scoring Algorithm August 2000

Health State Utility Scores for Cancer-Related Anemia through Societal and Patient Valuations

Adjusting the Oral Health Related Quality of Life Measure (Using Ohip-14) for Floor and Ceiling Effects

Chapter 3: GENERIC INSTRUMENTS

Measurement of health status or health-related quality of

The Scoliosis Research Society-22 questionnaire adapted for adolescent idiopathic scoliosis patients in China: reliability and validity analysis

DEVELOPMENT AND VERIFICATION OF VALIDITY AND RELIABILITY OF

Living Donor Liver Transplantation Patients Follow-up : Health-related Quality of Life and Their Relationship with the Donor

DEVELOPMENT OF A QUESTIONNAIRE TO MEASURE HEARING-RELATED HEALTH STATE PREFERENCES FRAMED IN AN OVERALL HEALTH PERSPECTIVE

Validated questionnaire on diagnosis and symptom severity for functional constipation in the Chinese population

Study Protocol: Comparison of Inconsistency between Time Trade Off and Discrete Choice Experiments in EQ-5D-3 L Health State Valuations

Health Economics & Decision Science (HEDS) Discussion Paper Series

A comparison of injured patient and general population valuations of EQ-5D health states for New Zealand

NBER WORKING PAPER SERIES HOW WAS THE WEEKEND? HOW THE SOCIAL CONTEXT UNDERLIES WEEKEND EFFECTS IN HAPPINESS AND OTHER EMOTIONS FOR US WORKERS

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Making a psychometric. Dr Benjamin Cowan- Lecture 9

Sawtooth Software. The Number of Levels Effect in Conjoint: Where Does It Come From and Can It Be Eliminated? RESEARCH PAPER SERIES

Write your identification number on each paper and cover sheet (the number stated in the upper right hand corner on your exam cover).

15D: Strengths, weaknesses and future development

Part 8 Logistic Regression

How to Measure and Value Health Benefits to Facilitate Priority Setting for Pediatric Population? Development and Application Issues.

Estimating EQ-5D values from the Neck Disability Index and numeric rating scales for neck and arm pain

Kelvin Chan Feb 10, 2015

Tails from the Peak District: Adjusted Limited Dependent Variable Mixture Models of EQ-5D Questionnaire Health State Utility Values

White Rose Research Online URL for this paper:

Can the Hospital Anxiety and Depression (HAD) Scale be used on Chinese elderly in general practice? Lam, CLK; Pan, PC; Chan, AWT; Chan, SY; Munro, C

Unit 1 Exploring and Understanding Data

University of Bristol - Explore Bristol Research. Publisher's PDF, also known as Version of record

Time to tweak the TTO: results from a comparison of alternative specifications of the TTO

Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Testing for non-response and sample selection bias in contingent valuation: Analysis of a combination phone/mail survey

Eastern Mediterranean Health Journal, Vol. 11, No. 3,

A panel data comparison of two commonly-used health-related quality of life instruments

An Overview on Attitudes Towards Organ Donation in Hong Kong

The past 35 years has seen significant progress in methodologies

Addendum: Multiple Regression Analysis (DRAFT 8/2/07)

UTILIZATION OF PRIMARY HEALTH CENTRE SERVICES IN RURAL AND URBAN AREAS: A COMPARATIVE STUDY IN MYSORE TALUK

Reliability, Validity and Responsiveness of the Syncope Functional Status Questionnaire

Magellan Health Services: Using the SF-BH assessment to measure success and prove value

Education and Preferences: Experimental Evidences from Chinese Adult Twins

The Impact of Weekend Working on Well-Being in the UK

VALUE IN HEALTH 21 (2018) Available online at journal homepage:

INTRODUCTION TO ECONOMETRICS (EC212)

Transcription:

Volume 11 Number 2 2008 VALUE IN HEALTH Valuation of the SF-6D Health States Is Feasible, Acceptable, Reliable, and Valid in a Chinese Population Cindy L. K. Lam, MBBS, MD, FRCGP, FHKAM (Family Medicine), 1 John Brazier, PhD, MSc, BA, 2 Sarah M. McGhee, PhD, BSc, BA, Hon. MFPH (RCP UK) 1 1 Department of Community Medicine,The University of Hong Kong, Hong Kong; 2 Health Economics and Decision Science, School of Health and Related Research, University of Sheffield, Sheffield, UK ABSTRACT Objectives: The SF-6D is a preference-based measure of health (PBMH) derived from the SF-36 for economic evaluation. The aim of this study was to find out whether it was feasible, acceptable, reliable, and valid to use the standard gamble (SG) method to generate preference-based values for the SF-6D in a Chinese population. Methods: The SF-6D was translated into Chinese by forward and backward translations. Forty-nine states defined by the SF-6D were selected using an orthogonal design and grouped into seven sets. An age-sex stratified sample of 126 Chinese adults with low education levels valued a set of 7 and the pits (worst) SF-6D health states by the SG method. The data were modeled at the individual and mean levels to predict preference values for all SF-6D states. The quality of data and the predictive power of the models were compared with results from the United Kingdom. Results: All respondents completed the interviews with 3% finding the process very difficult and 21% felt some degree of irritation or boredom. A total of 907 SG valuations (90% out of 1008 observations) were useable for econometric modeling. There was no significant change in the test retest values from 21 subjects. The main mean effect models achieved a good fit with a mean absolute error of 0.054. Some differences between the Chinese and UK preference coefficients were found especially in the physical functioning dimension. The range of SG values predicted by the HK function is slightly longer, with the pits state having a value of 0.152 compared to 0.271 in the UK. Conclusion: It was feasible, acceptable, reliable, and valid to value the SF-6D with the SG method in a Chinese population with relatively low education levels. The results supported the feasibility and validity of valuing PBMH in Asian populations. Further studies are required to determine whether the differences in the SF-6D scoring algorithms between the British and Chinese populations are important. Keywords: Chinese, preference-based measure, SF-6D, standard gamble, validity. Introduction There is increasing demand for the use of healthrelated quality of life (HRQOL) as a preference-based measure of health (PBMH) in health economic analyses to assist decision-making on health policy and resource allocation [1 4]. The Quality Adjusted Life Year (QALY) is recommended for use in costeffectiveness analyses of medical interventions by both the National Institute for Clinical Excellence in the United Kingdom [5] and the Panel on Costeffectiveness in Health and Medicine of the US Public Health Service [2]. To calculate QALYs, HRQOL needs to be valued on the full health to dead scale based on preferences obtained from the general population, where full health is one and being dead is zero. Address correspondence to: Cindy L. K. Lam, Family Medicine Unit, the University of Hong Kong, 3/F., Ap Lei Chau Clinic, 161 Main Street, Ap Lei Chau, Hong Kong SAR. E-mail: clklam@hku.hk 10.1111/j.1524-4733.2007.00233.x It is possible for health states to have a negative value where respondents regard them as worse than being dead [2,3,6,7]. A common way to derive a preference-based index in clinical studies has been to use a PBMH [8,9]. A PBMH has two components: a multidimensional health state classification that describes a patient s health in terms of a level on each dimension and a set of preference-based weights obtained from members of the general population. Widely used examples of PBMH include the EQ-5D [10,11], HUI [12,13], and the SF-6D [14,15]. These have usually been valued in their country of origin, though there is increasing interest in obtaining values from other countries [12,16,17]. The MOS 36-item Short-Form Health Survey (SF- 36) is a widely used HRQOL measure [18,19]. Brazier et al. in the United Kingdom extracted items from the SF-36 to form the SF-6D Health Survey that can be used to generate a six-dimension (6D) multiattribute health states for preference-based valuation [14,15]. 2008, International Society for Pharmacoeconomics and Outcomes Research (ISPOR) 1098-3015/08/295 295 303 295

296 Lam et al. The SF-6D offers a method for deriving a preferencebased index from any SF-36 data set. A preferencebased scoring algorithm for the SF-6D was successfully derived from the general population in the UK by the standard gamble (SG) method. The SF-36 has been validated in Chinese populations in Hong Kong, Taiwan, and Singapore [20 22]. There were significant differences between the Chinese normative scores from those of the United States and UK, which suggested cultural differences in social expectations and values [22,23]. It is likely that significant differences in the preferences for different health states may also exist, and the UK SF-6D preference-based values may not be applicable to the Chinese. Two questions need to be answered before the SF-6D can be applied to Chinese populations. The first is whether Chinese people can generate preferencebased values for multiattribute SF-6D health states, and the second is whether valuation of a representative sample of the SF-6D states could be modeled to produce a scoring algorithm for all possible SF-6D states. SG is the preferred method for preference-based valuation of health but most studies were carried out in Western populations, and little is known about the feasibility, reliability, and validity of this measurement method in Asian populations including the Chinese. The aim of this pilot study was to find out whether it was feasible, acceptable, reliable, and valid to value SF-6D health states with SG in a Chinese population of relatively low education levels. If the results were positive, PBMH such as the SF-6D could be adapted to the world s largest ethnic group who can then be included in global and multiethnic pharmacoeconomic studies. Methods Subjects Chinese adults aged 18 to 75 years old registered with a primary care practice in Hong Kong were stratified into six age-sex groups (male or female aged 18 40, 41 60, or 61 75 years). The computer generated a random list of each group who were contacted in the order of the list by a research nurse for eligibility and willingness to participate in the study. People were excluded if they could not be reached after three telephone calls, refused to participate, could not communicate in Cantonese, or were not ambulatory. People, who were illiterate, defined by self-reported inability to read the newspaper, were also excluded after the first 2 weeks of study because it was found that they had great difficulty in completing the exercises. A total of 126 subjects with 21 from each of the six age-sex groups were recruited from 867 people identified from the lists giving an overall response rate of 14.5%. The majority of the nonrespondents were due to noncontacts. We did not undertake formal sample size calculation. However, previous experience with the SF-6D and more recent work in valuing the HUI2 has demonstrated that 15 values per state is sufficient to estimate an additive model. Three subjects from each group valued each of the seven sets of health states with a total of 18 subjects per health state. A convenient sample of 21 subjects representing different age-sex groups repeated the interview 4 to 8 weeks after the first interview. The sociodemographic characteristics of the subjects are shown in Table 1. Compared with the general population [24], the study sample was older because it was age-stratified. It also had lower education levels (17 Table 1 Sociodemographic characteristics of subjects All subjects (n = 128) Test retest subjects (n = 21) HK general adult population* (n = 5,148,653) Mean (SD) age in years 48 (17.6) 47 (17.5) 42.3 Male/female (%) 50/50 48/52 49/51 Education level (%) No formal education 13.5 9.5 8.4 1 6 years 28.6 23.8 23.7 7 13 years 43.6 42.9 52.7 >13 years 14.3 23.8 15.2 Social class by occupation (%) Professional/assistant professional 5.6 4.8 19.7. Skilled workers 36.5 38.1 32.1 Semi skilled/unskilled workers 34.1 38.1 27.8 Not in paid employment 23.8 19.1 20.4 Marital status (%) Single 23.8 19.0 31.5 Married or living as married 67.5 66.7 60.6 Divorced or separated 3.2 0 1.9 Widowed 5.6 14.3 5.9 *Data from 2001 Hong Kong population Census.The distribution of occupations was calculated from 4,085,731 people whose occupation data were available. Percentages may not add up to 100 because of rounding.

Valuation of SF-6D in a Chinese Population 297 subjects had no formal schooling) and fewer professionals/associate professionals reflecting the patient population of a Government subsidized primary care practice, and fewer people were single because the subjects were older. The sample included eight (6.3%) illiterate subjects who were recruited in the first 2 weeks of the study. Data Collection Procedure A Chinese version of the SF-6D Health Survey was developed by single forward and backward translations by professional translators. The English back translation was evaluated by the developer (Brazier) of the SF-6D, who confirmed that it was equivalent to the original. For such a large descriptive system, with 18,000 combinations of dimension levels, it is only possible to value a sample of these states. To select the states for valuation we used the orthoplan procedure in SPSS [25]. This identifies an orthogonal main effects design that permits the estimation of an additive model to estimate the value for all states defined by the SF-6D. 49 states were randomly selected with the criteria that every level of each dimension was included at least once, different combinations of dimension levels in different states, and the combination of states had occurred in existing SF-36 data sets. These 49 states were grouped into seven sets. Each set consisted of a combination of seven different levels of health states. A six-digit number represents each SF-6D health state, each digit denotes the level of one of six SF-6D dimensions in the order from left to right: physical functioning (PF), role limitation (RL), social functioning (SF), bodily pain (BP), mental health (MH), and vitality (VT). The details of the structure and classification of the SF-6D health states are described in the article by Brazier et al. [15]. Three rounds of seven interview sessions were carried out from December 2002 to January 2003. One set of health states was used and six subjects (one from each age-sex group) were interviewed individually in each session. The seven sets of health states were used in rotation to minimize the interviewer learning effect. Each subject first answered the Chinese version of the SF-6D, then ranked 10 health states (the allocated set of 7, the best and pits [worst] SF-6D health states, and death), valued each of the set of 7 in a random order to reduce bias from the order effect and the pits/death SF-6D health states by SG using visual prop charts as shown in Figure 1, answered a structured questionnaire on demography and finally evaluated the interview experience. The details of the ranking and SG procedures are described in the article by Brazier et al. [15]. This study used the same interview protocol and schedule as the UK study. The interview schedule was translated into Chinese. One modification was made to the UK method by the addition of symbols to the health state cards to indicate the level of wellness of each SF-6D dimension, as shown in Figure 2, to help respondents interpret each health state better. The SG variant was that developed by the McMaster team that uses an iterative ping pong procedure [9,13]. All study instruments were in Chinese and administered by a trained interviewer in Cantonese. The interviewer rated the subject s understanding and concentration in the interview at the end of the interview. Outcome Measures and Data Analysis Feasibility was assessed by the completion rate of the interviews, proportion of states with useable values, duration of the interview, interviewer ratings on the subject s understanding and concentration, and subject ratings on the degree of difficulty of the exercises, quality of answers and the number of health dimensions considered before making the choice. Acceptability was assessed by subject ratings on the amount of effort and degree of irritation or boredom. Test retest reliability of the SF-6D health states preferences of 21 subjects were analyzed by the mean difference between test and retest results (statistical significance tested by paired t-test), and intraclass correlation (ICC). The validity of the valuations was tested by the fitting of data into econometric models, model predictive ability and consistency of model coefficients with the ordinality of the SF-6D. The results were compared with those found in the UK population. Data were not usable if the respondents valued all states the same, valued less than 2 states or failed to value the pits state. Each respondent s health state values were chained using valuation of the pits onto the full health-death scale. The pits health state was valued on the full health-dead scale where full health is one, dead is zero and it could take a negative value bounded by -1. The values for the 7 intermediate health state values were transformed onto the conventional zero to one scale using the value for the pits state. These adjusted SG values form the dependent variable (y) in the models discussed below. Modeling All respondents with useable data were included whether or not they had missing values. Models have been estimated at the mean level; that is, the explanatory variables were used to estimate the mean value given to each of the states by the respondents that valued them. Models have also been estimated at the individual level that takes into account the variation across respondents using a random effects (RE) model. The modeling methods are the same as for the UK study and for a fuller account the reader should consult the article by Brazier et al. [15]. The explanatory variables have been classified into two groups. First, a set of binary dummy variables (x dl) that describe each level l and dimension d of the health

298 Lam et al. Perfect Health Card (Pink) Death Card (Blue) Choice B Choice A SF-6D Health State Card Figure 1 Visual props for standard gamble exercises. state. For example, x 31 denotes dimension d=3 (social functioning), level l=1 (health limits social activities none of the time). For any given health state, x dl will be defined as: x dl = 1 if, for this state, dimension d is at level l, and x dl = 0 if, for this state, dimension d is not at level l. In all cases level l=1 acts as the baseline for each dimension. Second, there is a binary dummy variable to take account of any additional effect on health state value when one or more dimension of health is at the most severe level. Most severe is defined as level 3 for physical functioning, levels 3 and 4 for role limitation and levels 4 and 5 for social functioning, pain, and mental health, and level 5 for vitality. In both cases the intercept in the regression model is restricted to equal unity. In theory this term represents the value of full health, i.e., when each dimension of the heath state is at level 1. However, in practice estimates of the intercept are usually less than one [15]. The techniques employed in the valuation survey are based on the assumption that state 111111 is equal to one and death is equal to zero. For state 111111 to hold any other value would change the scale, hence the restriction is imposed. The models presented in this article were estimated by the ordinary linear square (OLS) mean level model with constant forced through unity and via maximum likelihood for the RE model with the MOST term included to account for interactions. Explanatory Card 003 SF-6D Health State 113411 1) 2) (Your health does not limit you in vigorous activities (such as running, lifting heavy objects, participating in strenuous sports) 3) (You have no problems with your work or other regular daily activities as a result of your physical health or any emotional problems) (Your health limits your social activities (like visiting friends, relatives etc.) some of the time) 4) 5) 6) (You have pain that interferes with your normal work (both outside the home and housework) moderately) (You feel tense or downhearted and low none of the time) (You have a lot of energy all of the time ) Figure 2 An example of one of the Chinese SF-6D health state cards (003) with symbol aids (The original English descriptions are shown in brackets.). Notes: The maximum number of levels of each dimension is indicated by the total number of symbols, and the level of each dimension is indicated by the number of symbols colored with a larger number indicating a better level. Circles instead of stars were used for the dimension on role-limitation to highlight its difference from the other dimensions in that it differentiates between the limitation from physical and mental health.

Valuation of SF-6D in a Chinese Population 299 Table 2 Feasibility and acceptability of standard gamble (SG) and ranking exercises Proportion of subjects (N = 126) Interviewer rating Problem in performing task (%) Effort and concentration (%) Subject evaluation None (77.8) Some (18.3) A lot (4.0) Great (87.3) Some (9.5) Little (3.2) Challenge level of task Easy (35.7%) 27.0 8.7 0 29.4 5.6 0.8 Neutral (36.5%) 32.5 2.4 1.6 33.3 3.2 0 Difficult (27.8%) 18.3 7.2 2.4 24.6 0.8 2.4 Tried best to answer Yes (99.2%) 77.8 17.5 4 86.5 9.5 3.2 No (0.8%) 0 0.8 0 0.8 0 0 Number of dimensions considered in SG One (2.4%) 0.8 1.6 0 2.4 0 0 Two (5.6%) 3.2 2.4 0 4.0 1.6 0 Three (77.8%) 67.5 9.5 0.8 73.0 4.8 0 Not sure (14.3%) 6.3 4.8 3.2 7.9 3.2 3.2 Quality of answers Very good/good (42%) 36.5 5.6 0 38.9 3.2 0 Average (56.4%) 41.3 11.9 3.2 47.6 5.6 3.2 Poor (1.6%) 0 0.8 0.8 0.8 0.8 0 Felt bored or irritated Yes (21.4%) 17.5 2.4 1.6 17.5 3.2 0.8 No (78.6%) 60.3 15.9 2.4 69.8 6.3 2.4 Percentages may not add up to total because of rounding. power for the OLS model is expressed in terms of an adjusted R-Squared. However, the overall aim is to predict health state values and this has been assessed in terms of mean absolute errors (MAE) and the proportion of predictions outside 0.05 and 0.10 ranges on either side of the actual value. Predictions were further tested in terms of bias (t-test). All analysis was carried out in STATA 8 and SPSS for Windows 12.0. Results Feasibility and Acceptability All 126 respondents completed all parts of the questionnaire and therefore the completion rate was 100%. Three subjects gave the same value for all the health states, suggesting that they probably did not understand the process. The mean time for completing the whole interview was 48.9 min (SD 17.8, ranged from 20 to 145). Table 2 shows the interviewer and subject evaluations on the process of the ranking and SG exercises. There was good concordance between the interviewer ratings and subject evaluations. Most subjects seemed to be able to perform and concentrate on the tasks. The majority (77.8%) of subjects said that they considered three or more dimensions in the SG decision indicating that it was feasible to generate a preference-based value for a multiattribute health state. Although 3.2% of subjects found the task very difficult and 24.6% found it a bit difficult, very few (1.6%) thought the quality of their answers was poor. The process was acceptable to most subjects with only 27 (21.4%) reporting some degree of irritation or boredom, which occurred during the ranking exercise in 12 (9.5%) and the SG exercises in 13 (10.3%) of them. Two subjects who felt irritated or bored could not decide when this occurred. Test Retest Reliability The ranking of the best health state card as the top was consistent in both interviews for all 21 respondents. On the other hand, five (24%) subjects reversed the order of the pits and death cards between the first and second interviews (three ranked death the lowest in the first interview but the pits health state lowest in the second interview; and two ranked the pits health state the lowest in the first interview but death the lowest in the second interview). There were 158 paired health state values for the assessment of the test retest reliability after exclusion of the 10 unpaired pits/death heath card values. The mean difference was -0.026 (95% CI -0.069 0.017), which was not statistically significant by the paired t-test (t =-1.174, P = 0.242). ICC was 0.787 (95% CI 0.708 0.844), which was above the standard of 0.7 for group comparison [26]. SF-6D Valuations Each of 126 subjects valued seven SF-6D health states and pits/death resulting in 1008 observations (882 nonpits values and 126 pits/death values). The health state values were evenly distributed between the 49 health states generated by orthoplan. Fourteen subjects (three of them valued all states the same) failed to provide values for the pits state and this resulted in further state values being excluded because they could not be adjusted (although for states regarded as equivalent to full health this does not prevent the

300 Lam et al. Table 3 Chinese Mean SG values of the SF-6D health states in HK SF-6D state Mean SD Number of subjects 211111 0.9511029 0.19557202 17 121212 0.8480469 0.23562106 16 133132 0.8182500 0.23258485 15 332411 0.7767917 0.24650219 15 321122 0.7697794 0.26932578 17 113411 0.7636765 0.30580276 17 241531 0.7625000 0.24747517 16 312332 0.7547794 0.27352096 17 213323 0.7519853 0.27595822 17 412152 0.7353676 0.25749270 17 122233 0.7239338 0.27763649 17 232111 0.7219531 0.27640473 16 132524 0.6859559 0.31837740 17 235224 0.6848162 0.26826189 17 124125 0.6800000 0.27896747 17 341123 0.6733594 0.22667374 16 142154 0.6632353 0.32026724 17 221452 0.6466912 0.29377558 17 135312 0.6364844 0.26115737 16 421314 0.6340625 0.18641994 16 425131 0.6296094 0.27767702 16 414522 0.6275000 0.28420531 17 534113 0.6181618 0.28724381 17 522321 0.6086719 0.25416918 16 511114 0.6086458 0.36760367 18 115653 0.5987500 0.30147878 17 545422 0.5955882 0.37378321 17 432621 0.5918750 0.32314588 14 431443 0.5856985 0.34849662 17 443215 0.5760833 0.22909511 15 144341 0.5757500 0.22548846 15 633122 0.5682031 0.28411558 16 212145 0.5577344 0.29843209 16 131542 0.5571094 0.29907347 16 622513 0.5631618 0.35196994 17 523551 0.5542500 0.37587927 15 323644 0.5525735 0.34145898 17 334251 0.5425781 0.30739445 16 122425 0.5353125 0.31822375 16 611221 0.5315809 0.36160194 17 512242 0.5307031 0.29561446 16 111621 0.5264063 0.28821428 16 631355 0.5263235 0.30488102 17 224612 0.5147500 0.21962031 15 642612 0.4946875 0.28224675 16 315515 0.4931250 0.26787357 16 614434 0.4864167 0.39980823 15 531635 0.4612500 0.22514926 15 625141 0.3375000 0.24341323 15 645655* 0.0935268 0.41353434 112 *The pits state (645655) was valued by all subjects but data were missing from 14 subjects. SG, standard gamble. values from being used because pits adjustment makes no difference). In all there were 907 (90%) useable health state values. Table 3 shows the mean values and number of useable values of the 49 randomly selected and pits health states of the SF-6D. The mean health state values ranged from 0.094 for pits (645655) to 0.95 for the best state (211111) included in the study. The skewness in the data can be seen at the individual level. A histogram for the 907 individual health state values is shown in Figure 3. They show that negative values did occur, but as in the UK a large proportion lie between 0.9 and 1.0 (20%). There were few valuations at 1.0 (37/907) indicating that most respondents were willing to risk a worse health state to have a chance of a better state. Modeling The results of the RE and OLS modeling of the individual level valuation data are presented in Table 4, including the beta coefficients estimated for each dimension level, model predictive ability (MAE and number of absolute errors greater than 0.05 or 0.10) and the number of inconsistent preference-based coefficients, compared with results from the UK. All the beta coefficients had the expected negative sign in the models and 21 out of 23 were significant at the 10% level in the RE model. The MAE in the RE model were 0.089 compared to 0.078 in the UK. The only significant inconsistent coefficients were found between MH2 (-0.069) and MH3 (-0.042) in the RE model; MH3 is hypothesized as a lower health state level (should have a larger negative coefficient) than MH2 but the reverse was found in the model. The UK model had four such inconsistencies. As in the UK, there was evidence of some bias (t 0) in the predictions of the RE model. The results of the mean level OLS model were better in terms of model predictive ability as indicated by a lower MAE (0.054) and lower proportions with absolute errors greater than 0.05 or 0.10, which were slightly better than the UK results. There was also one inconsistency, though this time with the MH5 (-0.095) and MH4 (-0.128), in that MH5 had a smaller negative coefficient though it was hypothesized to be a lower level of mental health than MH4. 300 200 100 0 -.7 -.5 -.3 -.1 0.1.3.5.7.9 SG score Figure 3 Histogram for adjusted standard gamble (SG) valuations (n = 907). Notes: In total, 907 (90%) of 1008 observations from 126 subjects each of whom valued seven SF-6D health states and pits/death were useable after exclusion of data from 101 observations for which the adjusted value could not be calculated because the subjects did not value pits. Each column indicates the number of observations that had SG scores within the range bounded by the column.

Valuation of SF-6D in a Chinese Population 301 Table 4 SF-6D health state HK and UK models* Hong Kong (1) RE model (constant forced to unity) UK (2) Hong Kong (3) OLS Mean model (constant forced to unity) UK (4) PF2-0.020-0.058-0.060-0.060 PF3-0.045-0.051-0.073-0.020 PF4-0.066-0.088-0.099-0.060 PF5-0.132-0.061-0.157-0.063 PF6-0.219-0.160-0.232-0.131 RL2-0.032-0.056-0.065-0.057 RL3-0.009-0.076-0.053-0.068 RL4-0.049-0.078-0.067-0.066 SF2-0.030-0.066-0.052-0.071 SF3-0.027-0.048-0.036-0.084 SF4-0.083-0.066-0.113-0.093 SF5-0.115-0.109-0.131-0.105 PAIN2-0.048-0.042-0.075-0.048 PAIN3-0.022-0.046-0.068-0.034 PAIN4-0.081-0.055-0.082-0.070 PAIN5-0.092-0.103-0.103-0.107 PAIN6-0.155-0.178-0.183-0.181 MH2-0.069-0.043-0.069-0.057 MH3-0.042-0.055-0.037-0.051 MH4-0.138-0.115-0.172-0.121 MH5-0.146-0.125-0.098-0.140 VIT2-0.024-0.040-0.026-0.094 VIT3-0.062-0.030-0.031-0.069 VIT4-0.076-0.040-0.060-0.069 VIT5-0.117-0.087-0.137-0.106 N 907 3518 50 249 adj R 2 0.952 0.508 Inconsistencies 1 4 1 5 MAE 0.089 0.078 0.054 0.074 AE > 0.05 34/50 (68%) 122/249 (49%) 20/50 (40%) 118/249 (47%) AE > 0.10 20/50 (40%) 59/249 (24%) 8/50 (16%) 52/249 (21%) t -8.01-6.717 *The coefficients in bold are significant at t 0.10. No R 2 statistics (GEE estimation). mean is zero by definition. Inconsistencies, number of significant coefficients whose rank order is not consistent with that of the health state levels. adj R 2, adjusted R 2 ; AE, Absolute errors; GEE, generalized estimating equations; MAE, Mean absolute errors. OLS, ordinary linear square; RE, random effects. The SF-6D preference value can be calculated by summating the corresponding coefficients (with the negative signs) of the dimension-levels with 1. Using the OLS Mean model, the minimum SF-6D value is 0.152 with the HK function, which was lower than the 0.271 with that of the UK. Discussion The results of this pilot study supported the feasibility, reliability, and validity of using the SG method to generate preference-based health values for the SF-6D in a Chinese population of relatively low education levels. SG is the recommended method of preferencebased health valuation because it is most consistent with the original von Neumann-Morgenstern theory [9]. However, there was concern about whether SG could be applied to people with low education levels because it demands the respondent to think in abstract terms of probability [27]. Our study sample included a large proportion of people who had less than 6 years of formal education, with 17 (13.5%) of them having none and eight (6.3%) being illiterate, all but three (2.4%) of whom were able to complete the exercises and give valid values. Lo et al. also used the SG method to generate preference values for the rhinitis symptom utility index in Chinese patients with allergic rhinitis but their subjects were young (aged 18 61 years) and better educated (74% had >6 years education) [28]. We found the use of symbols to indicate the relative level of each dimension in the health state card was effective in helping subjects with low literacy level to grasp the condition described. On the other hand, use of symbols could introduce bias. The choice of symbols was particularly challenging for the SF-6D that has different number of levels for different dimensions. We used the same star symbol for all dimensions except that of role-limitation (RL) in order not to highlight any particular dimension. A different symbol in the form of two rows of circles, one for physical and one for mental health effect, was used for the RL dimension because its composition was very different from those of other dimensions. It was explained very clearly to the subjects that a level with more stars in one dimension did not imply it was better than a level in another dimension that had fewer stars, and each dimension level should be considered in the context of the total number of levels in that particular dimension.

302 Lam et al. The proportion (90%) of useable data in our study was higher than that obtained in the UK study (70%) [15], mainly because we used only two very experienced interviewers who ensured that respondents valued the pits/death state along with all the others. There was a wide range of health state values although most were within a range of 0.4 0.9, which showed that subjects were discriminating between health states. The mean value of the pits health state (0.093) was much lower than that found in the UK (0.21). On the other hand, a lower proportion of subjects (14/126 = 11%) than that in the UK (166/611 = 28%) thought the pits health state was worse than death [15]. This indicated possible differences in health preferences between the two cultures and deserves further investigations. As for the UK, the mean health state values were broadly consistent with the health levels of the SF-6D. It was interesting to note that state 321122 (0.7697794) had a higher value than state 232111 (0.7219531) even though the former had more dimensions with lower levels than the latter. This showed the complexity of preference-based health valuation in that one dimension (e.g., role limitation) might be valued much more highly than other dimensions and the relative trade-offs between different health dimensions might not be the same at different levels. The performance of the HK model compared very favorably with that of the UK in terms of its predictive ability measured by the MAE and the number of absolute errors greater than 0.05 or 0.10. The results supported the validity of preference-based valuation by SG of the SF-6D in a Chinese population for the generation of scoring algorithms applicable to the Chinese. More sophisticated models could be tested with data obtained from a larger sample of health states. There was only one inconsistency between the models coefficients and the SF-6D hypothesized levels, between levels 4 and 5 of the mental health (MH) dimension for the mean OLS model and MH2 and MH3 for the RE model. The number of inconsistencies was fewer than that found in the UK further supporting the validity and quality of the data from the Chinese population. This is very encouraging given the relatively smaller size of the HK sample compared to the UK. The HK Chinese SF-6D preference-based coefficients found in this study tended to be larger (bigger discount in preference) than those found in the UK, but this finding was not consistent across all dimensions or levels. Nearly all the Chinese coefficients in the physical functioning (PF) and bodily pain (BP) dimensions were larger than those found in the UK, and some of the differences were quite large (>0.05). On the other hand, the Chinese coefficients for the vitality (VT) dimension tended to be smaller than those found in the UK. The range of the SF-6D values predicted by the HK function is longer, suggesting that it might have less floor effect than the UK algorithm. However, this result should be interpreted with some caution because it is based on a small pilot sample. Further studies are needed to confirm the population differences and determine whether they are important. Limitations The feasibility and validity of generating preference values with the SG method is only indirect evidence of the validity of the concept of PBMH in the Chinese population. Further qualitative explorative studies are needed to confirm the concept of PBMH and whether it has the same meaning in the Chinese culture as that found in the Western culture. The study sample was small and the response rate was low, which limit the generalizability of the preference values found. The order of rotation of the seven sets of health states was not randomized and we cannot exclude a possible order effect although it should be minimal. The small number of states valued might affect the accuracy of the econometric modeling. Therefore, the SF-6D preference-based coefficients generated from this pilot study should not be regarded as representative of the general population of HK or any other Chinese population. Further studies with a larger and more representative sample from the general population are needed to determine the HK Chinese specific SF-6D scoring algorithm. The ranking exercise was carried out before the SG exercises in this study with the intention to familiarize subjects to different health states and to think in terms of relative preferences [9]. Unfortunately, we found that this became an obstacle in the study process especially for people who could not read so much so that we had to exclude subjects who were illiterate from our study after the first 2 weeks, though they were able to carry out the SG. The exclusion of people with low literacy levels could bias the valuation results because people from different socioeconomic backgrounds may have different health preferences. Further studies should be carried out to find out how illiterate people could be included in preference valuation studies and whether the exclusion of the ranking exercise would affect the results of SG. Conclusion This pilot study confirmed that it was feasible, acceptable, reliable, and valid to generate preference values with the SG method for the SF-6D in a Chinese population with relatively low education levels. The results are very encouraging, and suggest that the concept of PBMH and preference measurement by SG may also be applicable to other Asian populations with low education levels. The performance of the econometric models derived from the Chinese data compared favorably to that obtained from the United Kingdom. The findings

Valuation of SF-6D in a Chinese Population 303 support the applicability of the SF-6D to Chinese populations, which has a lot of potential because its parent HRQOL measure, the SF-36, is widely used in this ethnic group that makes up nearly a quarter of the world s population. Some differences were found in the SF-6D preference-based coefficients between the Chinese and UK populations. Further studies are required to establish the Chinese specific SF-6D scoring algorithm, and to find out whether population differences in preference values are clinically important. We would like to thank Daisy Chou, June Chau, and Annie Cheung for their help in subject recruitment, data collection and analysis. All authors contributed to the planning of the study, supervision of the data collection, data analysis, and writing of the article. Source of financial support: The study was funded by a seed grant from the Center on Behavioral Health, the University of Hong Kong. The study was approved by the Ethics Committee of the Faculty of Medicine, the University of Hong Kong (EC 1757-01). References 1 Russell LB, Gold MR, Siegel JE, et al. The role of cost-effectiveness analysis in health and medicine. JAMA 1996;276:1172 7. 2 Weinstein MC, Siegel JE, Gold MR, et al. Recommendation of the panel of cost-effectiveness in health and medicine. JAMA 1996;276:1253 8. 3 Weinstein MC, Stason WB. Foundations of costeffectiveness analysis for health and medical practices. N Engl J Med 1977;296:716 21. 4 Patrick DL, Erickson P. Applications of health status assessment to health policy. In: Spilker B, ed. Quality of Life and Pharmacoeconomics in Clinical Trials. Philadelphia, PA: Lippincott-Raven Publishers, 1996. 5 National Institute for Clinical Excellence (NICE). Guide to the Methods of Technology Appraisal. London: National Health Services, 2004. 6 Feeny DH, Torrance GW, Labelle R. Integrating economic evaluations and quality of life assessments. In: Spilker B, ed. Quality of Life and Pharmacoeconomics in Clinical Trials. Philadelphia, PA: Lippincott-Raven Publishers, 1996. 7 Palmer S, Byford S, Raftery J. Types of economic evaluation. BMJ 1999;318:1349. 8 Torrance GW. Utility approach to measuring healthrelated quality of life. J Chronic Dis 1987;40:593 600. 9 Torrance GW, Feeny DH. Utilities and qualityadjusted life years. Int J Technol Assess Health Care 1989;5:559 75. 10 EuroQol Group. EuroQol a new facility for the measurement of health-related quality of life. Health Policy 1990;16:199 208. 11 Brooks R, EuroQol Group. EuroQol: the current state of play. Health Policy 1996;37:53 72. 12 Furlong WJ, Feeny DH, Torrance GW, et al. The Health Utilities Index (HUI) system for assessing health-related quality of life in clinical studies. Ann Med 2001;33:375 84. 13 Furlong W, Feeny D, Torrance GW, et al. Guide to Design and Development of Health State Utility Instrumentation. Centre for Health Economics and Policy Analysis Paper 90 9. Hamilton, ON: McMaster University, 1990. 14 Brazier J, Usherwood T, Harper R, et al. Deriving a preference-based single index from the UK SF-36 Health Survey. J Clin Epidemiol 1998;51:1115 28. 15 Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ 2002;21:271 92. 16 Tsuchiya A, Ikeda S, Ikegami N, et al. Estimating an EQ-5D population value set: the case of Japan. Health Econ 2002;11:341 53. 17 Badia X, Roset M, Herdman M, et al. A comparison of United Kingdom and Spanish general population time trade-off values for EQ-5D health states. Med Decis Making 2001;21:7 16. 18 Ware JE, Snow KK, Kosinski M, et al. SF-36 Health Survey Manual & Interpretation Guide. Boston: The Health Institute, New England Medical Center, 1993. 19 Ware JE. SF-36 health survey update. Spine 2000;25:3130 9. 20 Lam CLK, Gandek B, Ren XS, et al. Tests of scaling assumptions and construct validity of the Chinese (HK) version of the SF-36 Health Survey. J Clin Epidemiol 1998;51:1139 47. 21 Thumboo J, Fong KY, Machin D, et al. A communitybased study of scaling assumptions and construct validity of the English (UK) and Chinese (HK) SF-36 in Singapore. Qual Life Res 2001;10:175 88. 22 Tseng H, Lu JF, Gandek B. Cultural issues in using the SF-36 Health Survey in Asia: results from Taiwan. Health Qual Life Outcomes 2003;1:72 80. 23 Lam CLK, Lauder IJ, Lam TP, et al. Population based norming of the Chinese (HK) version of the SF-36 Health Survey. H K Pract 1999;21:460 70. 24 Census & Statistics Department Hong Kong. Main Tables of the 2001a Population Census. Hong Kong: Census & Statistics Department, HKSAR, 2002;1 346. 25 SPSS Inc. SPSS for Windows 12.0. Chicago, IL: SPSS Inc, 2003. 26 McDowell I, Newell C. The theoretical and technical foundations of health measurement. In: Mcdowell I, Newell C, eds. Measuring Health A Guide to Rating Scales and Questionnaire. New York: Oxford University Press, 1996. 27 Torrance GW. Social preferences for health states: an empirical evaluation of three measurement techniques. Socio-Econ Plan Sci 1976;10:129 36. 28 Lo PSY, Tong MCF, Revicki RA, et al. Rhinitis symptom utility index (RSUI) in Chinese subjects: a multiattribute patient-preference approach. Qual Life Res 2006;15:877 87.