The HeartQol questionnaire. Reliability, validity and responsiveness?

Transcription

1 The HeartQol questionnaire. Reliability, validity and responsiveness? Stefan Höfer, PhD, MSc Associate Professor Medical University Innsbruck

2 The HeartQoL Story Data collection: Presentations: 2006 (EuroPrevent Athens) : : : : 22 Minutes 2012 (EuroPrevent Dublin)

3

4 Global HRQL Physical HRQL Emotional HRQL Range: 0 (low) 3 (high)

5 Reliable, valid, responsive Reliable: yes/don t know Valid: yes Responsive: yes

6 HeartQoL Project: International 21 countries 15 languages n= 6,384 Australia; Canada; USA SE: Portugal, Spain UK, Ireland NE: Denmark, Norway, Sweden WE: Austria, Belgium, France, Netherlands, Germany, Switzerland SE: Italy EE: Hungary, Poland, Russia, Ukraine

7 Sample mi primary: 37.3% angina primary: 33.1% heart failure primary: 29.6% Age: 62.5±11.3 mi primary: 59.7±11.7*** angina primary: 63.1±10.2*** heart failure primary: 65.1±11.5 ***

8 HeartQoL patient profiles: International cohort summary HeartQoL Age / % male 62.3 / 75% BMI 27.4 Smoking 15.1% Diabetes 20.6% Treated for 90.1% Hypertension 55.4% Treated for 95.9% Hypercholesterolemia 59.6% Treated for 92.1% EuroAspire III 61.9 / 73% % 28% 35% 61% 89% 46% 88%

9 Criteria of HRQoL Instruments Conceptual and measurement model Reliability Validity Responsiveness Interpretability Alternative forms Respondent and administrative burden Objectivity Cultural and language adaptations Scientific Advisory Board, Quality of life Resaerch, 2002

10 Conceptual & measurement model MacNew MI Q 27 items 3 sub-scales: Physical Social Emotional Sub-scale scores Total Score Seattle Angina Q 19 items 5 sub-scales Physical limitation Angina stability Angina frequency Treatment satisfaction Disease perception Sub-scale scores Minnesota Living with Heart Failure Q 21 items 2 sub-scales Physical Emotional Sub-scale scores Total score

11 Conceptual & measurement model MacNew MI Q 27 items 3 sub-scales: Physical Social Emotional Sub-scale scores Total Score Seattle Angina Q 19 items 5 sub-scales Physical limitation Angina stability Angina frequency Treatment satisfaction Disease perception Sub-scale scores Minnesota Living with Heart Failure Q 21 items 2 sub-scales Physical Emotional Sub-scale scores Total score 49 items

12 What we did Item reduction from 49 item to as few as possible: Clinical impact method Mokken scaling Item response theory Pre-testing the prototype instrument Decision about scoring method Determination of reliability Validation Finally: 14 items

13 Reliability Is an instrument free from random error? Internal consistency the precision of a scale: i.e.: Cronbach s alpha Reproducibility stability over time: i.e.: Test-retest reliability

14 Reliability Cronbach s a Total group Angina MI Heart Failure Global score Physical score Emotional score Cronbach s a: Group comparison: >0.70 Individual comparison: >0.90

15 Reliability compared (i.e.) Cronbach s a Total group Angina MI Heart Failure Global score Physical score Emotional score Angina HeartQoL - physical.89 SF-36 - PCS SAQ physical limitations MacNew physical HRQL

16 Validity Does an instrument measure what it purports to measure? Content-related: Evidence that the domain of an instrument is appropriate relative to its intended use Construct-related: Evidence that supports a proposed interpretation of scores based on theoretical implications associated with the constructs being measured Criterion-related: Evidence that shows the extent to which scores of the instrument are related to a criterion measure

17 Convergent Validity SF-36 PCS SF-36 MCS p-value H-physical ++ - <.001 H-emotional - ++ <.001 p-value <.001 <.001

18 Convergent Validity SF-36 PCS SF-36 MCS p-value H-physical 0.68** 0.36** <.001 H-emotional 0.28** 0.60** <.001 p-value <.001 <.001 Same pattern for each diagnosis Same pattern in each country

19 Discriminative Validity 3 2,5 2,4 2,3 2,5 2 1,8 1,9 1,9 1,5 1 non-depressed depressed 0,5 0 Angina MI Heart Failure Same pattern for each diagnosis Same pattern in each country

20 Discriminative Validity 3 2,5 2 2,3 2,1 2,2 1,9 1,5 1 CCS/NYHA II CCS/NYHA III/IV 0,5 0 Angina Same pattern for each diagnosis Same pattern in each country Heart Failure

21 Responsiveness Is an instrument able to detect change over time? Evidence on the changes in scores of the instrument Longitudinal data that compare a group that is expected to change with a group that is expected to remain stable

22 PCI: N=398 CR: N=383 3 Responsiveness 2,5 ** 2,4 2 2 ** 2 1,5 1 1,7 PC Rehab 0,5 0 Baseline Follow-up

23 Responsiveness 0,7 Effektsize statistics SRM 0,6 0,5 0,4 0,3 0,2 Medium SF-36 HeartQoL Small 0,1 0 PCI Rehab PCI Rehab Physical Scales Emotional Scales

24 Criteria of HRQoL Instruments Conceptual and measurement model Reliability Validity Responsiveness Interpretability Alternative forms Respondent and administrative burden Objectivity Cultural and language adaptations Scientific Advisory Board, Quality of life Resaerch, 2002

25 Interpretability Are the numbers produced easily understood? Meaningful benchmarks to facilitate interpretation of the scores ( norms )... Pre post change... Clinical important difference What does a change of 0.3 on the HeartQoL actually mean?

26 Summary: HeartQoL Reliable: yes/don t know Valid: yes Responsive: yes

27 HeartQoL - Future To check for: test-stability interpretability Comparing with current gold standard(s) i.e. MacNew Health-related quality of life instrument Application