GATE: Graphic Appraisal Tool for Epidemiology picture, 2 formulas & 3 acronyms

Transcription

1 1

2 GATE: Graphic Appraisal Tool for Epidemiology picture, 2 formulas & 3 acronyms 2

3 GATE: Graphic Appraisal Tool for Epidemiology Graphic Architectural Tool for Epidemiology Graphic Approach To Epidemiology making epidemiology accessible 3

4 4 th year medical students 1991

5 Jerry Morris epidemiology = numerator denominator In: Uses of Epidemiology

6

7 Medical Student Pub crawl

8 Dear sir I have just read what you said in the sunday paper From this I can only conclude that you are some sort of fuckwit How dare you describe good food like butter as poisonous How long have you been in this country? I bet you are one of the auckland wankers that drive around with thier lights on

9

10 presentation outline GATE is a framework for: 1. study design 2. study analysis 3. study error 4. practicing EBM 1 picture, 2 formulas & 3 acronyms 10

11

12 GATE: a framework for study design 1 picture every epidemiological study can be hung on the GATE frame 1 picture, 2 formulas & 3 acronyms 12

13 cohort of British doctors 1 picture: GATE frame smoking status allocated by measurement (observation) smokers non-smokers lung cancer events counted yes no followed for 10 years cohort / longitudinal / follow-up study 1 picture, 2 formulas & 3 acronyms 13

14 1 st acronym: PECOT British doctors P Participants randomly allocated to aspirin or placebo Exposure aspirin E C Comparison placebo Outcomes yes MI no O Time 5 years randomised controlled trial T 1 picture, 2 formulas & 3 acronyms 14

15 middle-aged Americans P body mass index measured overweight E C normal weight diabetes status measured in all participants yes no O T cross-sectional (prevalence) study 15

16 middle-aged American women P receive mammogram screening test mammogram positive E C mammogram negative breast cancer yes no O T diagnostic test (prediction) study 16

17 middle-aged American women P Gold Standard breast cancer E C no breast cancer mammogram test positive negative O T diagnostic (test accuracy) study 17

18 P smokers E C non-smokers lung cancer smoking status measured yes no O cases controls T case-control study (all nested in virtual cohort studies) 18

19 $10,000

20

21 GATE: a framework for study analysis: 1 st formula: occurrence = outcomes population the numbers in epidemiological studies can be hung on the GATE frame 1 picture, 2 formulas & 3 acronyms 21

22 1 st formula: occurrence of outcomes = number of outcomes number in population/group British doctors P Participant Population smoking status measured Exposure Group smokers EG CG Comparison Group non-smokers Outcomes Lung cancer yes no a O b T Time 10 years 22

23 British doctors P Population smoking status measured Exposure Group smokers EG CG Comparison Group non-smokers Outcomes Lung cancer yes no a O b T Time 10 years Exposure Group Occurrence (EGO) = a EG = number of outcomes (a) number in exposed population (EG) 23

24 British doctors P Population randomly allocated Exposure Group aspirin EG CG Comparison Group placebo Outcomes MI yes no a O b T Time 5 years Comparison Group Occurrence (CGO) = b CG = number of outcomes (b) number in comparison population (CG) 24

25 Epidemiology = Numerator Denominator middle-aged American women P Participant Population Exposure Group mammogram positive Outcomes breast cancer yes no EGD receive mammogram screening test a N O Comparison Group mammogram negative T Time 25

26 the goal of all epidemiological studies is to calculate EGO and CGO British doctors P smoking status measured smokers EG CG non-smokers EGO: Occurrence (risk) of cancer in smokers yes no a O b Lung cancer 10 years T CGO: Occurrence of cancer in nonsmokers 26

27 Middle-aged Americans P Body Mass Index (BMI) measured High BMI EG CG Low BMI EGO: Average blood glucose in EG high low O CGO: Average blood glucose in CG 27

28 Middle-aged Americans P Body Mass Index (BMI) measured High BMI E C Low BMI blood glucose high low O T cross-sectional study with numerical measures 28

29 Middle-aged American women P Gold Standard Breast cancer E C no Breast cancer mammogram positive negative EGO: likelihood of a positive mammogram if breast cancer O T CGO: likelihood of a positive mammogram if no breast cancer 29

30 1 st formula: occurrence = outcomes population its all about EGO and CGO EGO CGO = Relative Risk (RR) EGO CGO = Risk Difference (RD) measures of occurrence: risk; rate; likelihood; probability; average; incidence; prevalence 30

31

32 GATE: framework for nonrandom error 2 nd acronym: RAMBOMAN Recruitment Allocation Maintenance Blind Objective Measurements ANalyses 1 picture, 2 formulas & 3 acronyms 32

33 Study setting Eligible population recruitment process P P RAMBOMAN Recruitment of participants who are the findings applicable to? 33

34 RAMBOMAN: were participants well Allocated to exposure & comparison groups? was Allocation to EG & CG successful? RCT: allocated by randomisation (e.g to drugs) Cohort: allocated by measurement (e.g. smoking) EG & CG similar at baseline? EG CG EG CG E & C measures accurate? T O T O 34

35 P RAMBOMAN were Participants well Maintained in the groups they were allocated to? T EG CG O completeness of follow-up compliance contamination co-interventions 35

36 P EG CG RAMBOMAN were outcomes well Measured? were they measured Blind to whether participant was in EG or CG? T O 36

37 P RAMBOMAN were outcomes well Measured? EG CG were they measured Objectively? T O 37

38 P RAMBOMAN were the ANalyses done well? EG A EG C CG A CG C If RCT were Intention To Treat (ITT) analyses done? T a O b 38

39 P RAMBOMAN were the ANalyses done well? EG CG adjustment for baseline differences / confounding? T O 39

40 GATE: random error: 2 nd formula: random error = 95% confidence interval sample from a population EGO ± 95% CI CGO ± 95% CI There is about a 95% chance that the true value in the underlying population lies within the 95% CI (assuming no non-random error) 1 picture, 2 formulas & 3 acronyms 40

41 GATE: a framework for error in systematic reviews & meta-analyses: 3 rd acronym: FAITH 1 picture, 2 formulas & 3 acronyms 41

42 systematic review: a study of studies study sources studies screened studies appraised & allocated: included excluded studies summarised & pooled if homogeneous 42

43 critical appraisal of SR: FAITH Find study sources studies screened Appraise studies appraised & allocated: Include included excluded Total Heterogeneity? studies summarised & pooled if homogeneous 43 1 picture, 2 formulas & 3 acronyms

44

45 GATE: framework for the 4 steps of EBP 45

46 46 the steps of Evidence Based Practice (EBP): 1. Ask 2. Acquire 3. Appraise 4. Apply & Act

47 EBP Step 1: ASK - turn your question into a focused 5-part PECOT question P 1. Participants 2. Exposure E C 3. Comparison 4. Outcomes yes no O T 5. Time 47

48 EBP Step 2: ACQUIRE the evidence use PECOT to help choose search terms P Participants Exposure E C Comparison Outcomes yes no O T Time 48

49 EBP Step 3: APPRAISE the evidence with the picture, acronyms & formulas P P Recruitment E C E C Allocation Maintenance blind O T T O objective Measurements ANalyses Occurrence = outcomes population Random error = 95% Confidence Interval 49

50 APPLY the evidence by AMALGAMATING the relevant information & making an evidencebased decision: the X-factor 50

51 51

52 X-factor: making evidence-based decisions person family community practitioner values & preferences epidemiological evidence patient s clinical circumstances system features economic legal political Practitioner expertise: putting it all together - the art of practice Clinical expertise in the era of evidence-based medicine and patient choice. EBM 2002;736-8 (March/April) 52

53 GATE critically appraised topic (CATs) forms download from bottom of the 2015 web page at:

54 GATE CAT 4-sheet workbook (in Excel) sheet 1: GATE-Ask & Acquire 54

55 GATE CAT 3-sheet workbook (in Excel) sheet 2: GATE-Appraise (with calculator) 55

56 GATE CAT 3-sheet workbook (in Excel) sheet 3: GATE-Apply 56

57 GATE CAT : GATE-Appraise (with print versions of GATE frame, calculator & text) 57

58

59

60 60