NJR 2009 NJR Activity 2008 Keith Tucker Survivorship Analysis Martyn Porter Outliers Paul Gregg Clinician Feedback Peter Howard

Transcription

1 NJR 2009 NJR Activity 2008 Keith Tucker Survivorship Analysis Martyn Porter Outliers Paul Gregg Clinician Feedback Peter Howard

2 NJR ACTIVITY A few highlights Keith Tucker NJR Steering Committee

3 NJR Activity NJR database now stands at > 742,706 entries 160,227 uploads, the busiest year so far Compliance (registrations as % of levies) 92.5% Consent 87.4% Linkability 92.5% (Overall NJR linkability 77.4%)

4 Operations

5 KNEES

6 2008 KNEES

7 KNEE BRANDS

8 HIPS

9 2008 HIPS

10 Cemented stems

11 Cementless stems

12 Cemented cups

13 Cementless cups

14 Resurfacing

15 Head Size

16 ASA & BMI We seem to be operating on less fit patients

17 Hips? Less fit patients

18 Knees?Less fit patients

19 BMI Hips

20 BMI Knees

21 ODEP 10A Benchmark 76% Cemented Stems 77% Cementless Stems 49% Cemented cups 11% Cementless cups 45% Surface Replacements (BHR 10A)

22 Acknowledgements Claire Newell NJR Data quality manager (Northgate public services) Martyn Porter Peter Howard Paul Gregg

23 THANK YOU

24 Survivorship Analysis Martyn Porter Wrightington Hospital Chair NJR Editorial Board NJR Steering Committee

25 Methodology Changes Linkage to HES and NJR to identify revisions Changes in methods to identify revisions in HES Capture of revision hip increased by 200% Capture of revision knee increased by 300% Reporting period for linked data extended to Oct 2008 ( was June)

26 Linkage Mechanism

27 Revision Following Primary THR 1 year 1% ( %) 3 years 2% ( %) 5 years 2.8% ( %)

28 Three Year Revision According to Hip Type Cemented 1.3% ( %) Hybrid 1.9% ( %) Cementless 2.8% ( %) Resurfacing 4.4% ( %)

29 Three Year Revision According to Hip Type

30 Age and Sex Risk Stratification Males< 55yrs Cemented 2.5% ( %) 1,384 1 Cementless 3.3% ( %) 3, Hybrid 1.8% ( %) 1, Resurfacing 3.7% ( %)

31 Age and Sex Risk Stratification Females> 65yrs Cemented 1.1% ( %) 41,701 1 Cementless 2.5% ( %) 14, Hybrid 1.6% ( %) 8, Resurfacing 8.5% ( %)

32 Revision and Cemented Stems Exeter 1.3% ( %) 49,213 1 Charnley 1.3% ( %) 10,740 1 CPT 1.5% ( %) 7, C Stem 1.4% ( %) 7, Stanmore 1.4% ( %) 2,

33 Revision and Cemented Cups Contemporary 1.3% ( %) 16,193 1 Ogee 0.9% ( %) 10, Charnley 1.3% ( %) 6, Duration 1.5% ( %) 6, Opera 0.8% ( %) 3,

34 Revision and Cementless Stems Corail 2.8% ( %) 18,905 1 Furlong 2.7% ( %) 10, SL Plus 2.8% ( %) 2, Accolade 2.8% ( %) 2, Taperlock 2.9% ( %) 2,

35 Revision and Cementless Cups Pinnacle 2.2% ( %) 14,902 1 Trident 1.8% ( %) 10, CSF 2.7% ( %) 9, Trilogy 2.3% ( %) 8, Duraloc 2.2% ( %) 3,

36 Revision and Resurfacing BHR 3.3% ( %) 6,748 1 Cormet 6.0% ( %) 1, ASR 7.5% ( %) 1, Adept 4.2% ( %) Durom 4.9% ( %)

37 Revision and Bearing MoP 1.6% ( %) 94,012 1 CoP 1.7% ( %) 15, CoC 2.2% ( %) 9, MoM 1.9% ( %) 1,

38 Revision Following Primary TKR 1 year 0.7% ( %) 3 years 2.5% ( %) 5 years 3.7% ( %)

39 Three Year Revision According to Knee Type Cemented 2.1% ( %) Cementless 2.4% ( %) Hybrid 2.9% ( %) Unicondylar 7.2% ( %) PFR 8.3% ( )

40 Revision and Type of Knee

41 Revision and Sex

42 Three Year Revision and Brand of Knee PFC 1.7% ( %) 52,793 1 Nexgen 1.8% ( %) 20,259 1 AGC 2.1% ( %) 19, Scorpio 2.2% ( %) 12, Kinemax 2.5% ( %) 7,

43 Summary Hips Cemented fixation superior at five years Cementless fixation has now overtaken cemented Age and sex stratification has an important effect Resurfacing results best in males < 55yrs but still infrerior There is variation in survivorship of types of THA within its fixation category There is less variation in survivorship in terms of bearing surface

44 Summary Knees Cemented fixation most popular and best results at three years (2.1%) Unicondylar revision 7.2% at three years Age and sex stratification are important Results very similar to Australian Register

45 Conclusions The NJR is work in progress We are aware that data quality issues need to be addressed But NJR Compliance stands at over 90% Clinician feedback reports should further improve data quality HES interrogation, linkage and statistical analysis are likely to improve

46 THANK YOU

47 OUTLIERS Prof P J Gregg The James Cook University Hospital, Middlesbrough Vice-Chairman NJR Steering Committee

48 POTENTIAL OUTLIERS arise from the need to measure outcome of total hip and knee replacement surgery

49 NATIONAL JOINT REGISTRY Primary objective is to provide information to all those involved in the management of joint replacement surgery with regard to surgical and implant performance and clinical best practice. Central to the provision of this information is the aim of improving patient outcomes and safety.

50 SIXTH NATIONAL ADULT CARDIAC SURGICAL DATABASE REPORT Significant improvements in survival despite increasing complexity of case mix and increasing patient age Methodologies for predicting operative risk and adjusting for case mix essential if comparisons are to be made about differing outcomes between hospitals or surgeons

51 DARZI DIMENSIONS OF QUALITY! Safety! Clinical effectiveness! Patient experience Backed up by metrics and backed up by regulation using metrics.

52 OUTCOME MEASURE The outcome measure used is implant survivorship Expressed as Revision Rate Calculated for individual hospitals, surgeons, and implants

53 REVISION RATE Revision rate = Total revisions Patient time (years) 1 (Expressed as revisions per 100 patient years) 1 Time elapsed from primary operation to revision, death or end of follow-up, whatever comes first.

54 REVISION RATE Surgeon-specific revision rates are presented in a funnel plot and compared against a target revision rate, that is defined as the average rate observed in England and Wales. Target rate (National Benchmark) is defined as total number of revisions divided by the total sum of patient time for all surgeons data in registry.

55 EXPECTED NUMBER OF REVISIONS Expected number of revisions for a surgeon is equal to the target rate multiplied by the patient time summed up over all patients for this surgeon.

56 HIP REPLACEMENT WITH NJR REVISIONS Funnel plot: 95% and 99.8% limits revision rate / 100 pat years expected number revisions

57 HIP REPLACEMENT WITH NJR FIRST REVISIONS 2003 TO 2008 Funnel plot: 95% and 99.8% limits CEMENTED CEMENTLESS revision rate / 100 pat years revision rate / 100 pat years expected number revisions expected number revisions HYBRID RESURFACING revision rate / 100 pat years revision rate / 100 pat years expected number revisions expected number revisions

58 PROBLEMS Poor compliance artificially lowers the national benchmark. NJR NJR linkage seriously underestimates number of revisions. Anomaly of resurfacing surgeon can have higher revision rate than non-resurfacing but not be seen as outlier.

59 PROBLEMS Funnel plots are based on assumption that the revision rate remains constant with time from surgery which is not the case. Further work needed to investigate which statistical method represents best the timedependent revision rates and how this can be used to estimate expected number of revisions.

60 PROBLEMS Revision rates for surgeons with expected numbers of revisions of less than 1 are not displayed in the funnel plot because the calculations are too imprecise.

61 POTENTIAL OUTLIERS An adequate system for detecting potential outliers cannot be developed quickly and will require continuous refinement and updating with a growing understanding of it s functioning.

62 POTENTIAL OUTLIERS It is not acceptable to ignore evidence of outlying performance even if the evidence is imperfect BUT results could reflect differences in data quality, completeness and case mix rather than quality of joint replacement surgery.

63 POTENTIAL OUTLIERS Given current stage of development, the identification of outlying revision rates should first trigger a detailed examination of the data in the NJR and HES databases and cross-checked with data from the hospital concerned.

64 FUTURE Compliance must be made mandatory Compliance part of Health Commission s Annual Health Check PBR linked to NJR compliance Compliance part of GMC revalidation process

65 FUTURE Case-mix/complexity assessment and adjustment essential Risk-adjusted funnel plot Prosthesis Age Sex Diagnosis

66 THANK YOU

67 Clinician Feedback Peter Howard Consultant Orthopaedic Surgeon, Derby Chair Regional Clinical Co-coordinators committee

68 Clinician Feedback Significant progress in last 12 months Much more to come Funnel plots difficulties/issues resolved Data accuracy issues persist consent NHS number needed for optimal Great for appraisal folder & departmental audit (if on correct side of the plot)

69 NJR Clinician Feedback

70 Available Reports

71 Data Quality

72 NHS Number Submission

73 Revision Rate at One Year - TKR

74 3 Year Revision Rate Unicondylar Knee

75 Revision Rate 3 Years All Knees - SHA Level

76 Patient Time Incidence Rate - All Hips

77 Patient Time Incidence Rate - Hips Cementless

78 Patient Time Incidence Rate - All Knees

79 Patient Time Incidence Rate - Unicondylar Knee

80 Latest format of PTIR plots

81 NJR Clinician Feedback - Getting Access Username and Password for Data Entry System will work. If you don t have any log on credentials you must the NJR Service Desk. The you send must: Be from an NHS/Hospital account Include a specific request for access to Clinician Feedback Include a contact telephone number Health_servicedesk@northgate-is.com The Service Desk will contact you with the necessary details. Failing that, visit the NJR Stand in the Exhibitors Hall

82 Consenting to Share Data - Step 1 Select System Functions once logged into the Data Entry System

83 Consenting to Share Data - Step 2 Select Modify Surgeon Profile

84 Consenting to Share Data - Step 3 Select Personal Options

85 Consenting to Share Data - Step 4 Check Consent Box

86 Consenting to Share Data - Summary Log in to Data Entry System Select System Functions then Select Modify Surgeon Profile Select Personal Options Check Consent Box Click Save All too difficult? Call the Service Desk on !

87 The future? Including HES data on PE etc will give much more data availability Consent, NHS number & mandation of the NJR essential for accuracy What else do we need?

88 THANK YOU DISCUSSION