Update on the National Board Dental Examinations

Transcription

1 Update on the National Board Dental Examinations American Dental Education Association San Diego, California March 2011

2 Research & Development/Psychometrics Tsung-Hsun Tsai, Ph.D

3 Updates Research the highest score reliability is found at the pass/fail point, high score reliability is found on the current content structure with 8-10 cases on Part II, and psychometrically defensible models and procedures are developed to detect aberrant responses for computer-based examinations.

4 Updates Planned 2011 Part II Practice Analysis Domain of entry-level dentistry 65 revised, consolidated clinical competencies of the New General Dentistry ad hoc content review Survey criticality frequency Data analysis

5 Updates New Item Types Multiple correct answers, extended matching, and ordering are coming to National Board Examinations in These new item types will be scored objectively with a well defined scoring rubric. Responses on these new item types must match the scoring rubric exactly in order to get a score of "1" for the item. If there is no exact match, the score for the item will be "0". There is no partial credit.

6 Updates For example, for an item with multiple correct answers and four options: A, B, C, and D, if the correct answers are B and D, both B and D and no other options must be selected to get a score of "1". Otherwise, the score for this item will be "0."

7 Updates Multiple Correct Answers From the following list, select the three symptoms associated with candidosis. A. Small blisters B. Parasitic in nature C. Reduced prothrombin D. Fungal in nature E. Bruxism F. Maladsorption syndrome G. Bacterial in nature

8 Updates Extended Matching For each symptom listed below, select the correct disorder from the list provided. Symptom 1. White patches easily removed with light abrasion 2. Buccal lesion with erythematosus surface 3. Dorsal tongue carcinoma 4. Paterson - Kelly Syndrome 5. Abdominal pain, diarrhea, weight loss, fever 6. Multiple bluish - purple macules or plaques on lower extremities 7. Hairy tongue Disorder A. Squamous cell carcinoma B. Candidosis C. Syphilis D. Iron deficiency E. Crohn s disease F. Sjögren syndrome G. Kaposi sarcoma H. Paget s disease I. Hypothyroidism J. Septicemia

9 Updates Ordering Order the citric cycle as it occurs. Match each letter with its proper sequence number

10 Don t Forget The implementation of Pass/Fail reporting for candidate performance on National Boards will take effect on January 1, After that date, passing candidates will receive the status of Pass, P, while failing candidates will receive raw score information for each discipline with the status of Fail, F.

11 Don t Forget The dental school profiles will be discontinued on January 1, 2012 when score reporting on the National Board examinations becomes Pass/Fail. The Joint Commission is developing a model for providing feedback to dental schools for evaluation purposes.

12 Score Trends Trends in candidate performance and failure rates on Part I and Part II based on reference groups are presented in Figures 1 to 4 below. A reference group is defined as candidates who took the examination for the first time and who enrolled in accredited dental schools.

13 Figure 1. Part I Average Scores

14 Figure 2. Part II Average Scores

15 Figure 3. Trend in the Failure Rates for Part I

16 Figure 4. Trend in the Failure Rates for Part II

17 Transition to a Single Exam Test Administration Updates Laura M. Neumann, DDS, MPH Interim Secretary, JCNDE neumannl@ada.org

18 Transition to a Single Exam Parts I & II will disappear; to be replaced by single, comprehensive exam JCNDE Committee for and Integrated Exam (CIE) leading process Information and progress JCNDE Newsletters CIE website (pending) Questions and feedback to jcndecie@ada.org

19 Integrated Exam Current status Model for domain of general dentistry defined o65 clinical competencies cross-link with 10 areas of scientific foundation knowledge ovalidation in progress Practice analysis planned for mid-2011 > establish test specifications Anticipated implementation at least 4 years

20 Policy Updates Score reports effective 1/1/12: P or F no numerical score unless candidate tested prior to that date. Candidates who have passed may not retest unless required by state board DENTPIN required to apply/test.

21 DENTPIN 8-digit unique personal identifier Candidate/student must register him/herself Used by: DAT, NBDE I & II, NBDHE ADEA AADSAS TMDSAS PASS CAAPID 35,221 DENTPINs assigned since 2009

22 Exam Administration Trends Part I 8,044 9,209 7,696 Part II 6,232 6,449 7,185

23 NBDE Part I Volume by Month

24 NBDE Part II Monthly Volume

25 Testing Accommodations Volume Jan Feb Mar Apr May June Jul Aug Sep Oct Nov Dec

26 Reschedule /No-Show Volume NBDE I NBDE II Reschedule No-Show Reschedule No-Show 5,483 71% 472 1,610 22% 180

27 Irregularities NBDE I: 1,984 NBDE II: 2,551 Incidents resulting in action/penalty: 41 warning letters 31 notices of violation/penalty o30 appeals 4 granted 27 denied, including 8 wait time to retest reduced

28 See our video: Cheating Helps No One

29 Questions Joint Commission on National Dental Examinations 211 E. Chicago Ave., Suite 600 Chicago, Illinois Fax: (312)