Update on the National Board Dental Examinations American Dental Education Association San Diego, California March 2011
Research & Development/Psychometrics Tsung-Hsun Tsai, Ph.D tsait@ada.org
Updates Research the highest score reliability is found at the pass/fail point, high score reliability is found on the current content structure with 8-10 cases on Part II, and psychometrically defensible models and procedures are developed to detect aberrant responses for computer-based examinations.
Updates Planned 2011 Part II Practice Analysis Domain of entry-level dentistry 65 revised, consolidated clinical competencies of the New General Dentistry ad hoc content review Survey criticality frequency Data analysis
Updates New Item Types Multiple correct answers, extended matching, and ordering are coming to National Board Examinations in 2012. These new item types will be scored objectively with a well defined scoring rubric. Responses on these new item types must match the scoring rubric exactly in order to get a score of "1" for the item. If there is no exact match, the score for the item will be "0". There is no partial credit.
Updates For example, for an item with multiple correct answers and four options: A, B, C, and D, if the correct answers are B and D, both B and D and no other options must be selected to get a score of "1". Otherwise, the score for this item will be "0."
Updates Multiple Correct Answers From the following list, select the three symptoms associated with candidosis. A. Small blisters B. Parasitic in nature C. Reduced prothrombin D. Fungal in nature E. Bruxism F. Maladsorption syndrome G. Bacterial in nature
Updates Extended Matching For each symptom listed below, select the correct disorder from the list provided. Symptom 1. White patches easily removed with light abrasion 2. Buccal lesion with erythematosus surface 3. Dorsal tongue carcinoma 4. Paterson - Kelly Syndrome 5. Abdominal pain, diarrhea, weight loss, fever 6. Multiple bluish - purple macules or plaques on lower extremities 7. Hairy tongue Disorder A. Squamous cell carcinoma B. Candidosis C. Syphilis D. Iron deficiency E. Crohn s disease F. Sjögren syndrome G. Kaposi sarcoma H. Paget s disease I. Hypothyroidism J. Septicemia
Updates Ordering Order the citric cycle as it occurs. Match each letter with its proper sequence number
Don t Forget The implementation of Pass/Fail reporting for candidate performance on National Boards will take effect on January 1, 2012. After that date, passing candidates will receive the status of Pass, P, while failing candidates will receive raw score information for each discipline with the status of Fail, F.
Don t Forget The dental school profiles will be discontinued on January 1, 2012 when score reporting on the National Board examinations becomes Pass/Fail. The Joint Commission is developing a model for providing feedback to dental schools for evaluation purposes.
Score Trends Trends in candidate performance and failure rates on Part I and Part II based on reference groups are presented in Figures 1 to 4 below. A reference group is defined as candidates who took the examination for the first time and who enrolled in accredited dental schools.
Figure 1. Part I Average Scores 99 94 89 84 79 74 69 64 59 54 49 85.4 85.1 85.5 85.4 85.1 85.7 83.0 81.5 82.6 82.3 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Figure 2. Part II Average Scores 99 94 89 84 79 74 69 64 59 54 49 81.9 82.0 81.7 81.5 82.7 81.2 81.1 81.6 79.2 79.8 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Figure 3. Trend in the Failure Rates for Part I 50 45 40 35 30 25 20 15 10 5 0 13.4 7.6 10.0 9.5 10.0 7.8 7.4 3.5 5.2 5.3 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Figure 4. Trend in the Failure Rates for Part II 50 45 40 35 30 25 20 15 10 5 0 13.5 10.6 6.4 5.5 5.6 7.2 5.6 6.0 6.4 5.3 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Transition to a Single Exam Test Administration Updates Laura M. Neumann, DDS, MPH Interim Secretary, JCNDE neumannl@ada.org
Transition to a Single Exam Parts I & II will disappear; to be replaced by single, comprehensive exam JCNDE Committee for and Integrated Exam (CIE) leading process Information and progress JCNDE Newsletters CIE website (pending) Questions and feedback to jcndecie@ada.org
Integrated Exam Current status Model for domain of general dentistry defined o65 clinical competencies cross-link with 10 areas of scientific foundation knowledge ovalidation in progress Practice analysis planned for mid-2011 > establish test specifications Anticipated implementation at least 4 years
Policy Updates Score reports effective 1/1/12: P or F no numerical score unless candidate tested prior to that date. Candidates who have passed may not retest unless required by state board DENTPIN required to apply/test.
DENTPIN 8-digit unique personal identifier Candidate/student must register him/herself Used by: DAT, NBDE I & II, NBDHE ADEA AADSAS TMDSAS PASS CAAPID 35,221 DENTPINs assigned since 2009
Exam Administration Trends 2008 2009 2010 Part I 8,044 9,209 7,696 Part II 6,232 6,449 7,185
NBDE Part I Volume by Month 2000 1800 1600 1400 1200 1000 800 600 400 200 0 2008 2009 2010
NBDE Part II Monthly Volume 2000 1800 1600 1400 1200 1000 800 600 400 200 0 2008 2009 2010
Testing Accommodations Volume 140 120 2009 2010 100 80 60 40 20 - Jan Feb Mar Apr May June Jul Aug Sep Oct Nov Dec
Reschedule /No-Show Volume NBDE I NBDE II Reschedule No-Show Reschedule No-Show 5,483 71% 472 1,610 22% 180
Irregularities NBDE I: 1,984 NBDE II: 2,551 Incidents resulting in action/penalty: 41 warning letters 31 notices of violation/penalty o30 appeals 4 granted 27 denied, including 8 wait time to retest reduced
See our video: Cheating Helps No One http://www.ada.org/2667.aspx
Questions Joint Commission on National Dental Examinations 211 E. Chicago Ave., Suite 600 Chicago, Illinois 60611 Fax: (312) 587-4105 http://www.ada.org/jcnde.aspx.