Joint Commission on National Dental Examinations (JCNDE) and the Integrated National Board Dental Examination (INBDE) 63 rd Southern Conference of Dental Deans and Examiners January 27, 2018 2018 All rights reserved.
Conflict of Interest Declaration Form We, the undersigned, declare that neither we nor any member of our family has a financial arrangement or affiliation with any corporate organization offering financial support or grant monies for this continuing dental education program, nor do we have a financial interest in any commercial product(s) we will discuss in the presentation. Dr. Lisa Heinrich-Null Dr. Kathy Hinshaw Dr. Matt Grady 2
Presentation Topics Commissions at the ADA Dr. Heinrich- Null Principles Commonalities History of JCNDE INBDE Development and Implementation Dr. Grady JCNDE Dr. Heinrich-Null Composition Governance documents Purpose, Mission Statement, Conflict of Interest, Simultaneous Service Policies Current appointees, policies and procedures for commissioners Committees Policies and procedures for commissioners Websites, Communications, Resources 2018 Joint Commission on National Dental Examinations, All Rights Reserved 3
Commissions at the ADA Commissions established within ADA Bylaws as agencies of the ADA: Commission on Dental Accreditation (CODA) Commission for Continuing Education Provider Recognition (CCEPR) Joint Commission on National Dental Examinations (JCNDE) National Commission on Recognition for Dental Specialties and Certifying Boards (established 2017) 4
Principles of the Commissions at the ADA Philosophical foundation of Commissions: Consistent and free from bias/conflict of interest remain objective. No single community of interest can have undue influence in the decision-making process, including the ADA. Quality assurance is necessary to protect the public and assure longterm viability of the profession. Integrity, confidentiality, due process. Subject to ADA Bylaws and Standing Rules, while maintaining own Bylaws and Rules in accordance with mission and with HOD approval. Maintain independent authority to carry out their program. 5
Commonalities among the Commissions Recognition that there are many stakeholders outside the ADA. Commissioners appointed independently by stakeholders (e.g., AADB, ADEA, ADHA, ASDA, etc.). The number of ADA appointees are in the minority with respect to the full Commission (e.g., 3 out of 15 members of the Joint Commission are ADA appointees). Commissions include at least one public member. Commissioners serve four year terms (except students); qualifications of commissioners are expertise-based; dentists must be ADA members. The ADA approves the Commission s operating budget and the ADA employs staff. Commissions elect their own chairs and select their own consultants (test constructors, psychometricians, etc.). 6
History of the JCNDE Year Event 1928 National Board of Dental Examiners established as a standing committee of the ADA for the purpose of providing & conducting written examinations for use by the state boards of dentistry in licensing dentists. 1933/1934 NBDEs first administered. 1962 NBDHE first administered. 1973 NBDHE became a comprehensive examination. 1980 National Board of Dental Examiners was restructured as the 15 member JCNDE. 1992 Part II became a comprehensive examination. 2007 Part I became a comprehensive examination. 2009 All National Boards are computer-based examinations. Present All U.S. licensing jurisdictions accept the NBDE and NBDHE as fulfillment of the written examination requirement for licensure. 7
Appointing Organizations Voting Members Composition of the JCNDE 1 Number of Members Term Lengths (in years) AADB 6 4 ADEA 3 4 ADA 3 4 ADHA 1 4 ASDA 1 1 Public 1 4 Non-voting Members ASDA Observer 1 1* ADA BOT Liaison 1 1 * The ASDA Observer transitions to a Commissioner role in their second year. 8
Governance Documents: JCNDE in Relationship to the ADA ADA Governance Documents ADA Constitution and Bylaws ADA Standing Rules for Councils and Commissions ADA Principles of Ethics and Code of Professional Conduct JCNDE Governance Documents JCNDE Bylaws (composition and responsibilities) JCNDE Standing Rules (roles of JCNDE committees) JCNDE Examination Regulations (testing policies and procedures) JCNDE Test Construction Teams and Member Selection Criteria 9
Purpose of the JCNDE The purpose of the JCNDE is to: Provide and conduct examinations to assist state boards in determining qualifications of dentists and dental hygienists who seek licensure. Make rules and regulations for the conduct of National Board examinations and certificates. Serve as a resource for the dental profession in the development of examinations. 10
Mission Statement of the JCNDE The JCNDE develops and conducts highly reliable, state of the art cognitive examinations that assist regulatory agencies in making valid decisions regarding licensure of oral health care professionals, develops and implements policy for the orderly, secure, and fair administration of its examinations, and is a leader and resource in assessment for the oral health care profession. 11
Examination Purpose The purpose of an examination is of paramount importance; examination purpose drives all decisions. The purpose of the National Board Dental Examinations and the National Board Dental Hygiene Examination is to assist state boards in determining the qualifications of individuals seeking licensure to practice dentistry or dental hygiene, respectively. 12
Conflict of Interest and Simultaneous Service Policies While the members of the Joint Commission have been appointed by different associations, each member is to fully adopt the purpose and mission of the Joint Commission in their decision making. 13
Appointing Organizations and Current Appointees AADB (6) ADA (3) ADEA (3) ADHA (1) ASDA (1) Public (1) Liaisons & Observers Dale R. Chamberlain, DDS Roy L. Irons, DDS Frank A. Maggio, DDS William F. Robinson, DDS (JCNDE Vice-Chair) Wesley Delaine Thomas, DMD Leonard P. Weiss, DDS Cheryl Haley, DDS Lisa Heinrich-Null, DDS (JCNDE Chair) Kanthasamy K. Ragunanthan, DDS, MS Cataldo W. Leone, DMD, DMSc, FICD Nader Nadershahi, DDS, MBA, EdD Joseph J. Zambon, DDS, PhD Melissa Gail Efurd, RDH, Ed.D Aaron Henderson, BS Issie L. Shelton-Jenkins, Esq. Jeffrey Kerst, BS (ASDA Observer) Chad P. Gehani, DDS (ADA Board Liaison) Liaisons and observers do not participate in voting 14
Policies and Procedures for Commissioners Roles of the Commissioners Liaison for respective stakeholder (AADB, ADEA, ADA, ADHA, ASDA) Prepare & participate in JCNDE meetings & committees Comply with ADA Standing Rules Consider appeals Oversee development & administration of JCNDE exams Establish & oversee JCNDE policies Maintain confidentiality of JCNDE information Oversee JCNDE budget Attend a Test Construction Team meeting 15
JCNDE Committees Standing Committees Ad hoc Committees Test Constructor Teams Committee on Administration Committee on Dental Hygiene Committee on Examination Development Committee on Research and Development Long term projects with continuity requirements Committee for an Integrated Examination (CIE) Recurring technical committees Standard Setting Practice Analysis Special projects Bylaws Self-Assessment Image Quality Irregularities/Appeals, etc. Subject matter experts develop items for one or more examination programs 16
Websites, Communications & Resources 17
INBDE Development and Implementation 2018 All rights reserved.
Overview INBDE purpose and guiding principles Content domain Item development Field testing program Implementation plan 19
INBDE Purpose, Clinical Relevance, and Integration Examination Purpose A written examination, exclusive of clinical demonstrations, for the purpose of assisting state boards in determining qualifications of dentists who seek licensure to practice in any state, district or dependency of the United States, which recognizes the National Board Dental Examinations. Clinical Relevance Refers to factors that impact patient outcomes in clinical and professional contexts. Integration Bringing to bear knowledge of biomedical, clinical, and/or behavioral sciences along with cognitive skills to understand and solve problems in clinical/professional contexts. 20
The INBDE Content Domain A content domain is the set of behaviors, knowledge, skills, abilities that a test measures. In establishing the INBDE content domain, the Joint Commission focused on two key questions: 1) What tasks must entry-level general dentists be able to perform to practice safely? 2) What knowledge, skills and abilities underlie the performance of those tasks? 21
56 Clinical Content Areas (2016) The Joint Commission has established 56 clinical content areas that represent the tasks entry-level general dentists must be able to perform to practice safely. The clinical content areas were based on ADEA s 2008 Competencies for the New General Dentist. The 56 clinical content areas are classified into three component sections: 1) Diagnosis and Treatment Planning 2) Oral Health Management 3) Practice and Profession 22
56 Clinical Content Areas (2016) 23
56 Clinical Content Areas (2016) 24
56 Clinical Content Areas (2016) 25
Foundation Knowledge Areas (2018*) The successful entry-level general practitioner is focused on the prevention, diagnosis, and management of oral disease, and the promotion and maintenance of general health. This requires application of knowledge in the following areas: FK1 FK2 FK3 FK4 FK5 FK6 FK7 FK8 FK9 FK10 Molecular, biochemical, cellular, and systems-level development, structure and function Physics and chemistry to explain normal biology and pathobiology Physics and chemistry to explain the characteristics and use of technologies and materials Principles of genetic, congenital and developmental diseases and conditions and their clinical features to understand patient risk Cellular and molecular bases of immune and non-immune host defense mechanisms General and disease-specific pathology to assess patient risk Biology of microorganisms in physiology and pathology Pharmacology Sociology, psychology, ethics and other behavioral sciences Research methodology and analysis, and informatics tools * FK 9 and 10 contain minor edits that are currently pending JCNDE approval. 26
Practice Analysis (2016) In 2016, the Joint Commission conducted a practice analysis to determine the frequency with which each clinical content area is performed, and the criticality of each area to patient care. Surveyed over 2,500 general dentists. A panel of practitioners and educators used the practice analysis results to establish a recommendation for the INBDE content specifications. 27
INBDE Content Specifications (2017) INBDE Content, by Clinical Component Section # Clinical Component Section Percent 1 Diagnosis and Treatment Planning 34.6% 2 Oral Health Management 42.0% 3 Practice and Profession 23.4% 28
INBDE Content Specifications (2017) INBDE Content, by Foundation Knowledge Area # Foundation Knowledge Area Percent 1 Molecular, biochemical, cellular, and systems-level development, structure and function 2 Physics and chemistry to explain normal biology and pathobiology 3 Physics and chemistry to explain the characteristics and use of technologies and materials Principles of genetic, congenital and developmental diseases 4 and conditions and their clinical features to understand patient risk 5 Cellular and molecular bases of immune and non-immune host defense mechanisms 12.2% 6.8% 8.0% 10.6% 9.0% 6 General and disease-specific pathology to assess patient risk 11.8% 7 Biology of microorganisms in physiology and pathology 10.6% 8 Pharmacology 10.6% 9 Sociology, psychology, ethics and other behavioral sciences 10.6% 10 Research methodology and analysis, and informatics tools 9.8% 29
INBDE Item Development Several INBDE Test Constructor Teams (TCTs) have been formed to develop INBDE items. TCTs meet in 5-person groups and also as a full unit (15 members) during item reviews. INBDE TCTs have drafted over 1,000 items to date. 30
INBDE Item Development Guiding principles in item development: Focus on clinical relevance. Increased focus on the general dentist in item writing. Standardized presentation format and conventions for presenting information. Direct and concise wording that focuses examinees on the concept tested as opposed to language/item wording. Increased accuracy and fairness/sensitivity through a thorough, multi-faceted item review process that capitalizes on the unique expertise of the individuals involved. 31
INBDE Item Development A draft INBDE item development guide has been written to facilitate item development. TCT members are asked to write clinically relevant, integrated items. The INBDE utilizes a new item presentation format known as the Patient Box. 32
The Patient Box Presents patient demographic characteristics (gender, age, and potentially ethnicity). Presents the chief complaint as described by the patient or a guardian. Presents background information such as history of dental diagnosis and treatment, medical conditions, allergies, social history, etc. Presents information collected by dental professionals during the current visit. 33
INBDE Model Items Where would a loss of taste be expected? 34
INBDE Model Items The most appropriate antimicrobial agent is A. amoxicillin and clavulanate (Augmentin ). B. cephalexin (Keflex ). C. clindamycin (Cleocin ). D. metronidazole (Flagyl ). 35
INBDE Sample Items A set of almost 50 sample INBDE items are now available on the Joint Commission website. 36
INBDE Field Testing Program INBDE Sample Item Survey July 1, 2015 through September 22, 2015 170 NBDE Part II candidates INBDE Short Form Field Test October 10, 2016 through January 31, 2017 840 NBDE Part II candidates from accredited dental schools 2017-2018 INBDE Field Test November 1, 2017 through January 31, 2018 Approximately 1,400 NBDE Part II candidates from accredited dental schools 37
INBDE Sample Item Survey (2015) Goals To understand how dental students apply knowledge of the biomedical, clinical, and behavioral sciences in responding to INBDE items. To collect feedback from dental students regarding the presentation of INBDE content. Method Asked 170 NBDE Part II candidates to attempt a series of INBDE model items and provide feedback. e.g., Please name at least two areas of your dental education and training (e.g., specific classes, clinical experiences) you used to answer the question. e.g., What is your overall impression of the sample questions and how they are presented? 38
INBDE Sample Item Survey (continued) Results Candidates indicated that INBDE items required them to apply their biomedical science knowledge and clinical experiences. INBDE items were regarded as straightforward, fair, and clinically relevant. The Patient Box provided a clean and simple presentation; some participants commented that they preferred this question format to what is currently used on the Board Exams. No significant changes appeared necessary with respect to INBDE item development efforts 39
INBDE Short Form Field Test (2016-17) Study Overview Administered two short forms of the INBDE to NBDE Part II candidates. Each short form had 120 items. Asked participants to provide feedback on INBDE content via a post-test survey. Participants Invited 4,167 NBDE Part II candidates enrolled in accredited dental schools. Of those, 840 participated. Each participant received a full refund of their Part II fee ($425), and a chance to win an ipad based on the number of items they answered correctly. Participants were removed from the final analytic sample if they showed low effort. The final sample comprised 704 participants from 59 dental schools. 40
INBDE Short Form Field Test (continued) Key Findings Psychometric analysis indicated the majority of the test items performed reasonably well. Eighty-nine percent (89%) of participants indicated they were satisfied with their experience on the Field Test. Eighty-nine percent (89%) of participants indicated that the questions on the test were clinically relevant (less than 3% disagreed). Eighty-five percent (85%) of participants indicated that their educational training prepared them well to answer these types of questions. Candidates who had taken the NBDE Part II prior to participating in the field test tended to have a more positive impression of INBDE content than those who had not. 41
2017-2018 INBDE Field Test (2017-18) Study Overview Administer a 300-item form of the INBDE to NBDE Part II candidates from accredited dental schools. Ask participants to provide feedback on INBDE content via a post-test survey. A performance based incentive is provided: $500 to candidates who perform in the top quarter. $400 to candidates who perform in the second quarter. $350 to candidates who perform in the third quarter. $300 to candidates who perform in the bottom quarter. Participants Approximately 1,400 NBDE Part II candidates from accredited dental schools. 42
INBDE Field Testing Program Results INBDE field testing efforts have been successful to date. The Joint Commission is on track for an August 2020 release of the INBDE. 43
INBDE Implementation Plan On August 1, 2018, the Joint Commission intends to provide communities of interest with notice of INBDE implementation and NBDE discontinuation. This notice will include the following: The projected date when the INBDE will be available for administration, the official name of the new examination, and how results will be reported.* The dates when NBDE Part I and NBDE Part II will be discontinued. Any additional rules needed to facilitate the transition. * Similar to Part I and Part II, INBDE results will be reported as Pass/Fail. 44
INBDE Implementation Plan (continued) Two years after notification has been provided, NBDE Part I will be discontinued (approx. July 31, 2020). No Part I administrations will occur after this date. The first official administration of the INBDE is expected to take place on August 1, 2020. Two years after NBDE Part I is discontinued, NBDE Part II will be discontinued (approx. July 31, 2022). No Part II administrations will occur after this date. Notification of INBDE implementation and NBDE discontinuation is contingent upon successful completion of the INBDE Field Testing Program. 45
INBDE Implementation Plan (continued) 46
Additional Information from the JCNDE Information concerning the INBDE is available via the Joint Commission s website (www.ada.org/jcnde/inbde). The following information is currently available and is updated as changes occur: INBDE background INBDE FAQ s Domain of Dentistry and general validity evidence Test specifications Preliminary sample questions INBDE retest policy and candidate eligibility INBDE draft item development guide INBDE practice test questions The following information will be posted as soon as it becomes available: Technical report(s) providing detailed information concerning validity. 47
Thank you! 48