Oregon Institute of Technology Medical Imaging Technology Department Diagnostic Medical Sonography Degree Completion Program Assessment

Transcription

1 Oregon Institute of Technology Medical Imaging Technology Department Diagnostic Medical Sonography Degree Completion Program Assessment I. Introduction The Oregon Tech Diagnostic Medical Sonography degree completion program enables registered professionals in Diagnostic Medical Sonography to further their knowledge and skills necessary for career advancement, to become effective communicators, problem solvers, critical thinkers, responsible managers and leaders, and to value lifelong learning. The Bachelor of Science Degree Completion Program in Diagnostic Medical Sonography is delivered via distance education to Sonographers who are credentialed with American Registry for Diagnostic Medical Sonography (ARDMS). Students will complete required course work through the Oregon Institute of Technology Distance ducation Department. Courses are delivered via Blackboard, which serves as a virtual learning environment. The Sonography Degree Completion program is presented by the Department of Diagnostic Medical Sonography (DMS). The DMS program is in the Department of Medical Imaging Technology (MIT). DMS and MIT are contained within the College of Health, Arts, and Sciences (HAS) at Oregon Tech. The Diagnostic Medical Sonography Degree Completion program was implemented in fall 2011 as an online program. Students who are accepted into the Diagnostic Medical Sonography Degree Completion program are already registered Diagnostic Medical Sonographers working in the field who have passed their national registry exam in Diagnostic Medical Sonography. The distance delivery version began in 2011 and will expect to grow over time. The on campus Diagnostic Medical Sonography Program (DMS) began in 1997 and is one of the five Medical Imaging programs offered on the Klamath Falls campus. II. Program Purpose, Objectives and Student Learning Outcomes The program faculty adopted the mission, objectives, and student learning outcomes in Fall 2010 and submitted them to the Curriculum Planning Commission for approval. The faculty met in the fall of 2011 and agreed to continue with the student learning outcomes as suggested by the programmatic accrediting body known as the Joint Review Committee of Diagnostic Medical Sonography. The current version is listed below. Diagnostic Medical Sonography Degree Completion Program Purpose The purpose of the Diagnostic Medical Sonography Degree Completion Program is to provide ARDMS registered Sonographers a Bachelor of Science degree from a distance education program that furthers the student s knowledge, clinical practice, and performance of examinations while practicing competent patient care and safety in the advanced modalities of Diagnostic Medical Sonography. 1

2 Program ducational Objectives The program prepares students to: 1. mploy diagnostic sonographic imaging techniques, critical thinking skills, effective communication skills, and professional judgment. 2. ffectively apply ergonomically correct scanning techniques. 3. Successfully complete nationally recognized credential examinations. 4. Develop a dedication to independent life-long learning and professional contribution. 5. Utilize diagnostic techniques, sound judgment and good decision making to provide patient services. 6. Be leaders in the field of Diagnostic Medical Sonographers who contribute to the field on a local, regional or national level. 7. Think critically, communicate effectively and exemplify professional ethics. 8. Become lifelong learners and responsible citizens. xpected Student Learning Outcomes Graduates from this program will be able to demonstrate: 1. ffective oral, visual, and written communication skills. 2. The ability to work effectively in teams. 3. The ability to provide basic patient care and comfort while utilizing ethical, professionalism and HIPAA guidelines 4. Knowledge and understanding of human gross and sectional anatomy relative to normal and abnormal sonographic imaging. 5. Knowledge and understanding of human physiology, pathology and pathophysiology. 6. Knowledge and understanding of ultrasound physical principles and instrumentation. 7. Knowledge of sonographic biological effects, proper application of sonographic instrumentation relative to imaging and image quality. 8. Appropriate ergonomic scanning applications. 9. An understanding of diverse cultural and humanistic traditions in the global society. Other Learning Opportunities 1. Annual professional meetings and conferences for sonography students include: Society of Diagnostic Medical Sonography (SDMS) American Institute of Ultrasound in Medicine (AIUM) American College of ducators in Radiologic Technology (ACRT) ugene Ultrasound Society (US) Other smaller study groups located in San Francisco Bay Area Oregon Tech DMS Sonography Advisory Council annual meeting and Continuing Medical ducation opportunity (CM) The location and financial responsibility remain a challenge for DMS students to attend national conferences. These meetings are held during regularly scheduled instructional terms. Students appreciate the networking and educational benefits of attending these meetings. Competition opportunities are components of the national conferences of SDMS and ACRT. Presently, international trips are unavailable to DMS students. 2

3 2. On-line professional learning opportunities for sonography students include: Monthly CM directed readings associated with student SDMS Memberships SDMS Webinars are available to students with SDMS Membership All DMS students hold student SDMS memberships and are eligible for these opportunities. The DMS faculty encourage students to participate in these offerings not only for educational benefits, but to develop and promote effective life-long learning behaviors. III. Three-Year Cycle for Assessment of Student Learning Outcomes The following are the nine main outcomes which will be assessed at a rate of three per year on a three-year cycle, as listed below in Table 1. Student Learning Outcomes Assessment Schedule 1. The student will demonstrate effective oral, visual, and written communication skills The student will demonstrate the ability to work effectively in teams 3. A. The student will demonstrate an ability to provide basic patient care and comfort while utilizing ethical, professionalism and HIPAA guidelines B. Professionalism 4. The student will demonstrate knowledge and understanding of human gross and sectional anatomy relative to normal and abnormal sonographic imaging. 5. The student will demonstrate knowledge and understanding of human physiology, pathology and pathophysiology. 6. The student will demonstrate knowledge and understanding of ultrasound physical principles and instrumentation. 7. The student will demonstrate knowledge of sonographic biological effects, proper application of sonographic instrumentation relative to imaging and image quality. 8. The student will demonstrate appropriate ergonomic scanning applications. 9. The student will demonstrate an understanding of diverse cultural and humanistic traditions in the global society. Table 1. Diagnostic Medical Sonography Assessment Cycle x 3

4 IV. Summary of Assessment Activities The DMS faculty conducted formal assessment of three programmatic student learning outcomes (SLO), and one Institutional Student Learning Outcomes (ISLOs) during the academic year. Student Learning Outcome #1: The student will demonstrate effective oral, visual, and written communication skills. Direct Assessment #1- Public Speaking Assignment The faculty assessed the SLO #1 by means of a voice over PowerPoint project administered fall term 2013 in DMS 365. DMS distance education faculty graded this assignment via Oregon Tech s public speaking rubric. Rubric criteria is described in the Table 2 seen below. There were 2 DMS D students involved in the assessment. Table 2: DMS Public Speaking Assignment Assessing Communication Skills Criteria Content Organization Style Delivery Visuals Assessment Method OIT public speaking Rubric OIT public speaking Rubric OIT public speaking Rubric OIT public speaking Rubric OIT public speaking Rubric Measuremen t Scale 1-4 scale, % 1-4 scale, % 1-4 scale, % 1-4 scale, % 1-4 scale, % Table 2. Direct Assessment Results for PSLO #1 in DMS 365, Fall 2013 Minimum Acceptable Results 80 % 100% 80 % 95% 80 % 100% 80 % 90% 80 % 95% Students performed well in this speaking assignment. The data indicates that the target Distance ducation DMS students evaluated were exceeding proficiency in the public speaking activity. Faculty agreed that a Skype session would work better to assess students true speaking abilities. 4

5 Direct Assessment #2- DMS Written Assignment to Assess Writing Skills The faculty assessed the written component of the PSLO #1 The student will demonstrate effective oral, visual, and written communication skills communication outcome in DMS 343 Fetal cho, Neonatal, and Pediatric Sonography using a written assignment. The written assignment was assessed via OIT s essay rubric criteria described in Table 3 below. There were 2 DMS D students involved in the assessment. Table 3: DMS Written ssay Assignment Assessing Written Skills Criteria Assessment Method Measuremen t Scale Minimum Acceptable Results Purpose OIT essay rubric 1-4 scale, % 80% 90% Organization OIT essay rubric 1-4 scale, % 1-4 scale, % 90% Support OIT essay rubric 1-4 scale, % 1-4 scale, % 100% Style OIT essay rubric 1-4 scale, % 1-4 scale, % 90% Conventions OIT essay rubric 1-4 scale, % 1-4 scale, % 90% Documentations OIT essay rubric 1-4 scale, % 1-4 scale, % 85% Table 3. Direct Assessment Results for #1 PSLO in DMS 365, Fall 2013 The goal for this assessment was to achieve a minimum acceptable performance of 80%. This goal was met. The sample size was extremely small so scores are probably inflated. Student Learning Outcome #5: The student will demonstrate knowledge and understanding of human physiology, pathology and pathophysiology. Direct Assessment #1- DMS Test Questions to Assess Understanding of Anatomy Physiology The faculty assessed this outcome in DMS 373 Obstetrical Pathology, Spring term 2014 using six test questions to evaluate human anatomy knowledge. Students who scored 80% correct have met our expectations for proficiency. There was 1 students involved in the assessment. Results are detailed in table 4 below. 5

6 Table 4: DMS Test Questions to Assess Understanding of Anatomy Physiology Criteria Understanding human anatomy Assessment Method Spring Test 1 Question 45, 46 Measurement Scale 80% of the questions correct Minimum Acceptable 80% of the students with 80% correct Results 100% Understanding human pathology Spring Test 1 Question 47, 48 80% of the questions correct 80% of the students with 80% correct 100% Understanding pathophysiology Spring Test 1 Question 49, 50 80% of the questions correct 80% of the students with 80% correct 100% Table 4. Results for PSLO #5 in DMS 430, Spring Term 2014 The sample size was too small to gather accurate date. As expected, the solo DMS students was able to understand human anatomy, pathology, and pathophysiology. Data collection was achieved by means of test question evaluation that pertained to the knowledge of human anatomy and physiology criteria. The exam was conducted using timed questions. Understanding anatomy and human pathology is a main responsibility of the sonographer, thus understanding of this information is crucial to hospital standards and scope of practice. There were no specific weaknesses that needed corrective action. Indirect Assessment #2- Practical Assessment for Critical Thinking Skills The faculty assessed this outcome using the ISLO Critical thinking Assignment delivered to 3 DMS D students winter term. A self-rubric was designed to evaluate the critical thinking and problem solving abilities of DMS students. The faculty rated the proficiency of the students using the performance criteria described in Table 5 below. 6

7 Table 5: DMS Practical Assessment Critical Thinking Criteria Assessment Methods Measure Scale Identification Grading Rubric 1-10 scale per rubric proficiency criteria Clarification Grading Rubric 1-10 scale per rubric proficiency criteria valuation Grading Rubric 1-10 scale per rubric proficiency criteria Table 5. Practical Survey Results for Critical Thinking, Spring 2014 Minimum Acceptable 80% with 8.0 or higher 80% with 8.0 or higher 80% with 8.0 or higher Results-% with Target or Higher 90% 100% 95% Strengths: Majority of students scored at 80% with 8 or better all performance criteria. Weaknesses: None Recommendations: Continue effective teaching practices. Students performed above expectations for the ISLO in all areas. These results conclude the didactic and practical applications are relevant to student achievements within the DMS program. It is speculated that these scores could be inflated due to personal grading that was performed. These students conducted this survey at multiple locations. Student Learning Outcome #8: The student will demonstrate appropriate ergonomic scanning applications. Indirect Assessment #1- DMS Student Survey to Assess rgonomic Applications The faculty indirectly assessed this outcome in DMS 430B winter term student survey, by asking the 3 students to rate their level of competency. There were 3 students who completed the assessment. These results are summarized, shown in Table 5 below. 7

8 Table 6: DMS Student Survey to Assess rgonomic Applications Criteria Student applied ergonomic scanning applications. Assessment Method Student survey Measurement Scale 1-4 scale, % at 3 or 4 Table 6. Results for PSLO #1 DMS 430B, Winter 2014 Minimum Results Acceptable 80 % 95% There were 3 DMS D students that participated in this activity. Data collection was achieved by means of a survey that pertained to the performance criteria. Results for the students demonstrating proficiency is concluded in the Results Column. The DMS faculty found these results to be demonstrated above average. As expected, DMS D students were able to understand ergonomic criteria because they are working professionals already immersed in the field. There were no particular weaknesses that needed remedial action. V. Summary of Student Learning In a spring faculty meeting, the DMS faculty reviewed the assessment results and reached the following overall conclusions. Student Learning Outcome #1 Limited information due to low enrollment, no action needed at this time. Student Learning Outcome #5 Limited information due to low enrollment, no action needed at this time. Student Learning Outcome #8 Limited information due to low enrollment, no action needed at this time. Institutional Learning Outcome-Critical Thinking Limited information due to low enrollment, no action needed at this time 8

9 Appendix A Student Learning Outcome-Course Matrices Student Learning Outcome #1: The student will demonstrate effective oral, and visual communication skills. I=Introduce R=Reinforce =mphasize DMS Course Summer Fall Winter Spring DMS 315 Sonographic Superficial Structures I DMS 352 Junior Lab I DMS 316 Survey of VT DMS 371 OB Sonography I DMS 353 Junior Lab II DMS343 Fetal cho & Neonatal Sono R DMS 372 OB Sonography II DMS 354 Junior Lab III DMS 365 Sonographic Pathology DMS 373 OB Pathology DMS 430A xternship DMS 430B xternship Table A1. Student Learning Outcome #1 -Course Matrix Identified courses indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced = mphasized 9

10 Appendix A2 Student Learning Outcome-Course Matrices Student Learning Outcome #5: The student will demonstrate knowledge and understanding of human physiology, pathology and pathophysiology. I=Introduce R=Reinforce =mphasize DMS Course Summer Fall Winter Spring DMS 315 Sonographic Superficial Structures DMS 352 Junior Lab I I DMS 316 Survey of VT DMS 371 OB Sonography I DMS 353 Junior Lab II R DMS343 Fetal cho & Neonatal Sono DMS 372 OB Sonography II DMS 354 Junior Lab III DMS 365 Sonographic Pathology DMS 373 OB Pathology DMS 430A xternship DMS 430B xternship Table A2. Student Learning Outcome #5 -Course Matrix Identified courses indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced = mphasized 10

11 Appendix A3 Student Learning Outcome #8: The student will demonstrate appropriate ergonomic scanning applications. I=Introduce R=Reinforce =mphasize DMS Course Summer Fall Winter Spring DMS 315 Sonographic Superficial Structures I DMS 352 Junior Lab I DMS 316 Survey of VT DMS 371 OB Sonography I DMS 353 Junior Lab II DMS343 Fetal cho & Neonatal Sono R DMS 372 OB Sonography II DMS 354 Junior Lab III DMS 365 Sonographic Pathology DMS 373 OB Pathology DMS 430A xternship DMS 430B xternship Table A3. Student Learning Outcome #8 -Course Matrix Identified courses indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced = mphasized 11

12 Appendix B Assessment time map combining Institutional Student Learning Outcomes and Programmatic Student Learning Outcomes is found in Table B1. ISLO with PSLO Coordinating Assessment Cycle Institutional Student Programmatic Student Learning Learning Outcomes Outcomes 1. Communication 1. The student will demonstrate (oral, written, visual) effective oral, visual, and written 2. Team and group work communication skills 2. The student will demonstrate the ability to work effectively in teams Professionalism and ethical practice 3a. The student will demonstrate an ability to provide basic patient care and comfort while utilizing ethical, professionalism and HIPAA guidelines. 3b. Professionalism 4. The student will demonstrate knowledge and understanding of human gross and sectional anatomy relative to normal and abnormal sonographic imaging. 4. Critical Thinking and 5. The student will demonstrate Problem Solving knowledge and understanding of human physiology, pathology and pathophysiology (xtern Case Study) 5. Lifelong and 8. The student will demonstrate independent learning appropriate ergonomic scanning applications 6. Mathematical 6. The student will demonstrate Knowledge, skills and knowledge and understanding of application ultrasound physical principles and instrumentation. 7. Scientific knowledge 7. The student will demonstrate and skills in scientific knowledge of sonographic biological reasoning effects, proper application of sonographic instrumentation relative to imaging and film quality. 8. Global perspectives 9. The student will demonstrate an and Cultural diversity understanding of diverse cultural and humanistic traditions in the global society. Table B1, three year assessment cycle for DMS SLOs and PSLOs 12