ACP 360 Multi-source assessment for psychiatrists March 2012
What is ACP 360? Gathers feedback kfrom colleagues (including free text comments) and service users; it complies with two of the GMC s revalidation criteria Uses validated and reliable questionnaires* Measures an individual s behaviour in 8 domains (see slide 6) that psychiatrists identified as being important An individual id can compare their scores with benchmark average scores that are based on data from past participants (psychiatry peers) 4 versions are available for: general adult, CAMHS, learning disability, and a 270 degree version for psychiatrists with limited patient contact *Lelliott, P., Williams, R., Mears, A., et al (2008) Questionnaires for 360 degree assessment of consultant psychiatrists: development and psychometric properties. British Journal of Psychiatry, 193: 156 160.
Why use ACP 360? For the individual Personal development: Enables individual psychiatrists to o understand their strengths o help identify areas for development o increase self awareness o and own and control their personal development Revalidation: It provides psychiatrists with twoofthe of the six types of supporting information required for revalidation and relicensing. For organisations ACP 360 o supports improved communication o helps create a more open culture o improves skills, team working and mutual understanding
Feedback 75% found the results of the assessment helpful 85% found the report clear and easy to understand 90% agreed that the instructions were easy to follow and that no training was required 90% stated that the report would form part of their next appraisal
Participation More than 4000 psychiatrists have registered with ACP 360 since its launch in 2005. A new online survey was launched in August 2010 and as of March 2012 this survey system holds data for: 1420 general adult psychiatrists (incl. rehabilitation, forensic, addiction)* 112 child and adolescent psychiatrists py 93 learning disability psychiatrists *The data and mean ratings presented in the following slides are from the general adult psychiatrists who completed the online survey (n=1420)
The 8 behaviouraldomainsassessed assessed andmean ratings General adult psychiatrists (n=1420); Scale: 1 = very low to 6 =very high Behaviouraldomains Mean self rating Mean colleague rating (derived from sub sections within a 46 item questionnaire) 1. Communication 4.6 5.0 2. Availability 4.7 5.0 3. Emotional intelligence 4.5 4.9 4. Decision making i 46 4.6 50 5.0 Relationships with 5. patients t 46 4.6 51 5.1 6. relatives, partners or carers 4.5 5.1 7. other psychiatrists 4.5 4.9 8. team and external agencies 4.2 4.9
Service user feedback for general adult psychiatrists 15 item questionnaire; scale: 1=very low to 6=very high Sample item questions Number of service users Mean rating 1. Is friendly and easy to approach 32,839 5.3 2. Listens well to what I say 32,878 5.3 6. Shows warmth and is genuine and understanding 32,782 5.3 11. Asks about my point of view 32,328 5.2
What does it involve? After enrolling, participants i t receive an email with an instruction ti pack and electronic link to activate their online survey 4 steps to ACP 360 1. Complete your online self assessment 2. Invite colleagues to complete an online questionnaire 3. Invite service users to complete an anonymous paper based questionnaire returned directly to ACP 360 4. You receive your ACP 360 report On your request, your nominated appraiser receives a copy of your report and the free text comments so that they may be discussed in a supportive way.
Report format and content (1)
Report format and content (2) Self and colleague ratings on the 46 item questionnaire are reported in a table by each item. This presentation also applies to the service user ratings on the 15 item questionnaire. Where a colleague rating is > 90 th percentile of the benchmark (indicating strengths) th )it is flagged with and a rating < 10 th percentile of the benchmark and below a rating of 4 (i.e. below Moderately High ) (indicating potential areas for improvement) is flagged with i
Enrolment: www.rcpsych.ac.uk/acp360 Costs Multi enrolments (> 10) = 99 per psychiatrists + VAT Individual enrolment = 110 + VAT Recommend ACP360 is undertaken every 3 years Contact: ACP360@cru.rcpsych.ac.uk Tel: 020 7977 6664