Impact Evaluation of Alcohol Brief Intervention Training (ABI) June 2014 February 2017

Transcription

1 Aberdeen City Alcohol & Drug Partnership Impact Evaluation of Alcohol Brief Intervention Training (ABI) June 2014 February 2017 Based on extensive prior experience of delivering alcohol training it was felt necessary to break down future training into two distinct session areas; alcohol awareness (the whole population approach ) and brief intervention skills ( ABI ). Each session would be of 3 hours duration with the awareness session a prerequisite for attendees who had little or no prior alcohol awareness or not having had any opportunity to previously attend or complete any training. As the ABI component was being opened out to wider settings (i.e. non NHS priority areas) for the first time, it was felt that this distinction was important for those with less experience. This session was also designed to act as a stand-alone briefing session for anyone without a client/patient focus in order to build capacity for increasing awareness of policy issues in a local context. However nearly all attendees were also practitioners by definition and went on to complete both sessions. All sessions were evaluated on their completion by participants however it was felt to be just as important (if not more so) to ensure that a detailed follow-up of the ABI participants post-training was carried out in order to gauge impact on practice and actual delivery of ABIs. The follow up survey was conducted with those practitioners who had completed the 3 hour face-to-face ABI practice session as detailed below. Total number attending ABI training: 120 Completed surveys: 65 Overall response rate: 54% A detailed questionnaire was devised and released to participants who had a 2-3 month gap between completion of their training and participating in the survey. The following responses (tables/graphs) are taken directly from the survey summary: 1

2 Question 1: Where Do You Work? ARI/Acute % Community % Keep Well 1 1.4% Local Authority % Mental Health Clinic based 4 5.5% Mental Health Hospital based 4 5.5% NHS Healthpoint 2 2.7% Other 6 8.2% Primary Care % Voluntary Org 2 2.7% TOTAL 73 2

3 Question 2: Why did you book to attend ABI training? To develop or improve my own professional practice in the delivery of ABIs % To be better informed about the delivery of ABIs in health or community settings % Other 3 4.6% TOTAL 65 The majority of responses identified improving professional practice as the main rationale in attending training. The % rate was similar for both training evaluation dates. 3

4 Question 3: How did you find out about the training? Information circulated via newsletters or publications % Other 1 1.5% Own research to identify training opportunities % Recommendation by a colleague % Suggestion by line manager % TOTAL 65 Line management was reported to be the main reason for finding out about training, followed by Information circulated. The % response for these 2 reasons was exactly the same for the earlier evaluation (36% for both Line Manager & Information circulated via newsletters or publications). This % response for finding out about training via line manager was much higher for the most recent evaluation (65%). 4

5 Question 4: After attending the training session were you able to apply your learning to your practice? No 5 7.9% Yes % TOTAL 63 The above shows a very positive response rate in terms of learning, development and application. Both evaluations showed a similar response ratio. 5

6 Question 5: How often do you use the learning from the ABI training in your practice? Daily % Weekly % Monthly % Other % TOTAL 53 A total of 53 out of a possible 65 responses were recorded (82%) for this question, with the majority stating that they applied ABI training "weekly" in their practice. Of note, "Daily" was the most frequent reply for the most recent evaluation. 6

7 Question 6: Do you feel the ABI training has helped facilitate easier conversations between you and your patients/clients? No 3 5.1% Yes % TOTAL 59 7

8 Question 7: Do you feel the ABI training has helped you deliver effective interventions? No 4 6.9% Yes % TOTAL 58 A very positive outcome from the intended learning and development outcomes remains evident. 8

9 Question 8: Are you aware of any success following the delivery of an effective ABI? Patient/client indicating that they will reduce consumption % Patient/client reporting a reduction in consumption % No % Other 5 7.9% TOTAL 63 Almost half of replies reported that patients had indicated that they would reduce consumption, followed by a quarter reporting that patients had reported a reduction in consumption. Just under a quarter of responses recorded that they were not aware of any success following the delivery of an effective ABI. 9

10 Question 9: Can you give any indication of the approximate number of patients/clients you have delivered an ABI to since you attended this training? Between % Between % Between % Over % Other (specify) 2 3.7% TOTAL 54 10

11 Question 10: Indication of the nos of patients where following screening, and identification of possible dependent drinking it has not been appropriate to deliver an ABI? Between % Between % Between % Over % Other 2 3.3% None % TOTAL 60 11

12 Question 11: Following identification of dependent drinking have you made a referral to another service or offered additional information? Patient/client provided with information to self refer % Patient/client provided with leaflet and/or information % Patient/client referred to alcohol service locally % Patient/client referred to GP % Patient/client referred to hospital based alcohol service % Patient/client refused to discuss 4 6.8% TOTAL 59 It is interesting to note that 41 of the 59 responses to question 11 were from the most recent evaluation. This represents 69% of all responses although the number of responders in this evaluation represents 32% of the total respondents (both evaluations). 12

13 Question 12: Have you experienced any difficulties putting aspects of the training into practice? No % Yes % TOTAL 57 13

14 Question 13: Can you identify which area of the ABI approach is causing difficulties? Delivery of the ABI % Feedback % Recording 1 6.7% Screening 1 6.7% Other % TOTAL 15 14

15 Question 14: Would further support with regard to ABI training be useful to you? No % Yes % TOTAL 61 15

16 Question 15: What type of support would you like to receive? Short refresher training % Short updates on a regular basis % Signposting to E-learning opportunities % To join a mailing group of people with similar interests 6 8.5% To meet others using the ABI approach to share experience & learning % Other (specify) 2 2.8% TOTAL 71 There are some limitations to this evaluation in terms of a number of training participants who have not responded by completing the survey questionnaire. That said, the overall quality of responses received suggests that the programme of training has been relatively successful with a high degree of practitioner confidence demonstrated in terms of delivery of alcohol brief interventions. Fraser Hoggan ADP Development Officer October