Drumchapel Caravan Project Independent Evaluation Report - Final Report - By Eddie Cusick Communities First Consultants A report to the Management Committee of Drumchapel Caravan Project June 2008
Table of Contents Section Focus Page(s) 1 Introduction 3 2 Background 3 3 Aims and Objectives 4 4 Partnerships 4 5 Outputs and Outcomes 5 6 Membership 6 7 Allocation and Occupancy 7 8 Beneficiaries Feedback 8 9 Case Studies 9 10 Value for Money 11 11 S.W.O.T Analysis 11 12 Recommendations 12 13 Conclusion 13 2
1. Introduction Communities First Consultants were commissioned by Drumchapel Caravan Project in June 2008 to carry out a robust independent evaluation of the services, over the last three years, to ensure that they have sufficient and credible evidence to demonstrate that the organisation provides key services to their target group, delivers on agreed outputs and outcomes, and offers value for money. The objectives for this were to: Collect and collate information from member groups on how the Drumchapel Caravan Project assisted them to support and enhance the life and lifestyle of their beneficiaries. Collect and collate information from beneficiaries on how the Drumchapel Caravan Project supported them to enhance the life and lifestyle. Make recommendations for the future development of the Drumchapel Caravan Project to ensure sustainability. The methodology used for this evaluation has involved: Meetings with representatives of all member groups, particularly those involved in the promotion and referral process. Providing a questionnaire to beneficiaries of the Drumchapel Caravan Project. Extracting and collating the necessary information from questionnaires. Analysis of all agreed outputs and outcomes. Holding a focus group of member groups. This evaluation report is designed to provide a summary of the Drumchapel Caravan Project s achievements and activities over the past three years and of the lessons learnt in the course of the implementation, which may assist the development of the project in the future. 2. Background Drumchapel Caravan Project was established in 1985, to provide affordable holidays and respite to disadvantaged Drumchapel residents, as an unincorporated community organisation, whose management committee are made up of members of the project s user groups. After receiving a caravan from the residents of Harrow Court Sheltered Accommodation Complex. Initially the project was under the management of the Drumchapel Volunteer Group, and received additional support for the Volunteer Centre. However, this has changed with project being self managed with additional support via a Service Level Agreement with the Volunteer Centre for administration and management support. Following a successful Big Lottery application in May 2004, The Drumchapel Caravan Project was able to purchase and manage two (6 berth) fully accessible and modified caravans at Berwick-Upon-Tweed. Both caravans have been equipped to the highest standard where its member groups and beneficiaries can enjoy thirty weeks of family and respite breaks throughout the caravanning season. 3
3. Aims and Objectives Aims The overall aim of the project is to promote and develop social inclusion, community involvement, and health and well-being in the Drumchapel Caravan Project. Objectives: To provide low cost quality subsidised holidays for vulnerable disadvantaged residents of Drumchapel and West Area. To engage with new user groups to widen target group representation i.e. people with mental, emotional, and physical health problems, people with addictions, lone parent families, young people, and learning disabilities. 4. Partnerships During the life of the project, the project has developed and sustained working partnerships with a number of statutory/voluntary/community agencies. These partnerships have ensured that member groups and beneficiaries received and had access to enhanced services that made their experience of the project that bit more enjoyable and eventful. The partnerships have focused on health, education, transport, and safety, with the partners are: Community Health Action Team Health Promotion Oral Health Action Team Community Learning Project West Area Social Work Services Drumchapel Community Safety Forum The in-kind service from the partners included: Book Library Project - small Library in both caravans to encourage adults, young people and children to read as an alternative to television. Educational Games Project - small selection of educational games in both caravans for children and young people Community Safety Initiative provision of leaflets on home security to users of the caravan to ensure that holiday makers have piece of mind when leaving their homes unoccupied. Healthy Eating & Fruit Project provision of healthy eating recipes for families and also specific recipes targeting over 60 s. Provision of a basket of fresh fruit to every family/group staying at the caravan. Oral Health Project provision of new toothbrushes and information on how to protect your teeth to every family/group that will use the caravan. 4
Initiatives had positive 2005 2006 2007 impact on holiday party Safety Pack 40 29 33 Fruit & Veg Pack 34 32 30 Oral Hygiene Pack 28 23 21 Games interaction 33 27 33 Books for relaxation 27 23 30 It is envisaged that to build on these partnerships the committee will endeavour to sustain existing partnerships and form new partnerships with other service providers such as: Drumchapel L.I.F.E Drumchapel Community Transport West Area Community Planning Partnership Drumchapel Credit Union Community Health and Care Partnership New users groups The project has a positive working relationship with the Berwick Holiday Centre have agreed to provide free entertainment passes to the beneficiaries. This in-kind contribution reduces the cost to the beneficiaries and alleviates any undue hardships. 5. Outputs and Outcomes The Drumchapel Caravan Project has set outputs and outcomes that they would deliver on, these being: Output provide and promote opportunities for at least 320 disadvantaged people to access a one week holiday. Outcomes People with physical and mental health issues will have reduced anxiety and depression. Children and young people will benefit from improved family relationships, broadening their experience and widening aspirations. People with previous addictions will benefit from increased social inclusion, and improved physical and mental well-being. Older people will benefit from a greater sense of independence. Disadvantaged people will benefit from reduced isolation, increased confidence and self esteem, and improved sense of well-being. Develop a Service Level Agreement with The Volunteer Centre for dedicated administration and development support and guidance. Figures show the breakdown of the criteria group that beneficiaries saw themselves belonging to, with some seeing themselves belonging to more than one group: Criteria Group Year 1 Year 2 Year 3 Elderly 40 22 39 5
Youth 10 8 15 Carers 17 14 12 Physical Disability 26 18 10 Mental Health 10 14 8 Vulnerable Family 7 12 12 Low Income 24 25 33 Learning Disability 3 8 7 Addictions 1 4 4 6. Membership The membership of the organisation has been developed over the years, and following the successful Big Lottery application in 2004 the organisation has been able to expand on its membership, therefore, increasing the number of beneficiaries. Prior to the Big Lottery application, Drumchapel Caravan Project had 10 member groups; however, following the Big Lottery award the membership rose to 24 member groups. It is felt that the purchase of 2 new fully adaptable/accessible caravans and the additional support services from partner organisations accounted for the increase in membership. A number of member groups see themselves servicing a number of beneficiary groups, however, for the purpose of this report we have taken their primary beneficiary group as their main criteria. These member groups are: Member Group West Step Together(West) West Carers Centre Drumchapel Law & Money Advice Drumchapel Home Visiting Scheme Focal Point Day Centre G15 Youth Project Harrow Court Sheltered Housing Norkin Action Group Phoenix Neighbourhood Centre Pinewood Square Sheltered Housing Drumchapel Seniors Forum Stonedyke Neighbourhood Centre West Area Social Work Department User Involvement Group Women s Active Support Group Young Person s Befriending Scheme Drumchapel Youth Forum Drumchapel Disabled Action Group One Plus Supported Youth Housing Beneficiaries Adults with Learning Disabilities Carers and Young People Low income Households Elderly and Physical Disabilities Elderly Young People Elderly Elderly Vulnerable Families Elderly Elderly Vulnerable Families Vulnerable Families People with Addiction issues Women & Families Young People Young People People with Physical Disabilities Lone Parent Families Young People 6
COPE Drum Adventure Group Momentum Tenants managed Homes Non Group Members Cancellations/Unfilled People with Mental Health issues Disadvantaged People with Mental Health issues Disadvantaged Various See Non group members The membership groups are clearly defined and service a specific section of the community, which are: Addictions Adults with Learning Disabilities Carers Disadvantaged Elderly Lone Parents Mental Health Physical Disabilities Vulnerable Families Young People Due to external matters, and matters out with the control of Drumchapel Caravan Project a few organisations/groups have withdrawn their membership of the project, but it is believed that some beneficiaries have moved to other member groups/organisation therefore are still in receipt of the projects services. It should be noted that non group members are groups who have contacted the project on an ad hoc basis looking for availability. These groups were only offered use of the caravans if a member group had to cancel at the last moment or there was a vacancy in the booking. 7. Allocations and Occupancy Drumchapel Caravan Project has the potential to provide a one week holiday for 60 groups and 360 individuals Presently member groups and beneficiaries have the opportunity to multiple visits maximum three per year, however, this could be reviewed once the membership increases. Furthermore, there are occasions when a group does not take up full occupancy. This is due to the purpose of the request and the beneficiaries utilising the caravans i.e. lone parents, people with mental health, vulnerable families, etc. Over the past three years the take up of the caravans by the member groups has been high, this is outlined on the chart below: No of Groups Year 1 Year 2 Year 3 Total 16 18 18 20 7
No of Individuals 172 219 210 601 The above figures have been broken down further into adult, and Children and Young People: Year 1 Year 2 Year 3 Adults 112 168 149 Children & Young People 60 51 61 Total 172 219 210 8. Beneficiaries Feedback Following each holiday every user group are requested to complete and return an evaluation form, unfortunately not all groups returned their evaluation despite numerous requests. Returned Evaluation Forms Year 1 Year 2 Year 3 41 36 40 The following results are taken from the evaluation form returns over the past three years and gives supporting evidence suggesting that the project is a successful and essential service to the area. Reason for holiday Year 1 Year 2 Year 3 Poor Health 19 18 19 Depression 14 13 14 Low Self Esteem 27 7 13 Change of Environment 27 17 28 Family Problems 11 5 12 Stress 20 12 21 Disability 25 15 12 Financial problems 12 12 18 Isolation 9 6 7 What made holiday possible? Year 1 Year 2 Year 3 Value for Money 35 32 39 Location of Caravan 22 18 28 Caravan holiday on offer 38 33 37 Door to Door Transport 32 31 35 Ease of Booking 30 27 35 Facilities and Initiatives 20 27 29 Impact on holiday 8
Year 1 Year 2 Year 3 Boost Confidence 16 14 19 Improve family relations 13 16 15 Meet new People 26 18 24 Time to relax 32 28 36 Physically feel better 33 16 26 Have more fun 34 22 33 Visit new places 33 23 26 Try new activities 11 9 16 Barriers to participation Year 1 Year 2 Year 3 Finances 30 23 25 Need Carer 10 4 8 Not a priority 3 2 2 Appropriate transport 19 19 26 Lack of confidence 6 10 7 Finding somewhere 6 6 12 suitable for kids Disabled Access 15 7 5 Family Circumstances 13 10 17 Although these barriers are relevant to the individuals and their respective group, in the main they are out of the control of the Drumchapel Caravan Project. However, the project raises the issue with the individual s member group so that they can seek additional support from their group and or another agency. 9. Case Studies The following case studies are in relation to the outcomes of the project, and are a sample reflection of the views of the beneficiaries after they had returned from their time at the caravans. Case Study A Reduced Isolation It gave me the confidence I needed to try out new activities. I have returned to college and met lots of new people and tired out new activities I feel this has helped me to become a happier person and therefore less stressed which has helped me suffer less asthma attacks. Mrs. F stated that the caravan holiday was the best thing that had happened to her in a long time and she believes it sent her on her road to recovery. Since the holiday, Mrs. F s health has improved and she has struck a long and lasting friendship with the ladies that holidayed with her. They have all become good friends and the volunteer her escort - visits her regularly. Case Study B Increased Confidence & Self Esteem Since returning from holiday Mrs. H stated that she felt more confident and was even leaning to say no. She felt much better after her holiday and was spending a bit more time on herself rather than others. Thomas has a health issue which can have an impact on his confidence and he sometimes struggles to mix with some of the local boys at home. He loved the caravan 9
(he still talks about it all the time) and managed to make friends with some to their neighbour s kids. Whilst he was there he also met and spent loads of time with his first girlfriend. He now has a photo album capturing lots of memories. Case Study C Improved sense of Well-being Although slightly self-conscious at first, F did get into using the swimming pool at the caravan. She had lots of fun and it has even inspired her to access the local pool at home. Life seemed easier and more pleasant after the holiday. Case Study D Improved access to healthier diet The fruit and veg pack were great. It helped us to have a healthy balanced diet. The extras such as transport and the fruit basket were also very much appreciated. The fruit available encouraged the children to try new tastes and on return home this continued. Case Study E Strengthened interpersonal relationships We all felt relaxed and stress free for the week we were there. It gave us the opportunity to spend some quality time together as a family. After the holiday we have been doing more things together as a family: shopping, cooking/eating, relaxing, watching DVDs etc. The actual holiday did reduce her feelings of stress and improved her relationship with her son who accompanied her on the holiday. She feels that since the holiday communication between them has improved and that they are much more open and prepared to talk about painful issues than was previously the case. Case Study F Reduced anxiety and depression F has been through a period of domestic violence and the chance to get away from it all proved a relief from day to day worries and anxieties. I wasn t looking forward to it because of all the family problems but I actually had the most relaxing & stress free time. On a personal level, mum reflected that she was more relaxed and less anxious about things generally which has improved the atmosphere in the house and the way they all relate to each other. Case Study G Young People We feel the change of scenery and the fresh air has made us feel better in ourselves and more confident about meeting other people and doing new activities. Mum felt that during their time away the children were more confident about going out and meeting other children of their own age and trying new things together. Case Study H People with disabilities I am a carer & my daughter has learning disabilities, we came back more relaxed and communicated better. Case Study I - Health improving benefits Mrs. M stated that the holiday had given her a new lease of life and had helped her to get back on her feet again. She felt better for having been away for sometime after and has managed to control her alcohol intake and seems to be improving. I didn t think or worry about my problems. I was stressed before the stress disappeared and I could cope better Helped me look at life in a different way, try to sort my problems. I got a wee job and my wife went to college. I am still seeing my counsellor regularly and have stopped drinking. I am also taking my medication regularly. Got the opportunity for a friend to clear out and clean my house when we were away, this really was a help for my wife. She and her sons had a lovely relaxing time and the change of environment made a 10
difference to her sons relationship. They got on well together; one in particular reduced his drinking while away from outside influences, and stopped their quarrelling. In general this holiday opportunity brought them closer for that week at least. 10. Value for Money From the information provided it appears that the Drumchapel Caravan Project provides great value for money to its members and beneficiaries, and has enabled the project to deliver on its objects within budget. Although the project did not address all its outcomes, it did develop robust partnerships in service delivery, which provided complementary/additional services, and could shape the way forward for the project. In addition to the holiday element of the project, it should also be noted of the additional benefits that participants gain. These additional benefits impact on the beneficiaries personal and social development, improvement of their health and well being, life and lifestyle, and community inclusion. The project does generate a small income from caravan rental, which allows the project to operate on a short term basis covering general running costs for each caravan per year. 11. S.W.O.T Analysis The Drumchapel Caravan Project Management Committee carried out a S.W.O.T Analysis of the project at a Project Review Day. The analysis will be used to develop the project, its operational planning, and service deliver. The points highlighted in the analysis touch on many parts of the recommendations in section 12 of the report, and set out a development route for the project. Strengths Weaknesses Successful project Lack of Funding Demand for service high Review o groups needing/using Multi benefits to users (meeting all project at present outcomes) User groups some non committed Holiday meets aspirations/recharge batteries Time restrictions to fill dates. Filling dates (early/late season) Excellent value for money Repeat users Breaks down barriers/change of User group lack of promotion environment Some user groups small numbers Networking/info sharing & referral Waiting list for other groups resource Limited staff support funding Income generating No charitable status Good track record (long history) Allocation of dates: not best but fair Non-discriminatory Distance from caravans lack of Attainable/accessible control/monitoring. eg past Good reputation self promoting incidents Unique in west Cleaning not best arrangement Committee: strong, knowledgeable, Sustainability long term funding 11
and committed Community based project High levels of customer satisfaction Caravans well equipped/accessible high standards User friendly project Transport/driver facility Free initiatives/passes Project staff support & Vol Centre User Group System rep contact & targets most in need Location & facilities on site & surrounding eg town centre/history & culture Partnership working eg initiatives Opportunities Expand project - more caravans, staff hours increased, and new posts Would need consultant support for above Expand area (west CHCP) Target under represented client groups or areas of high demand Look at other areas of partnership working eg link in with credit union Review current user groups Implement membership form for 2009 Project static no development Life expectancy of current caravans. Threats No funding >> No Project User groups & reps need to be committed for future success Other groups in west applying for caravan funding new project/ competition for funds No future development 12. Recommendations 12.1The Drumchapel Caravan Project should consider expanding its operational area to include the West Community Planning Partnership Area, and seek dialogue with the local partnership board to discuss the expansion and funding requirements to implement this expansion. 12.2 The Drumchapel Caravan Project should open discussions with the Drumchapel Credit Union to formalise a saving scheme for existing and potential beneficiaries who would like to save for usage and spending monies. 12.3 The Drumchapel Caravan Project should attempt to engage with new member groups and beneficiaries, and market the project more widely along with the support of a Marketing Strategy. 12.4 The Drumchapel Caravan Project should introduce a cancellation system, as the project has to make alternative arrangements when beneficiaries cancel at the last moment. 12
12.5 The Drumchapel Caravan Project should carry out a Needs Analysis with member groups as to why they want to be a member, and how they will support the sustainability of the project. 12.7 The Drumchapel Caravan Project should apply for Charitable Status, if obtained; this would allow them to access a new stream of funding opportunities. 12.8 The Drumchapel Caravan Project should develop a Funding Strategy for medium to long term development. 12.9 The Drumchapel Caravan Project should sustain their Service Level Agreement with The Volunteer Centre. 12.10 The Drumchapel Caravan Project should reduce its target number of beneficiaries, unless they are going to ensure full occupancy on each holiday, which may not be achievable. 13. Conclusion The Drumchapel Caravan Project appears to be targeting the appropriate beneficiaries showing evidence of positive results, and has been successful in encouraging active partnerships and addressing the needs of the member groups and beneficiaries. The project never reached its target of 960 individuals over a three year period, which is due to the make up of the groups and family beneficiaries. However, the 601 beneficiaries that did take up the opportunity did address the outcomes identified at the outset of the project. The barriers identified in the report are out with the control and powers of the project, and should only be included in the evaluation form if the project is looking to address these barriers with member groups and partner agencies. The project has resulted in a number of unexpected outcomes. Individuals have gained employment; there is an increased awareness of health opportunities and understanding, stronger family bonds, new friendships, and the strengthening of relationships between partners. If the project is to continue and develop, there has to be a commitment from partners and strategic bodies to support and assist in the project s future by ensuring that funding and funding opportunities, and in-kind support are available to progress the project, and enable it provide a key service to the residents of its operating area. Eddie Cusick Communities First Consultants 13