TOR- GIPA PROJECT FINAL EVALUATION

Transcription

1 1. BACKGROUND TOR- GIPA PROJECT FINAL EVALUATION 1.1. Backgrund t the UNV Prgramme The United Natins Vlunteer (UNV) prgramme is the UN rganizatin that cntributes t peace and develpment thrugh vlunteerism wrldwide. Vlunteerism is a pwerful means f engaging peple in tackling develpment challenges, and it can transfrm the pace and nature f develpment. Vlunteerism benefits bth sciety at large and the individual vlunteer by strengthening trust, slidarity and reciprcity amng citizens, and by purpsefully creating pprtunities fr participatin. UNV cntributes t peace and develpment by advcating fr recgnitin f vlunteers, wrking with partners t integrate vlunteerism int develpment prgramming, and mbilizing an increasing number and diversity f vlunteers, including experienced UNV vlunteers, thrughut the wrld. UNV embraces vlunteerism as universal and inclusive, and recgnizes vlunteerism in its diversity as well as the values that sustain it: free will, cmmitment, engagement and slidarity Backgrund t the prject The Millennium Develpment Gal #6 refers t halting and reversing the spread f HIV/AIDS by 2015, which is cnsidered ne f the pririty areas fr develpment assistance in rder t help Vietnam t achieve this gal. The Viet Nam Natinal Strategy n HIV/AIDS highlights the need t prvide care and supprt t peple living with HIV/AIDS and fight stigma and discriminatin. The strategy als specifically mentins the need t invlve peple living with HIV in HIV preventin activities. The 1 st phase f the Prject Prmting Greater Invlvement f Peple Living with HIV (GIPA) in Viet Nam fr the perid has cmpleted, while its 1 year extended phase fr 2009 will be ended in December The prject is implemented by the Vietnam Wmen s Unin in partnership with UNV and UNAIDS. Gegraphically, it cvers fur prvinces: H Chi Minh City, Hai Phng, Quang Ninh and Ha Ni, where a large number f peple living with HIV exist in cuple with a large number f available supprts and self help grups fr PLHIV. The GIPA prject aims t increase vluntary participatin f peple living with and affected by HIV in the planning and implementatin f HIV activities and ther effrts t imprve their lives, families and cmmunities. Specifically, the prject intends t deliver the fllwing utputs: 1. Increased capacity and number f peple living with and affected by HIV t meaningfully participate in HIV activities. 2. Increased access f PLHIV and their families t treatment and ther services. 3. Reduced stigma and discriminatin frm the general public twards PLHIV. 1

2 4. Increased understanding f and supprt t the GIPA principle. 2. JUSTIFICATION This evaluatin is required by UNV Headquarters and One Plan Fund Management and allcatin Cmmittee (OPFMAC), and will serve as a basis fr a lng term strategy and duplicatin f the prject gd practices t battle HIV epidemic in Vietnam. The main stakehlders f the evaluatin are UNDP, UNV, the Prvincial Peple Cmmittee f Quang Ninh, Hai Phng, Hani and H Chi Minh; and the Vietnam Wmen s Unin. 3. OBJECTIVES AND SCOPE General Objective: The evaluatin will clsely examine, but nt wuld be limited t, the fllwing areas: 1. Overall prject perfrmance against its wrkplan and thrugh which identify the Prject s best practices, lessns learned, successes and challenges. 2. Assessment f the relevance f prject design t Vietnam cntext in regard t GIPA cncept and its duplicatin t ther regins f Vietnam in the future when the prject has ended. 3. Idenficatin f any gaps in prject management, crdinatin mechanism as well as technical supprt t the prject, and recmmendatin f wrkable slutins that can be applied in case f prject s duplicatin in the future. 4. Identificatin f the results and cntributin which vlunteerism and vlunteers brught t the prject. 5. Assessment f relevance, effectiveness, effects and sustainability f the results and cntributin that vlunteerism and vlunteers brught t the prject including lessns learned. 6. Frmulate recmmendatins n hw t maximize the cntributin f vlunteerism in case f prject replicatin in the future. 4. KEY AREAS /ISSUES TO BE ADDRESSED This evaluatin must address the fllwing criteria: 4.1. Relevance External cherence: The extent t which the bjectives and design f the prject are suited t lcally defined stakehlders needs and pririties, and t gvernment plicies. Was the prject develped t address and did it implement the right things? Des the prject implementatin and management benefit cmmunity members in the target areas? T what extent are the bjectives and utputs f the prject still valid? Are the activities and utputs f the UNV cmpnent cnsistent with the verall GIPA prject gal and the attainment f its bjectives? Are they cmplementary t ther develpment interventins happening in the cuntry? 2

3 Which are the cnstraints under which the prject functined? Internal cherence: The extent t which the bjective and design f the prject are suited t UNV s strategic gals and pririties, t the cuntry prgramme, t reginal strategy. Has the prject cntributed t advancing the cntributin f vlunteerism t develpment in the area where it was implemented? Hw has the prject cntributed t strengthening advcacy fr vlunteerism, integratin f vlunteerism int develpment prgramming and mbilizatin f vlunteers (UNV and thers) in the area where it was implemented? What relevant lessns emerged frm this pilt can infrm future UNV prjects in similar areas/ cuntries? 4.2. Effectiveness A measure f the extent t which the prject has attained, r is expected t attain, its majr relevant bjectives. T what extent were the bjectives f the prject achieved? What indicatrs demnstrate that? What were the majr factrs influencing the achievement r nn-achievement f the bjectives? Is cmmunity vlunteerism an effective apprach/mechanism t prmte the GIPA principle? Why r why nt? 4.3. Efficiency A measure f hw ecnmically resurces/inputs (funds, expertise, time, etc.) are cnverted t results. Efficiency measures the utputs qualitative and quantitative in relatin t the inputs and usually requires cmparing alternative appraches t achieving the same utputs, t see whether the mst efficient prcess has been adpted. Were the activities cst-efficient? Were bjectives achieved in time? Was the prgramme r prject implemented the mst efficient way cmpared t alternatives that d nt include UNV participatin? 4.4. Effects The psitive and negative changes prduced by prject interventin, directly r indirectly, intended r unintended. The examinatin shuld include the psitive and negative impact f prject interventin, such as changes in terms f cmmunity perceptin f GIPA befre, during and after prject; vlunteer mbilizatin t varius prject activities, What has happened as a result f the prject? What real difference has the activity made t the beneficiaries? What were the mst significant changes that this prject has helped t generate? Include perceptin and behavir f cmmunities wh generate incme frm prject assistance thrugh sideline activities. What types/kinds/grups f peple have been affected and may be impacted after the prject? The evaluatin f effects needs t be realistic take int cnsideratin that mst develpment interventins have an attributin challenge, as develpment results and changes can very rarely be attributed t the actins f ne particular actr. In the case f UNV, this is very ften the case, as UNV wrks in cllabratin with ther partners in the field. While the added value f UNV and vlunteerism can and 3

4 shuld be highlighted in every evaluatin, it is imprtant that the reprt takes int cnsideratin and credits thers inputs as well as UNV s Sustainability A measure f whether the benefits f a defined activity is likely t cntinue after dnr funding has been withdrawn and the prject has ended. Prjects need t be envirnmentally as well as financially sustainable. External factrs (plitical, institutinal, ecnmic, technlgical, sci-cultural and envirnmental) affecting sustainability shuld als be cnsidered. T what extent are the benefits f the prject prjected t sustain after dnr funding ceases? What are the majr factrs which influence the sustainability f the prject? Is there a clearly defined exit strategy and t what extent will it cntribute t sustainability? What are the arrangements, implicatins and cnsideratins which VWU/UNAIDS need t make in regards t the sustainability f the GIPA and vlunteerism activities? 4.6. Vlunteerism UNV recgnizes that vlunteering means different things t different peple and that there is a wide range f ways t prmte vlunteerism. Within this cntext, the evaluatin shuld cver different aspects f vlunteering. What is the distinctive cntributin r added value f UNV vlunteers t the utcmes f the prject? Withut the invlvement f UNV vlunteers, what wuld have been different? Wuld the utcme have been the same, slwer, negative, nt happened at all? Hw did UNV in the prject cntribute t stimulating lcal vlunteerism? Hw did the prject cntribute t cmmunity empwerment and civic engagement f PLWHIV? What were the helping and hindering factrs t the stimulatin f vlunteerism in the prject? Hw did the prject prmte different aspects f UNV s business mdel? Are there any lessns emerging frm the prject that can infrm future UNV interventins n hw t implement the UNV business mdel? 4.7. Other evaluatin criteria There are ther themes and areas that are cmmnly included in prject design, and shuld be taken int cnsideratin during evaluatins. Fr instance, as part f UNV s strategy, prjects and prgrammes are usually dne in partnership and crdinatin with ther develpment actrs, include gender and human rights perspectives, and have strng participatin and capacity develpment elements. These tpics shuld t the extent apprpriate be part f the evaluatin and specifically included in the evaluatin reprt. Partnerships An analysis f the institutinal relatinships develped thrughut the prject and the extent t which they have cntributed t the achievement f results. Wh were the partners invlved in the design and implementatin f the prject (UN, gvernment, internatinal NGOs, lcal rganizatins, etc)? What value did the different partners add? What were the key factrs cntributing t building gd partnerships during implementatin f the prject? 4

5 Hw can key partnerships, especially with Gvernment, be strengthened in the future? Gender Whether and t what extent the prject tk the gender dimensin int accunt and whether it prmted a gender sensitive apprach t frmulatin and implementatin. It als invlves practical measures t guarantee an adequate treatment f gender issues in the prject, beynd equal participatin by men and wmen, and addressing changes in attitudes and behaviurs. Did the prject fllw a gender sensitive apprach? What was the level f participatin f men and wmen in the prject? Did the prject wrk specifically with wmen s grups and rganizatins? Was this an effective apprach? Are there any changes in attitudes and behavirs twards gender relatinships amng the beneficiaries that can be nted, and t what extent did the prject cntribute t these changes? Are there any actins prmted by the prject that demnstrate that vlunteerism can supprt changes in gender relatinships? Are there any generic lessns emerging frm this prject n hw t address gender issues in UNV interventins? Human Rights Whether and t what extent the human rights dimensin was taken int accunt, and if the prject prmted a rights-based apprach t frmulatin and implementatin. Did the prject cnsider a rights-based apprach? What were the practical measures taken by the prject t guarantee a human rights perspective? Was this apprach effective? Did the prject have a specific scial inclusin apprach? Are there any actins prmted by the prject that demnstrate that vlunteerism can supprt scial inclusin? Are there any lessns emerging frm this prject n hw t address human rights issues in UNV interventins? Capacity Develpment This criterin measures the extent t which the prject has supprted the creatin and/r develpment f lcal, rganizatinal and individual capacities in target/related prject participants (including cmmunities, NUNV vlunteers). Did the prject have a specific capacity develpment apprach? What were the key elements f this apprach? Wh was the target grup f the capacity develpment apprach? Were the capacity develpment actins adequate t the needs and expectatins f these target grups? What were the specific capacity develpment activities prmted by the prject? What were the mst significant results f these activities? T what extent did the vlunteer element f actins prmted by the prject influence the develpment f capacities? At what level were capacities develped (e.g. natinal, reginal, lcal, rganizatinal, individual)? What were the main challenges and cnstraints t develping capacities in the different levels? 5

6 Are there any lessns emerging frm the prject int ther cmpnents f the GIPA prject n hw t prmte a capacity develpment apprach linked t vlunteerism? Stakehlder invlvement and participatin This criterin measures the extent t which the prject has prmted participatry appraches, used participatry tls r ther means t prmte the invlvement f stakehlders at different levels and stages f the prject cycle. What was the strategy used by the prject t engage and invlve stakehlders in the different stages f the prject? Was this strategy effective? Did it have a psitive, negative r neutral effect n the achievement f results? Is it pssible t establish a link between vlunteer actins prmted by the prject and mre/ better stakehlder participatin in ther areas (e.g. in activities f ther partners, mre participatin in public spaces prmted by the gvernment, etc.)? Are there any participatry tls and methdlgies used in the prject that are wrth being cnsidered fr future UNV interventins? 5. METHODS AND APPROACHES The evaluatin will use the fllwing methdlgy t generate evidence and t maximize learning frm all relevant stakehlders and surces f infrmatin: Desk review Stakehlder mapping Briefing meetings and interviews with key prject infrmants, including the UNV cuntry team, UNAIDS and VWU, Gvernment cunterparts, lcal authrities, self-help grups, cmmunity leaders and key partners/ stakehlder representatives Site visit t areas where the prject is implemented, and fcus grups meetings with stakehlders. Presentatin f final evaluatin t UNV All evaluatins in UNV shuld be cnsistent with the UNEG (United Natins Evaluatin Grup) Nrms and Standards (annex t the TOR), and the UNDP Evaluatin Plicy. The cnsultant needs t sign the UNEG Cde f Cnduct fr evaluatin cnsultants (annex). After the evaluatin is finalized, the prject partners will be respnsible fr preparing a management respnse t the recmmendatins made (template is annexed t the TOR), and therefre recmmendatins need t cncrete, realistic and clearly identify pssible rles and respnsibilities. All dcuments related t the evaluatin (TOR, evaluatin reprt, management respnse matrix) will be made available t the public thrugh the UNDP Evaluatin Resurce Center ( 6. EVALUATION PROCESS Inceptin stage: Desk review f all relevant dcumentatin related t the prject, including plicy and prgrammatic dcuments, and mnitring reprts. Meeting with Prject management team in Hani (VWU) Meeting with UNAIDS fr additinal cmments befre finalizatin f evaluatin design. Briefing meetings and interviews with UNV cuntry team and UNV prject management t finalize evaluatin design. 6

7 Preparatin f inceptin reprt: the inceptin reprt will take advantage f the cnsultant s experience in M&E, and will be based n the cnclusins f the inceptin stage. It shuld particularly lk at the evaluatin questins (and refine them as apprpriate), data surces and data cllectin methds. Data cllectin and generatin stage: Evaluatin missin: visit t the selected lcatins in 4 prvinces ( Ha ni, H Chi Minh, Quang Ninh and Hai Phng) where the prject is implemented. During the missin, the fllwing tls can be applied fr data cllectin and generatin: Fcus grup meetings with stakehlders Site visits t areas where the prject is implemented Interviews with key infrmants Analysis and reprting stage: Preparatin f missin aide-memire: a descriptin f the evaluatin missin including activities carried ut, peple met, and issues t be cnsidered in the evaluatin reprt Preparatin f draft evaluatin reprt, 2-page evaluatin brief and recmmendatins matrix Presentatn f the draft evaluatin t relevant prject stakehlders Feedback n draft evaluatin reprt and evaluatin brief frm UNV Presentatin f final evaluatin reprt at UNV/UNDP cuntry ffice, with participatin f VWU and UNAIDS, and pssible representative f UNV HQ. Desk review Stakehlder mapping Briefing meetings and interviews Preparatin f inceptin reprt Steps in the evaluatin prcess Evaluatin missin (including travel time) t prject sites Preparatin f missin aide-memire, draft evaluatin reprt, 2-page evaluatin brief and recmmendatins matrix Feedback frm UNV t cnsultant n evaluatin reprt, evaluatin brief and recmmendatins matrix and necessary changes Presentatin f final evaluatin reprt (including travel time, if necessary) Ttal: Estimated # f wrking days 3 days 2 days 3 days 2 days 10 days 5 days days 27 days Deadline fr cmpletin Once dates have been cnfirmed, a detailed plan fr the evaluatin missin will als need t be prepared in crdinatin with the UNV cuntry ffice team and TSCP prject team. 7. OUTPUTS 7

8 Expected utputs fr this evaluatin are: Inceptin reprt including: Evaluatin matrix with key questins, indicatrs and means f verificatin Detailed infrmatin n evaluatin methds and tls t be used Evaluatin wrk plan Aide memire f evaluatin missin Draft and final evaluatin reprt with executive summary that can be used as stand-alne dcument Tw-page evaluatin brief Recmmendatins/ management respnse matrix (fr UNDP, UNV, UNAIDS and the the prject management). 8. MANAGEMENT OF THE EVALUATION The verall respnsibility fr managing the evaluatin will be with the UNV cuntry ffice. It will ensure clse cllabratin with ther UNV stakehlders including HQ. The invlvement f majr stakehlders at the cuntry level (including UNDP, gvernment and thers) shuld be ensured and maintained thrughut the entire evaluatin prcess. 9. REQUIREMENTS The assignment will be cntracted t a cnsultant team with experience in the substantive area and knwledge f vlunteerism. The cnsultant team will include ne internatinal and ne natinal (Vietnamese natinal) cnsultant. The internatinal cnsultant will pssess: University degree at the pst-graduate level in the scial sciences, develpment, management r ther relevant field f study 7 years wrk experience f which at least three in a develping cuntry Prven track recrd and experience in evaluating develpment interventins Knwledge and experience f vlunteerism with its diverse manifestatins and cultural settings Excellent analytical and reprt writing skills Excellent peple and cmmunicatin skills Fluency in English The natinal cnsultant will pssess: University degree in the scial sciences, develpment, management r ther relevant field f study 7 years wrk experience Prven track recrd and experience in evaluating develpment interventins Knwledge and experience f vlunteerism with its diverse manifestatins and cultural settings Excellent analytical skills Excellent peple and cmmunicatin skills, especially in a cmmunity setting Demnstrated ability t effectively interprete and translate between bth Vietnamese and English 8

9 10. ANNEXES Appendix 2: List f dcuments cnsulted Prject feasibility study 2004 Prject basic dcument Prject Mid- term evaluatin ( 2008) Prject field mnitring reprts Explratry Research Using GIPA Apprach in Can Th Prvince FHI (Feb 2004): Vu Sng Ha, MD, MSc; Vu Ngc Ba, MD, MPH; Lai Kim Anh, MD; Nguyen Danh Lam, MD Psitive Perspectives: A participatry research with PLHA Australian Red Crss & Vietnam Red Crss (Dec 2003) Directive f the Prime Minister n Strengthening HIV/AIDS Preventin and Cntrl The Gvernment f the Scialist Republic f Vietnam Natinal Strategy n HIV/AIDS Preventin and Cntrl in Vietnam fr the perid with a visin t 2020 Draft 5 Natinal Cmmittee fr AIDS, Drug, Prstitutin Preventin and Cntrl Supprt fr the invlvement f Peple Living with HIV/AIDS in Viet Nam: A case study n the situatin and needs f PLHAs in Ha Ni; Prpsal fr crdinatin and plan f supprt (first draft) WHO; Anng Bnchuey Mving Frward: Operatinalising GIPA in Vietnam; Final Study reprt, Octber 2003 CARE/POLICY A Cultural Apprach t HIV/AIDS Preventin and Care: H Chi Minh City, Quang Ninh Prvince UNESCO/UNAIDS GIPA Initiative in Suth Asia Reprt UNDP Situatinal Analysis f Care and Prtectin fr Children Infected and Affected by HIV in H Chi Minh City (Final Draft, May 2002) Vietnam s Prpsal t the Glbal Fund t Fight AIDS, TB and Malaria The Gvernment f the Scialist Republic f Vietnam (Apr 2002) 9

10 Decisin f the Prime Minister n Apprval f the Natinal Strategy n HIV/AIDS Preventin and Cntrl in Viet Nam up t 2010 with a Visin t 2002 The Gvernment f the Scialist Republic f Vietnam (Mar 2004) The Sciecnmic Impact f HIV/AIDS in the Scialist Republic f Viet Nam (June 2003) POLICY Prject Literature review: Challenging Stigma and Discriminatin in Sutheast Asia: Past Successes and Future Pririties Janna Busza, MSc. (Ppulatin Cuncil, Hrizns) HIV/AIDS-related Stigma and Discriminatin: A Cnceptual Framewrk and an Agenda fr Actin Richard Parker and Peter Aggletn with Kathy Attawell, Julie Pulerwitz, and Lisanne Brwn (Ppulatin Cuncil, Hrizns) Internatinal Law, Natinal Plicy and Legislatin fr the Preventin f HIV/AIDS and Prtectin f Human Rights f Peple Living with HIV/AIDS in Vietnam (Final Reprt, Nvember 2003) H Chi Minh Natinal Plitical Academy/CARE Internatinal supprted by USAID thrugh POLICY Prject 10

11 11