Implementation of ITB Tracer Study: Process and Progress

Transcription

1 Implementation of ITB Tracer Study: Process and Progress Bambang Setia Budi 1 and Angga Dinan A 2,* 1 Director of ITB Career Center, Office of Student Affairs, Institute Technology of Bandung 2 Head of Tracer Study Division, ITB Career Center, Office of Student Affairs, Institute Technology of Bandung * bambang@ar.itb.ac.id and tracer@pusat.itb.ac.id Abstract. This paper aims to explain the process and progress of the implementation of ITB Tracer Study. Tracer Study is a study concerning the alumni of a higher education institution. Tracer Study can provide much beneficial information for the evaluation of the results of higher education. It can be used to ensure the quality of higher education institution. Tracer Study is also useful in providing valuable information for development of the university. Moreover Tracer Study can evaluate the relevance between higher education and working life, contribute to the accreditation process, and inform students, parents, lecturers and administrators. For this reason, Tracer Study in ITB was held by ITB Career Center every year for all study program (PRODI) since The response rates always increase until now, 50% in 2012, 72% in 2013, 80% in 2014, 92% in 2015 and 93% in 2016, respectively. ITB Career Center always attempt to provide continuous improvements in every step/stage/aspects in the implementation: infrastructure, facilities, system, methodology, communication, publication, etc. This paper will try to explain in detail the method of data collecting, concept and strategy of approaching, data analyzing and reporting in the implementation of ITB Tracer Study. The analysis tools used in this research are JMP7, XLSTAT and StatPlus. Keywords: ITB Tracer Study, methodology, implementation, process, progress. PACS: Rr INTRODUCTION One indicator of a good education system was the system used to measure the output quality of education itself. Things that can be measured to determine the quality of alumni are competence, distribution problems faced, user response, acceleration career, as well as other things that includes both harmony and disharmony between the qualities of the alumni with the quality expected by universities. Tracer Study is a study concerning the alumni of a higher education institution. Tracer Study can provide much beneficial information for the evaluation of the results of higher education. It can be used to ensure the quality of higher education institution. Tracer Study is also useful in providing valuable information for development of the university. Moreover Tracer Study can evaluate the relevance between higher education and working life, contribute to the accreditation process, and inform students, parents, lecturers and administrators [2]. Tracer Study in ITB was held by ITB Career Center every year for all study programs (PRODI) since The response rates always increase until now, 50% in 2012, 72% in 2013, 80% in 2014, 92% in 2015 and 93% in 2016, respectively. ITB Career Center always attempt to provide continuous improvements in every step/stage/aspects in the implementation: infrastructure, facilities, system, methodology, communication, publication, etc. The process and progress of the implementation of ITB Tracer Study will explain in detail in this paper. METHOD OF DATA COLLECTING Data collection methods in tracer studies are census. This method was used because the target respondent was varies and the data provide from them was not homogeneous. Based on this fact, ITB held Tracer Study using census method. This method was supported with another technique, it was called surveyor role, used by ITB Tracer Study to validate the database of their respondent. The validated database was important in achieving the good response rate [6]. Complete and update database ( and HP number) Ask and motivated their classmates to fill in questionnaire Roles of Surveyor Give explanation about Tracer Study to their classmates Coordinate regularly with Tracer Study ITB Secretariat FIGURE 1. Roles of Surveyor [7].

2 The roles of surveyor were proved to be important in ITB Tracer Study. It can be seen since 2012, the surveyor improving the response rate achieved from 50% in 2012 into 93% in % 80% 60% 40% 20% 0% 50% ) 72% 80% 92% 93% ) complete ) ) not complete ) FIGURE 2. Response Rates Achieved in ITB Tracer Study Implementation. ITB Tracer Study implementation start with the making of work plan and gather alumni database from ITB General Directory of Higher Education (Dirdik ITB) and all study programs (PRODI) as a first step. The database then given to surveyors to be validated, particularly s and contact number. Once complete, ITB Tracer Study Division will start to send s requesting alumni to fill in the questionnaires. Alumni given time at least about 3 month for fill in the questionnaires. Data gained from alumni was saved in ITB Tracer Study server for analyzed and report. CONCEPT AND STRATEGY OF APPROACHING Tracer Study implementation mostly has been conducted in various universities in the world, in Indonesia particularly, by using cohort as target respondents. Currently response rate by 50% was said to be good, but this number was only depict half of respondents/alumni characteristics and profile [3]. Based on this issue, Institute Technology of Bandung (ITB) as one of the Tracer Study operator seeks to solve this problem of improving response rate. One of steps undertaken by ITB was to use entry class for their target respondent. In Indonesia Tracer Study, General Director of Higher Education (DIKTI), in 2011 presented by Mrs. Illah Sailah, said that the best time for held Tracer Study is 1-3 years after graduation. The main reason for this is because the 1-3 years was the best time to know the fresh graduate assessment for the higher education institution [8]. Planning and Preparation Phase Planning Phase Creation of work plan Creation of questionnaire Request alumni database fraom ITB Dirdik and departments Preparation Phase Questionnaire system trial Surveyor selection and request Improvement of alumni database by surveyors Upload alumni database to system Report Phase ITB Tracer Study Execution Phase Month 1 Month 2 Month 3 Phase I surveyor meeting Report book creation Socialization of ITB Tracer Study results Report book distribution Phase II surveyor meeting Questionnaire Closing and Data Analysis Phase ITB Tracer Study questionnaire closing announcement Data processing Data analysis Phase III surveyor meeting SMS blast starting from week 2 until week 4 Contact via Telephone in the last week FIGURE 3. Phase in ITB Tracer Study Implementation [1]. FIGURE 4. Best Time Held Tracer Study (developed from INCHER-Schomburg) [9]. In Tracer Study, the different between entry class and cohort approach is the range used in determined the respondent graduation. Basic concept in entry class approach is determined by the entry year the alumni/respondent entered the university. The range used in entry class approach is 1-3 years meanwhile in cohort the range used is 1-12 month. Basically, entry class approach in Tracer Study was one of innovation developed by ITB. One main reason in developing innovation of ITB Tracer Study was referred to the culture of Indonesia [4]. Regarding to this, ITB Tracer Study constructed in structural and cultural concept and also formal and informal approach. Structural and cultural mean Tracer Study conducted referred to the International/National Tracer Study s Guideline and also strongly pay attention and take advantage of the prevailing culture and tradition (Indonesia, and ITB/ITB alumni especially).

3 Meanwhile, formal and informal mean that Tracer Study conducted not only in conformance with generally accepted standard of Tracer Study but also using relationship: kinship, brotherhood, friendship and intimacy [5]. FIGURE 6. Entry Concept [5]. DATA ANALYZING AND REPORTING FIGURE 5. ITB Tracer Study Concept and Approach [4]. In entry class approach, supposedly Tracer Study conducted in 2016 then the target respondent picked was the class of We can see that the class of 2009 in ITB graduated in 2013 if they on time. The delayed time for ITB graduates generally between 1-2 years. Alumni who graduates 3 year after were rarely and almost never happened. In fact, the deadline for ITB students in study was maximum 6 years. Tracer Study can give a lot of data feedback from alumni for university. The data itself are varies and can be presented based on university needs. In ITB Tracer Study, data given are analyzed using software tools, which are JMP7, XLSTAT and StatPlus. Generally, techniques used in data analyzed are ANOVA, multivariate analysis, principal component analysis, cluster, correspondence analysis, etc. The result from analyzed the data was usually report in histogram, box plot, radar, or comparison table. Current Occupation of ITB Physics Alumni 4 5% 43 48% 40 44% 3 3% working not working/continuing studies work and entrepreneur entrepreneurship Rp15,000,000 Rp10,000,000 Rp8,702,068 Rp7,000,000 Rp8,415,875 Rp6,500,000 Rp14,160,386 Rp5,000,000 Rp5,000,000 Rp0 working (1636) work and entrepreneur (124) entrepreneurship (184) Income Mean Income Median FIGURE 7. Data Result from ITB Tracer Study (i).

4 knowledge in the field ability for life long learning ability to write a report knowledge outside the field general knowledge ability to present an idea project / program management initiative responsibility leadership internet skills computer skills critical thinking research skills learning ability work with people from differs communication ability loyalty and integrity ability to adapt tolerance analysis ability negotiation alumni competence ability to work under pressure time management ability to work independently ability to work in a team problem solving ability university contribution library information and communication technologies learning modules study rooms laboratories variation of lectures offered accomodation canteen student affairs center with its facilities and a recreation room healthcare facilities ITB Facilities Condition Box Mean line Mild outliers FIGURE 8. Data Result from ITB Tracer Study (ii). Data gained from Tracer Study basically give information related to alumni, higher education institution and industry. Detailed information obtained will be regarding alumni condition: current alumni occupation, suitability between field of study and job, length for getting 1 st job, income, job category, alumni assessment to their higher education institution including the facilities and also alumni competencies related to higher education institution contribution and the benefit to current alumni job. All of this information could be provide by Tracer Study every time it held. ITB Tracer Study has proven to provide many benefits in ITB development as higher education institution. This proved with the facts that many PRODI in ITB use ITB Tracer Study data as their reference in obtaining accreditation. In ITB Tracer Study, data result mostly presented in histogram/pie chart and box plot. Histogram/pie chart and box plot are simple graph that is considered capable of providing information even for people who not accustomed with statistic. Data analysis in ITB Tracer Study basically reported publicly so regarding information mostly presented in general. Detailed in

5 data analysis usually carried out by PRODI or if there is a request from ITB itself. ITB Tracer Study Division reported the data analysis result in an own design book of report. This book not contained report only but also some information about Tracer Study in general, especially in ITB. The book every year was given to all ITB lecturers and stakeholders and also given free to 3 rd party who need information on how Tracer Study should be held. TABLE 1. Example for Comparison Table Used in ITB Tracer Study Analyzed. This is the Comparison between Alumni Current Occupation with their GPA. Current Occupation N Mean Std Dev Min Median Max Working Work and entrepreneur Not working/ continuing studies Entrepreneurship REFERENCES 1. Aji, Nurul Apsari., Bambang Setia Budi., Angga Dinan A. Progress and Development of Tracer Study ITB. Poster Session presented at international conference EXLIMA 2015 on November Bali- 2. Budi, Bambang Setia., Angga Dinan A. Report Tracer Study ITB Angkatan Penerbit ITB. Bandung- 3. Budi, Bambang Setia. Tracer Study: Urgency, Problem, and How to Increase Response Rate. Presentation in Training for Tracer Study Team of UNPAD at WISMA UNPAD CIMANDIRI on Monday, 3 November Bandung Budi, Bambang Setia., Angga Dinan A. Innovation and Implementation: ITB Tracer Study ( ). Paper presented at international conference EXLIMA 2015 on November Bali- 5. Dinan A, Angga., Bambang Setia Budi., Sandro Mihradi dan Brian Yuliarto. Pros & Cons of Target Responden: between Cohort and Entry of Cohort in ITB Tracer Study. Paper discussion at international conference EXLIMA 2015 on November Bali- 6. Nursyahbani, Awalia., Bambang Setia Budi., Angga Dinan A. How to Increase Response Rate: ITB Tracer Study Experience. Poster Session presented at international conference EXLIMA 2015 on November Bali- 7. Nursyahbani, Awalia., Bambang Setia Budi., Angga Dinan A. The Roles of Surveyors in the Implementation of Tracer Study ITB. Poster Session presented at international conference EXLIMA 2015 on November Bali- 8. Sailah, Illah. Perlunya Tracer Study untuk Pendidikan Tinggi. Guideline Tracer Study in Indonesia. Jakarta (Direktur Pembelajaran & Kemahasiswaan Ditjen Dikti) Schomburg, Harald. Handout for Graduate Tracer Studies. International Centre for Higher Education Research (INCHER-Kassel) University Kassel. Germany