Monitoring the quality of experience in daily life: Experience Sampling Method on mobile phones

Transcription

1 Monitoring the quality of experience in daily life: Experience Sampling Method on mobile phones Alessandra Preziosa, Marta Bassi, Daniela Villani, Andrea Gaggioli Summary What s Experience Sampling Method (ESM)? ESM and Technology The study Results Conclusions

2 What is ESM? It s one of the first and most widely-used on line procedures Provides on-line repeated sampling of partecipants subjective experience during real life Its psychometric properties have been tested It has been extensively validated Its intrusiveness has been reported to be low It has been applied in various studies Sampling Schedules EXPERIENCE SAMPLING PROCEDURES Tools Duration Set of variables Number of observations

3 Paper & Pencil TOOLS ESM and Technology Computerized (Palmtop computer, PDA) Web Assessment Voice Recorder Advantages and limits MOBILE PHONE PROTOCOL Sampling Schedule: signal-contingent sampling Duration: week Number of observations: eight times each day (from 8 a.m to p.m) Tools: paper & pencil and mobile phone Set of variables: Enviromental variables: open-ended questions Activities; Places; Companions Experiential variables: point scales Challenge/Skill; Affect; Motivation; Cognition

4 STUDY The study assesses the usability of the ESM implementation on mobile phones as compared to the original ESM protocol Development and Technical Requirement Benchmarking on the technologies available in mobiledevelopment field The software that allows to reproduce files on mobile phones is Flash Lite.

5 Sample Twelve adult participants aged between and (M=.; sd=,8), males and females 7 observations Procedures All respondents are tested in two sessions with a version of the ESM based on Paper & Pencil with a version of the ESM implemented on 8 Nokia mobile phones (display resolution:7x) Measures: ESM Questionnaire for User Interface Satisfaction (Italian version) Structured interview Results Response frequency 7,7,9 No significant difference in response frequency between session (p&p) and session (mobile phone) (Chi square=9.7; p<.) delay in time response Significant difference in response delay: higher mean value in mobile phone session (T-test=-.7; p<.),,9

6 No significant differences in time-budget distribution between the two sessions Time-budget distribution Study Work Housework Interactions Structured Leisure Other Leisure Other Leisure Media Thinking Maintenance Transportations Transportation Miscellaneous Miscellaneous P&P Mobile p. (Chi square=8.89; p<.) No significant differences in quality of experience between the two sessions Variables P&P Mobile Phone t Value Tools Concentration * Control Happy. -.. Involvement. -.. Free Satisfaction * p <.

7 Experience Fluctuation Model (EFM) Channel OPTIMAL EXPERIENCE Delle Fave, A., Massimini, F. (), Investigation of Optimal Experience and Aphaty, European Psychologist ; Vol. (): 7 No significant differences between session and session for quality of experience in channels Variables Tools Concentration OPTIMAL EXPERIENCE P&P.9 Mobile Phone. t Value. * Control..8. Happy Involvement Free... Satisfaction * p <

8 Comfort & Forgetfulness Structured interview p&p:comfort p&p: forgetfulness never sometime frequently often always Mobile phone:comfort Mobile phone: forgetfulness never sometime frequently often always Point Scales: clarity & easiness Structured interview p&p: clarity p&p: easiness Mobile phone: clarity Mobile phone:easiness 9 8

9 Open-ended questions: clarity & easiness Structured interview p&p: clarity p&p: easiness Mobile phone: clarity Mobile phone:easiness Users satisfaction Questionnaire for User Interface Satisfaction 8 7, 7,,,8 Overall user reactions Screen Terminology and system information Learning System Capabilities 9

10 Conclusions No significant differences were found in time-budget distribution between p&p session and mobile phone session No significant differences were found in fluctuation of daily experience between the assessment done by p&p tool and mobile phone tool The study confirms the usability of ESM implemented on mobile phones Opportunities Use of both open-ended and Likert scale questions Control in subjects compliance and immediate feedback Wireless Network Data transferred directly into a statistic package and Limits Mobile phones must support Flash Lite software Training for using the software Connection problems Data security and integrity

11 References M. Csikszentmihalyi, J. Hektner, & J. Schmidt (). Measuring the quality of everyday life. The ESM Handbook. New York: Sage. Barrett, D. J. & Feldman Barrett, L. (). An Introduction to Computerized Experience Sampling in Psychology, Social Science Computer Review, Vol. 9 No., Summer 7-8. Chen, H. (), Digitalized Experience Sampling Method: Transformation, Implementation, and Assessment Henderson, T., Anthony, D. & Kotz, D. (). Measuring wireless network usage with the Experience Sampling Method, In Proceedings of the First Workshop on Wireless Network Measurements (WiNMee), April. Collins, R. L., Kashdan, T. B. & Gollnisch, G. (). The Feasibility of Using Cellular Phones to Collect Ecological Momentary Assessment Data: Application to Alcohol Consumption, Experimental and Clinical Psychopharmacology, Vol., N., Chin, J.P., Diehl, V.A. & Norman, K.L. (988). Development of an Instrument Measuring User Satisfaction of the Human-computer Interface. ACM CHI 88 Proceedings. -8. Thanks for the attention Alessandra Preziosa a.preziosa@auxologico.it