Supplementary Material. DAYA: A System for Monitoring and. Enhancing Children s Oral Hygiene. Table Of Contents. About Team.

Transcription

1 Supplementary Material DAYA: A System for Monitoring and Enhancing Children s Oral Hygiene Table Of Contents About Team Contextual Data Design Inspiration Evaluation Data

2 About Team Kejia Shao Master of Science in Information, University of Michigan, Ann Arbor, MI, U.S. Bachelor of Science in Psychology, Fudan University, Shanghai, China Jiye Huang Master of Science in Information, University of Michigan, Ann Arbor, MI, U.S. Bachelor of Arts in Advertising, Fudan University, Shanghai, China Huaying Song Master of Science in Information, University of Michigan, Ann Arbor, MI, U.S. Bachelor of Management in Archival Science, Renmin University of China, Beijing, China Runze Li Master of Science in Information, Master of Applied Economics, University of Michigan, Ann Arbor, MI, U.S. Bachelor of Science in Economics, George Mason University, Fairfax, VA, U.S. Jinxi Wu Master of Science in Information, University of Michigan, Ann Arbor, MI, U.S. Bachelor of Science in Economics, Xiamen University, Xiamen, China

3 Contextual Data We've reviewed 173 papers, watched a decent number of related videos, went through relevant patents, products and survived from those disgusting pictures of dental caries. Literature Reviews Drawing-telling Technique Interview Survey Observation

4 Contextual Data We asked the kids aged from 5 to 8 to express their thoughts at their preference. At last we collected 32 pieces of drawing in total. Literature Reviews Drawing-telling Technique Interview Survey Observation We asked them to imagine how they would feel if they were a tooth in these situations: toothbrushing, dental visits, eating candies. These kids, although still dependent on a story to open their mind, showed amazing creativeness and extraordinary drawing skills in expressing themselves.

5 Contextual Data These interviews provided evidence of parents concerns on children s dental health and the lack of effective oral hygiene education children receive. These findings helped us push forward further researches on these topics. Literature Reviews Drawing-telling Technique Interview Survey Observation Interview a kid at kindergarten Interview interpretation Interview a mom at home Interview interpretation

6 Contextual Data We conducted a survey among parents of 5-12 year olds, and 262 valid questionnaires were collected. Among these parent participants, we surveyed 50 children (mean age = 11.17) of them to compare the answers on the same questions. Yes, we are cunning but we were quite excited to see the discrepancy. Literature Reviews Drawing-telling Technique Interview Survey Observation Descriptive analysis Chi-square test and T test Paper questionaire for kids Online questionaire for parents

7 Contextual Data To further understand oral hygiene behaviors among children, we observed 27 children aged from 5 to 12(15 at home, 12 at kindergarten) brushing their teeth. Children at home were instructed to brush as usual. Kindergarten children brushed their teeth under regular instructions of their teachers. Literature Reviews Drawing-telling Technique Interview Survey Observation

8 Contextual Data Observation Interpretation Literature Reviews Drawing-telling Technique Interview Survey Observation 1. Childrens toothbrushing skills are related to their physical growth. The older children are, the easier for us to detect their patterns in brushing. And they are more aware of that there are some areas where they need to spend more time brushing. They are also more skilled in brushing. (One 10-year-old boy performs as good as adult in brushing). Younger children, however, are less conscious. They cover most areas of teeth but are less proficient than older children. More time is required for them to turn patterns of brushing into habits. Besides, strange postures are observed for these younger kids, especially the hold-penlike posture. 2. Kindergarten children have trouble in controlling toothbrush. They are are taught to brush vertically but are relatively slow when asked to so, which costs them almost 1 second to complete an stroke. It is their instinct to brush horizontally. 3. Most of children we observed spend limit time on brushing chewing surfaces in the upper right area. Few would cover the back surface of teeth. 4. Most children brush teeth below 2 minutes, the recommended time duration. Some of them spend more time gargling than brushing. 5. Toothbrushing skills vary from child to child. Skilled and unskilled are intermingled. Some kids are able to use both hand while brushing and some kids perform advanced skills. Even for children at the same age, difference in skills is significant. 6. Not all children brush their teeth in front of a mirror. Most of children use toothpaste in brushing and no one is found brushing without toothpaste. 7. Most children reveal positive emotions when they are brushing, which can be affected by parents and teacher s attitude. If parents think brushing casually is enough, their children are likely to brush as instructed. 8. Girls tend to brush their teeth more carefully than boys do. 9. It is hard to imagine what kind of interaction attracts children. A boy and a girl brush teeth together and compete on the speed of shaking head....

9 Design Inspiration We downloaded and experienced the top 30 applications under the fitness category of Apple App Store, as well as almost all the existing apps related to dental health. Fitness Monitor App Game Design Mirror Display Toothbrush Beam Brush Fitbit Jawbone Almost all the dental applications

10 Design Inspiration We bought a Jawbone, a Fitbit and a Pebble to experience their apps. Calm down, we are not asking for reinbursement :) Fitness Monitor App Game Design Mirror Display Toothbrush

11 Design Inspiration We found that Tower Defense is one of our target children's favorite game types. Our game design was inspired by several existing ipad games that use the concepts of routes in their design. Fitness Monitor App Game Design Mirror Display Toothbrush Kingdom Rush Wood Puzzle Maze HD Wooden Labyrinth 3D Carrot Fantasy

12 Design Inspiration We referred to a couple of serious games developed in academic fields. Fitness Monitor App Game Design Mirror Display Toothbrush One research has associated toothbrushing with a virtual aquarium on a screen in the place of a mirror. When users brush their teeth in a low frequency or for an insufficient amount of time, the aquarium turns dirty and the fish living in it become sick. Otherwise, the fish will prosper. Increased toothbrushing time is reported. In another game called Playful Toothbrush, kindergarten children are instructed to clean a cartoon picture of their dirty teeth displayed on a screen by physically brushing their own teeth. These children demonstrated significant Improvement in brushing time, coverage, and number of brushing strokes after playing the game for five days.

13 Design Inspiration Fitness Monitor App Game Design Mirror Display AwareMirror allows users to read the news and play games on the mirror while brushing teeth. A similar product, Cyberstructure, enables users to track health statuses and read social network feeds on ordinary mirrors. Toothbrush AwareMirror Cyberstructure Cyberstructure

14 Design Inspiration Fitness Monitor App Game Design Mirror Display Toothbrush From Vectorstock Pinyayev, Aleksey Mikhailovich, et al. U.S. Patent No. 8,214,958 Nikhil Shankarlal Vashi US A1 Ben Crossley

15 Those ephemeral sparkles in our mind

16 Scenario 1 Jasmine is a 5-year-old girl. She has just learned to brush her teeth by herself. But she doesn t understand why she should brush her teeth and always finds it boring. She never follows the right brushing process. Neither can she keep brushing for more than 2 minutes. This morning she gets a new toothbrush. The moment she picks up her brush, the mirror turns into a touch-screen displaying an interactive game called Forest Legend. She s curious about it and decides to follow the instructions to see what will happen. She picks a cute character and taps on the Start button. Since this is the first time she plays, a tutorial begins automatically. She just follows what the animation tutorial tells her and quickly understands how to play the game through brushing her teeth. Then the real game starts. At first she finds it a little bit challenging because she forgets the right brushing movement or area, and thus misses shooting monsters for several times and loses points. But thanks to the hints in the lower right corner she can learn the correct response again. With the help of hints, she brushes every area of her teeth and finishes her first quest with a fair score. It counts a good start and she s motivated to perform better next time. Now brushing teeth becomes something more fun and meaningful to her. Scenario 2 Jeremy is a 10-year-old boy. It s the 24th day that he plays the game Forest Legend while brushing his teeth. This teeth brushing game has now become his daily routine. He has earned the title of Combo Master in this game, which means he combos all the monster waves by brushing teeth with the correct movements continuously in every area for sufficient time. Today he just received a very rare seven-star badge after continuously occupying No.1 in the Top Hits for 7 days. He s going to show it off to his classmates tomorrow. He feels a sense of accomplishment in both playing the game and brushing his teeth, as he has never thought before that brushing his teeth could bring him so much fun and also some fame among his peers. His next goal is to become the champion of the month and earn the badge of this month and the awarding equipment. Scenario 3 Tommy, a 7-year-old boy, received the Forest Legend game and toothbrush last month as a birthday present from his parents. But he seems never interested in

17 the game from the beginning. After missing several monsters and losing points because he didn t follow the tutorial, he gave up, disregarding the game and brushing his teeth casually as he always did. Unlike other kids in his class, he cares nothing about the equipment and the ranking of that game. Neither will he be motivated to collect the monsters in the monster manual that many of his peers get crazy about. The toothbrush seems no difference from an ordinary one to him. But it actually makes some difference to his parents. The toothbrush records Tommy s poor performance everyday and transmits the data to the app, Mr. Beaver, on his mother s smartphone. The data shows that compared with Tommy s peers, the time spent on brushing teeth, the area covered and the overall performance are all below the average level. Today Tommy s mother receives a notification that the brush has detected a possible cavity in the upper left area of his teeth. She s seriously aware that it s time to take some actions. She will have to bring Tommy to a dentist first. Later she needs to find out how to motivate her son to brush his teeth. Scenario 4 Kate is a mother of 7-year-old twins, Anne and Alice. She herself had 3 cavities before and suffered a lot from the pain. As a result, she is quite concerned with her children s oral health and hopes to protect them from tooth decay. She uses Mr. Beaver, an app on her iphone, to monitor their teeth health. It s already 10 p.m. and as usual she checks Mr. Beaver on her phone before going to bed. An icon of notification shows on Alice s avatar. Kate taps on it and finds that Alice hasn t brushed her teeth yet. Usually she should have finished it before 9:30 p.m.. Kate goes into the twins room and asks Alice to brush her teeth. While Alice is brushing her teeth, Kate checks Anne s data. Anne s summary is as good as usual, so she doesn t have to worry. Several minutes later, Alice s data comes in. Her summary in the dashboard also shows a good performance today. Kate is content with that. She powers off the phone and goes to bed happily. Scenario 5 Mr. and Mrs. Black recently bought their 9-year-old son a toothbrush with a sensor, which can record and transmit their son s teeth related data to a mobile app called Mr. Beaver. They also equip in their bathroom a touch screen mirror that will display the interactive game Forest Legend, which can be played while their son is brushing his teeth with the new toothbrush. They hope

18 that the game will motivate their son to brush his teeth, and the sensor and the app can keep them aware of their son s teeth health. Their son hasn t formed a good habit of brushing his teeth and has already got a cavity, which makes the couple feel so worried. That s why they want to try out Mr. Beaver and Forest Legend. To their delight, they find that their son s records shown in the summary of Mr. Beaver are turning better every day. The husband is very surprised today when he sees that their son spends more time on brushing teeth this morning than average, for the first time. And the area covered is 80%, a peak number since they began using this app. He taps on the area covered and goes into details. A plan of teeth shows on the screen and the teeth are divided into 6 areas. He taps on the upper right area, where the cavity locates and insufficient brushing is always detected, to check the details. It still shows insufficient brushing, but the time spent here is quite close to the average. Mr. Black is very content and decides to give some encouragement to his son. Mr. Black praises his son first and reminds him to spend more time brushing the upper right area. The dad also promises the son to buy his favorite toy if he keeps brushing all areas for sufficient time and ranks top 1000 in the game Forest Legend. The son is so motivated and decides to perform better in brushing his teeth. In the next few days, Mr. and Mrs. Black find that their son is indeed doing better than the average in both brushing time and area covered. They feel so lucky that they try out the app and interactive game and decide to keep using them.

19 Storyboard

20 Storyboard

21 of the Toothbrush Game - Start Screen (Chinese Version)

22 of the Toothbrush Game - Start Screen (English Version)

23 of the Toothbrush Game - Map

24 of the Toothbrush Game - Examples of Monsters

25 of the Toothbrush Game - Elements for Wizard of Oz 在 开始 的背面写上大大的 准备

26 of the Monitoring Mobile App

27 of the Toothbrush Detachable Laser diode Detachable Photo diode Three-axis accelerometer Magnetic sensor Memory Bluetooth Button battery

28 of the Toothbrush Game - Start Screen

29 of the Toothbrush Game - Map

30 of the Toothbrush Game - Simulated Scenario

31 of the Monitoring Mobile App - Add a Profile

32 of the Monitoring Mobile App - Add a Profile

33 of the Monitoring Mobile App - View Dashboard

34 of the Monitoring Mobile App - View Dashboard

35 of the Monitoring Mobile App - View Dashboard

36 of the Monitoring Mobile App - View Details by Region

37 of the Monitoring Mobile App - View Menu

38 of the Monitoring Mobile App - View Settings

39 of the Monitoring Mobile App - View Oral Log

40 Evaluation Data We conducted usability tests on low-fidelity prototypes of the tooth brushing game with 16 children(aged 6 to 10) using Wizard of Oz technique. When the children played the game, their enjoyment and positive feedbacks really encouraged us greatly. Wizard of Oz Heuristic Evaluation

41 Evaluation Data Examples of Notes From Usability Test Wizard of Oz Heuristic Evaluation

42 Evaluation Data We conducted an internal heuristic evaluation to examine the usability of our app for parents. Wizard of Oz Heuristic Evaluation yy kj xxx 1. Visibility of system status 问题 1:summary 部分三个 item 的形式是一样的但是只有 area coverd 可以点开 最好能给用户提示 2. Match between system and the real world 问题 1: 语言稍微有点别扭 3. User control and freedom 问题 1: 刷牙覆盖区域和牙齿日志界面下拉菜单的按钮不能点 严重性 :3. 较小的问题, 但是最好能修正 严重性 :2. 锦上添花 严重性 :4 要修正 问题 2: 返回主界面的 问题 2: 刷牙方式评分 问题 2: 点开下拉菜单 选项藏在那一堆里面, 最好能说明怎么错了以后最好能点击旁边位置 单独挪出来是不是更容及正确的应该是什么, 就收起来, 现在必须点 易找到, 也可以减少一要不然有点 在菜单按钮上才能收起 个步骤 tricky 来 严重性 :3. 较小的问题, 但是最好能修正 严重性 :3. 最好修正 严重性 :3 最好修正问题 3: area covered 点完确定以后直接回主界面了 用户可能还要看别的区域, 所以应该留在 area covered 这里吧 严重性 :4 要修正 ( 严重性 3) 不清楚 summary 是日还是周还是全部的 summary ( 严重性 3) 返回首页功能在哪里 ( 严重性 3) 切换小孩界面的标题是 Mr. Beaver, 建议加一个副标题表明是选择小孩 ( 严重性 4) 没有 返回 键, 如 Add Profile 页,Area Covered 页 ( 严重性 2) methodology 不是说改成 performance 吗? ( 严重性 3)used (a) wrong way to brush 建议修改, 感觉语言有点激烈 ( 严重性 3) Remind John to brush his teeth before going to bed 建议加上 please ( 严重性 4) 牙齿 detail 里点击 OK 之后应该是继续停留在当前页而不是回主界面 ( 严重性 2)Notice 不能同时打开 = = 4. Consistency and standards ( 严重性 2) 我也不知道诶就是觉得 add profile 那页的 icon 和第一页是一样的, 会有种点了的话会新开一个空白 profile 的错觉, 而不是点了就可以加上一个小孩 ( 严重性 1) 好像感觉点左上角的 menu 的话,menu 应该是从左边侧滑进来的, 而不是拉下来的? ( 严重性 2) 第六页 4 seconds 的 4 是否也要和下面的数字一样进行强调? ( 严重性 3)Emily 头像上的绿色勾代表什么? 是当前选择的意思? ( 严重性 2)Area Covered 中的 upperback teeth 加粗的话 2 sec 最好也加粗 5. Error prevention ( 严重性 2) 我们需不需要考虑一下 Notification 如何解除? 如, 刷了牙之后提醒自动消失还是有其他的方式解除提醒 6. Recognition rather than recall 7. Flexibility and efficiency of use 好像没办法也没必要 tailor? 8. Aesthetic and minimalist design ( 严重性 4) 应该可以定每周几提醒, 几点提醒, 用 badge 还是 ( 严重性 1) 我觉得第 sound 还是 notification 六页的条形图的灰色 all 提醒之类的吧? 还有 area 说明可以不用, 然 bristle 提醒的频率之类后蓝色可以改名叫的 coverage ( 严重性 2)age 好像是给用户 iphone 的时间控件比较容易? 一个是不用想小孩几岁了, 一个是这样系统计算年龄也比较方便 除非 外国人不是过生日 +1 岁的, 而是过年 +1 岁? ( 严重性 2) 是否要有一个一键关闭所有提醒? ( 严重性 2) 设置中可以选择声音, 振动等方式提醒 ( 严重性 2)bristle need to be changed 有 ( 严重性 2)Oral Log 点长, 认为可以直接写中的每一天可以点开 change bristle 么? ( 严重性 3) 多语言? ( 严重性 2)Area Covered 的图示是否要把这一周和上一周稍微分区分一下, 使得更好辨识 9. Help users recognize, diag and recover from errors 还没有考虑 erro

43 Evaluation Data Redesign the Area Covered. Merge it into Details By Region. Show more details about specific area right below rather than a pop-up screen. Show the correct brushing method when clicking specific area. Wizard of Oz Heuristic Evaluation

44 Evaluation Data Add more functions to the Settings page. Allow users to customize the notification. Wizard of Oz Heuristic Evaluation

45 Evaluation Data Move the Back to Home button from the drop-down menu to the upper-left corner. Move the menu to the right side. Wizard of Oz Heuristic Evaluation