An assistive application identifying emotional state and executing a methodical healing process for depressive individuals.
|
|
- Piers Willis
- 5 years ago
- Views:
Transcription
1 An assistive application identifying emotional state and executing a methodical healing process for depressive individuals. Bandara G.M.M.B.O bhanukab@gmail.com Godawita B.M.D.T tharu9363@gmail.com Gunathilaka M.D.M.L maheshlak9@gmail.com Dr. Dharshana Kasthurirathna dharshana.k@sliit.lk Abstract In this paper we represent an assistive application identifying emotional state by utilizing various advanced technologies and providing methodical treatments for depressive individuals. is a very common mental disorder which can even lead to suicide [1]. It is acknowledged as a major public health problem by many national governments and international agencies. Fortunately, it is treatable. But most depressed people are unware that they are suffering from depression [2]. Considering all these we have implemented a mobile application to help people overcome depression. Our application uses many advanced techniques such as facial analysis, voice analysis and social media behavior to recognize users emotions and symptoms accurately. This helps to identify users depression, and the treatments are given based on that. User s progress is monitored frequently and activities are assigned according to that. Keywords diagnose, linguistic, emotion, sentiment I. INTRODUCTION is a common and serious medical illness, which can even lead to suicide [1]. According to the World Health Organization (WHO) depression will be the second most important medical disease worldwide by the year 2020 [3]. Though depression is treatable, the problem is that the most people suffering from this are never diagnosed, let alone treated [2]. And it has been a challenge to our healthcare system to connect people with the screening or treatments Maduranga P.S.W.B shashithm@gmail.com because of the obsessive fear and shyness that most people have to consult a psychiatrist. Though there are a few depression aid mobile applications available in the app market, none of them are able to diagnose the user s disorder accurately due to their very poor techniques and methodologies. These applications do not attempt to study user s emotions or track user s status at all. They just offer some basic questionnaires to identify the symptoms of the user and provide some instructions to keep their minds busy. There are many different s of depression. So, it is very important to identify each patient s depression in deciding the right treatment. But those existing applications are just offering same set of instructions to any user regardless of what their condition is. Therefore, these applications do not satisfy or fulfill the expectations of the user in need at all. As there s no control or proper guidance, the user s condition will get worst and worst which even leads to suicide. Considering all these issues, we came up with this mobile solution that effectively support people to overcome depression. It uses many advanced techniques to identify the user s emotions, symptoms and depression accurately. Those advanced techniques are following: Identify the emotions of the user by analyzing his/her facial expressions and diagnose depression by face analysis techniques. Identify the emotions of the user by analyzing his/her vocal expressions and diagnose depression by voice analysis techniques Analyze linguistic features on Twitter statuses of the users and diagnose his/her depression This application also prompts the users to answer a series of standard, recognized questions to identify the symptoms, medical and family history etc. Using all these techniques we will be able to diagnose the depression of the user
2 accurately. According to the depression of each user, this application provides different treatments separately. We are not just giving instructions. We provide simple interesting yet effective recognized activities to help people to combat depression and alleviate their negative moods. We monitor the users progress time to time and those activities are assigned according to that. This application provides guided meditations, positive thinking relaxation music and many other tools to improve mood and behavior of the user. This application has a notification system which reminds the users frequently, about the activities that they should involve to lift their moods. It also focusses in connecting users with their families, friends which is very effective for depressed individuals. This application provides a suicide safety plan to the users who are suffering with suicidal thoughts. II. METHODOLOGY This section discusses about the procedure and technologies that we have used in order to develop the application. The -Aid application is developed as a mobile based application in order to help the user to get the maximum use and high performance based experience in international standards and software development standards A. Facial emotion analysis The human face is the primary tool used for inferring human emotional expressions and intentions, thus it is widely used in healthcare, driver safety, human-computer interaction (HCI), surveillance, and many more new applications. Facial expressions are one of the key means of expressing emotions of a person. Activation of certain specific facial muscles are the foundation for expression of facial emotions. As facial expressions being such important, first step is to identify the user s depression by examining the face of the person and extracting the facial emotions. The user is asked to look at the mobile phones front camera which allows the application to scan through the facial actions from the live facial video and present a real-time result regarding the emotions of the person. Here in this research we have mainly focused in identifying basic emotions which in detail are, disgust, fear, joy, sadness and surprise. Fig. 1. Six basic human expressions [4] As stated above the facial emotion extraction process consists of steps like capturing, processing captured image sequences and provide the emotional s. Initially the system will be prompted with an interface where the front camera of the device is activated and a sequence of users facial images are captured by the system. Then they are undergone the initial process and basic facial features are detected. Then the feature extraction is to realize depression of the user based on a 0-10 scale. Fig. 2. Feature extraction process The above said processes will be developed considering the Facial Action Coding System (FACS) principles and concepts. Based on the result the user will be classified with a depressive. The application is developed using Android, python, and an emotion data library for emotion detection and for live prediction. Furthermore, a data set is being used or trained with the process. To give a much more accuracy a deep learning neural network is implemented to the program, which is like giving eyes to the system. Facial Action Coding System (FACS) is a system to define Facial movements of human by their appearance. Deconstructing each facial expression into Action Units (AU) and temporal segments occurred in that expression gives us the ability to code the most near possible emotion underlying with that expression. AUs are the basic elements for the construction of an expression, they represent minimal facial actions, that are not further separated into more simple actions. The muscle actions and Action Unit (AU) do not agree: in fact, an AU may correspond to the action of one or more of the same muscles and a muscle can be associated with several AUs. Au is, in short, a basic change in appearance of the face, caused by activation of one or more facial muscles. The AUs are divided into groups according to position and/or the type of action involved. First AUs are in the UPPER FACE, and affect the eyebrows, forehead, and eyelids. Then the LOWER FACE AUs are presented in a file groups: Up/Down, Horizontal, Oblique, Orbital, and Miscellaneous. [4]
3 [12] [15] [12] [15] AU 1 Inner Brow Raiser AU 4 Brow lowerer AU 12 Lip corner puller Table 1. Action Units (AU) [13] [16] [13] [16] 100% 100% 87.5% Disgust 37.5% [17] 100% Disgust 87,5% 85,5% 75% Embarrassment 12,5% 37,5% [17] Happy [12] Happy [13] Happy [14] Happy [15] Happy [16] Joy 100% Happy 50% [17] B. Vocal emotion extraction Emotion mentioned as important role in the human life. There are basically six classes that emotions are categorized. They are happiness, anger, fear, disgust, surprise and sadness. Speech-to-text and language modeling techniques are used to analyze emotions from speech. Below the figure 1 simply shows the whole process of the speech emotion recognition used to analyze the depression of the person. The first stage is an emotional speech database is used to get the voice samples which consists of annotated utterances of voice actors. Next, feature extraction is performed by using open source feature extractor. Then, feature selection method is used for decreasing the number of features and selecting only the most relevant ones. Finally, the emotion recognition is performed by a classification algorithm. Fig. 3. Voice analysis process For analyzing emotion from speech we used speech emotional database to train our emotional recognition algorithms. Database used in here is EMO_DB database (Berlin emotional speech database).[5] It is one of the most exploited database for speech emotion recognition. It has recordings of 535 audio files and used 10 actors to record the voice clips. For extract the features we used open smile tool. It is the most accuracy tool for feature extraction and signal processing. For classification algorithms we used support vector machine and linear classification algorithms to classify the different emotional states. It establishes a hyper plane as the decision surface maximizing the margin of separation between negative and positive samples. Finally, through all the emotion speech recognition process we successfully able to diagnose the depression from speech. C. Assess depression through social media behavior As another technique, we use social media to assess depression of the user. Nowadays social media has concurred a greater share of humans life. People tend to express their feelings and emotions freely through social media. In this paper we mainly focus on a most popular social media Twitter. In here, we gather the previously published twitter messages as known as tweets, of the user and analyze sentiments of those tweets that represent the user s state of mind. We gather the tweets using Tweet Rest API. Then the extracted data from the API were trained using a training data set in order to do the semantic analysis. For sentiment analysis, we present a supervised sentiment classification model based on the Naïve Bayes algorithm. Naïve Bayesian Classifier is a probabilistic learning method. It can solve diagnostic and predictive problems. Naïve Bayes classifier are among the most successful known algorithms for learning to classify text documents [6]. It takes less time to train than other classifiers. In here we are going to show how we achieved the accuracy of this model. Naive Bayes theorem provides a way of calculating the posterior probability, P(c x), from P(c), P(x), and P(x c). Naive Bayes classifier assume that the effect of the value of a predictor (x) on a given class (c) is independent of the values of other predictors. This assumption is called class conditional independence [7]. Above, P(c x) is the posterior probability of class (c, target) given predictor (x, attributes). P(c) is the prior probability of class. P(x c) is the likelihood which is the probability of predictor given class. P(x) is the prior probability of predictor.
4 D. Activity suggestion based on the data extracted The activities are one of the major factors which may help to reduce depression, and at the same time that activities may not help to reduce the depression of some other persons. The objective of this component is to identify the activities that help to reduce the depression of a person. The depression of relevant person, can be identified through the application by using Face recognition, Voice recognition and Social media to get current depression and according to the depression, the module will show some list to user and user can add different activities to the list. The application will provide an option to the user to select most favorable activities to and user must have to select more than 3 activities in the list. The application will afford some rate for each selected and it will analyses the depression daily. End of the day the application asks from user What activities? and according to the answers which provided by the user, the application will compare user s previous depression and current depression. If the current depression lower than the previous depression, the application will increase the rate value of that by itself otherwise it will reduce the ratings of that. The above process will be used to select activities for one month and identify the most suitable activities for that person according value of they gain from doing activities. The following tables will show user to understand how to do this process when they select three activities. Note. is calculated by getting the average sadness value of Face recognition, Voice recognition and Social media. Table 2. Activity rate calculation (first day) First Day Activity 1 Activity 2 Activity 3 Start rate New rate CDL Level PDL Previous Level Activity 1 and Activity 3 0 Note. Start rate value 0 is constant for any. Note. 0.5 Constant value for increase rate of activities. Second Day Table 3. Activity rate calculation (second day) Activity 1 Activity 2 Activity 3 Start rate New rate CDL Level PDL Previous Level = 0.3 Activity Note. 0.2 Constant value for decrease rate of activities. Table 4. Activity rate calculation (third day) Third Day Activity 1 Activity 2 Activity 3 Start rate New rate 0.3 CDL Level PDL Previous Level Activity 2 and Activity = 1.0 After one week through the application, user can identify what activities are more suitable to reduce their depression. III. CONCLUSION AND FUTURE WORK This research work demonstrated the implementation of a mobile application to assess and under control the mental depression of a person. This approach overcomes the present issues where the depressive individuals being afraid to attend to a psychiatrist as they try to hide from others, and to keep their issues to themselves thinking about their privacy. In the future work we have planned to increase the effectiveness of feature extraction process to enhance the system to be able to assess people from any country in the world with several appearances, and support more languages.
5 ACKNOWLEDGMENT Application on assessing depression through facial, vocal and social media behavior analysis Research was carried out as our 4 th year research in Sri Lanka Institute of Information Technology. We are extremely grateful to our supervisor Dr. Dharshana Kasthurirathna and our external supervisor Ms. Reka Attidiye, lecturers of Sri Lanka Institute of Information Technology who shared their great knowledge, constant encouragement and support making the pathway for the success of this research. REFERENCES [1] World Health Organization,, Media Centre, February, 2017.[Online].Available: 69/en/ [Accessed: March. 13, 2017].) [2] R. Letzter, If you have depression, you likely aren't getting the treatment you need, Business Insider, 16, November, [Online]. Available: [Accessed: March. 13, 2017]. [3] M.D. Roos, in Sri Lanka, taking pills or talking?, Sunday Island e-paper, para.2, July 26, [Online], Available: [Accessed: March. 13, 2017]. [4] A new tool to support diagnosis of neurological disorders by means of facial expression. [Online], Available: ieee. org/ document/ /? reload=true [Accessed: March. 13, 2017]. [5] Pooja Yadav, Gaurav Aggarwal, Speech Emotion Classification using Machine Learning.[Online]. Available: volume118/number13/pxc pdf [Accessed: March. 13, 2017]. [6] Naive-Bayes Classification Algorithm,. [Online]. Available: NaiveBayes.pdf [Accessed: March. 13, 2017]. [7] Sentimental Analysis on Twitter Data using Naive Bayes,. [Online]. Available: /IJARCCE% 2073.pdf [Accessed: March. 13, 2017].
Gender Based Emotion Recognition using Speech Signals: A Review
50 Gender Based Emotion Recognition using Speech Signals: A Review Parvinder Kaur 1, Mandeep Kaur 2 1 Department of Electronics and Communication Engineering, Punjabi University, Patiala, India 2 Department
More informationEmotion Recognition using a Cauchy Naive Bayes Classifier
Emotion Recognition using a Cauchy Naive Bayes Classifier Abstract Recognizing human facial expression and emotion by computer is an interesting and challenging problem. In this paper we propose a method
More informationFacial expression recognition with spatiotemporal local descriptors
Facial expression recognition with spatiotemporal local descriptors Guoying Zhao, Matti Pietikäinen Machine Vision Group, Infotech Oulu and Department of Electrical and Information Engineering, P. O. Box
More informationA Vision-based Affective Computing System. Jieyu Zhao Ningbo University, China
A Vision-based Affective Computing System Jieyu Zhao Ningbo University, China Outline Affective Computing A Dynamic 3D Morphable Model Facial Expression Recognition Probabilistic Graphical Models Some
More informationAnalysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information
Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information C. Busso, Z. Deng, S. Yildirim, M. Bulut, C. M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, S. Narayanan Emotion
More informationAffective Game Engines: Motivation & Requirements
Affective Game Engines: Motivation & Requirements Eva Hudlicka Psychometrix Associates Blacksburg, VA hudlicka@ieee.org psychometrixassociates.com DigiPen Institute of Technology February 20, 2009 1 Outline
More informationSupplemental Digital Appendix 1 Questions From the Pre- and Post-Evaluation for a Facial Expression Workshop a,b
Supplemental Digital Appendix 1 Questions From the Pre- and Post-Evaluation for a Facial Expression Workshop a,b The following items were included in both the pre- and post-workshop evaluation: Confidence
More informationA Smart Texting System For Android Mobile Users
A Smart Texting System For Android Mobile Users Pawan D. Mishra Harshwardhan N. Deshpande Navneet A. Agrawal Final year I.T Final year I.T J.D.I.E.T Yavatmal. J.D.I.E.T Yavatmal. Final year I.T J.D.I.E.T
More informationEdge Based Grid Super-Imposition for Crowd Emotion Recognition
Edge Based Grid Super-Imposition for Crowd Emotion Recognition Amol S Patwardhan 1 1Senior Researcher, VIT, University of Mumbai, 400037, India ---------------------------------------------------------------------***---------------------------------------------------------------------
More informationHealthy Coping. Learning You Have Diabetes. Stress. Type of Stress
Healthy Coping Learning You Have Diabetes Learning you have diabetes changes your life forever. You may feel scared, shocked, angry or overwhelmed. You may not want to believe it. These are normal reactions.
More informationEECS 433 Statistical Pattern Recognition
EECS 433 Statistical Pattern Recognition Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208 http://www.eecs.northwestern.edu/~yingwu 1 / 19 Outline What is Pattern
More informationNeuro-Inspired Statistical. Rensselaer Polytechnic Institute National Science Foundation
Neuro-Inspired Statistical Pi Prior Model lfor Robust Visual Inference Qiang Ji Rensselaer Polytechnic Institute National Science Foundation 1 Status of Computer Vision CV has been an active area for over
More informationBeyond AI: Bringing Emotional Intelligence to the Digital
Beyond AI: Bringing Emotional Intelligence to the Digital World Emotions influence every aspect of our lives how we live, work and play to the decisions we make We are surrounded by hyper-connected devices,
More informationIdentifying Signs of Depression on Twitter Eugene Tang, Class of 2016 Dobin Prize Submission
Identifying Signs of Depression on Twitter Eugene Tang, Class of 2016 Dobin Prize Submission INTRODUCTION Depression is estimated to affect 350 million people worldwide (WHO, 2015). Characterized by feelings
More informationClassification and attractiveness evaluation of facial emotions for purposes of plastic surgery using machine-learning methods and R
Classification and attractiveness evaluation of facial emotions for purposes of plastic surgery using machine-learning methods and R erum 2018 Lubomír Štěpánek 1, 2 Pavel Kasal 2 Jan Měšťák 3 1 Institute
More informationSkin color detection for face localization in humanmachine
Research Online ECU Publications Pre. 2011 2001 Skin color detection for face localization in humanmachine communications Douglas Chai Son Lam Phung Abdesselam Bouzerdoum 10.1109/ISSPA.2001.949848 This
More informationMODULE 41: THEORIES AND PHYSIOLOGY OF EMOTION
MODULE 41: THEORIES AND PHYSIOLOGY OF EMOTION EMOTION: a response of the whole organism, involving 1. physiological arousal 2. expressive behaviors, and 3. conscious experience A mix of bodily arousal
More informationResearch Proposal on Emotion Recognition
Research Proposal on Emotion Recognition Colin Grubb June 3, 2012 Abstract In this paper I will introduce my thesis question: To what extent can emotion recognition be improved by combining audio and visual
More informationFacial Expression and Consumer Attitudes toward Cultural Goods
Facial Expression and Consumer Attitudes toward Cultural Goods Chih-Hsiang Ko, Chia-Yin Yu Department of Industrial and Commercial Design, National Taiwan University of Science and Technology, 43 Keelung
More information1/12/2012. How can you tell if someone is experiencing an emotion? Emotion. Dr.
http://www.bitrebels.com/design/76-unbelievable-street-and-wall-art-illusions/ 1/12/2012 Psychology 456 Emotion Dr. Jamie Nekich A Little About Me Ph.D. Counseling Psychology Stanford University Dissertation:
More informationEmotion-Aware Machines
Emotion-Aware Machines Saif Mohammad, Senior Research Officer National Research Council Canada 1 Emotion-Aware Machines Saif Mohammad National Research Council Canada 2 What does it mean for a machine
More informationNot All Moods are Created Equal! Exploring Human Emotional States in Social Media
Not All Moods are Created Equal! Exploring Human Emotional States in Social Media Munmun De Choudhury Scott Counts Michael Gamon Microsoft Research, Redmond {munmund, counts, mgamon}@microsoft.com [Ekman,
More informationContrastive Analysis on Emotional Cognition of Skeuomorphic and Flat Icon
Contrastive Analysis on Emotional Cognition of Skeuomorphic and Flat Icon Xiaoming Zhang, Qiang Wang and Yan Shi Abstract In the field of designs of interface and icons, as the skeuomorphism style fades
More informationInventions on expressing emotions In Graphical User Interface
From the SelectedWorks of Umakant Mishra September, 2005 Inventions on expressing emotions In Graphical User Interface Umakant Mishra Available at: https://works.bepress.com/umakant_mishra/26/ Inventions
More informationFuzzy Model on Human Emotions Recognition
Fuzzy Model on Human Emotions Recognition KAVEH BAKHTIYARI &HAFIZAH HUSAIN Department of Electrical, Electronics and Systems Engineering Faculty of Engineering and Built Environment, Universiti Kebangsaan
More informationIntroduction to affect computing and its applications
Introduction to affect computing and its applications Overview What is emotion? What is affective computing + examples? Why is affective computing useful? How do we do affect computing? Some interesting
More informationEmotion Affective Color Transfer Using Feature Based Facial Expression Recognition
, pp.131-135 http://dx.doi.org/10.14257/astl.2013.39.24 Emotion Affective Color Transfer Using Feature Based Facial Expression Recognition SeungTaek Ryoo and Jae-Khun Chang School of Computer Engineering
More informationFostering positive team behaviors in human-machine teams through emotion processing: Adapting to the operator's state
https://livelink.ebs.afrl.af.mil/livelink/llisapi.dll Page 1 of 2 8/21/2018 AFRL-AFOSR-JP-TR-2018-0062 Fostering positive team behaviors in human-machine teams through emotion processing: Adapting to the
More informationThis is the accepted version of this article. To be published as : This is the author version published as:
QUT Digital Repository: http://eprints.qut.edu.au/ This is the author version published as: This is the accepted version of this article. To be published as : This is the author version published as: Chew,
More informationWEB MINING IN CLASSIFYING YOUTH EMOTIONS
Malaysian Journal of Computing, 3 (1): 1 11, 2018 Copyright UiTM Press eissn: 2600-8238 online WEB MINING IN CLASSIFYING YOUTH EMOTIONS Zura Izlita Razak 1, Shuzlina Abdul-Rahman 2, Sofianita Mutalib 3
More informationERI User s Guide. 2. Obtaining the ERI for research purposes
ERI User s Guide 1. Goal and features of the ERI The Emotion Recognition Index (Scherer & Scherer, 2011) is a rapid screening instrument measuring emotion recognition ability. The ERI consists of a facial
More informationGfK Verein. Detecting Emotions from Voice
GfK Verein Detecting Emotions from Voice Respondents willingness to complete questionnaires declines But it doesn t necessarily mean that consumers have nothing to say about products or brands: GfK Verein
More informationEmotion based E-learning System using Physiological Signals. Dr. Jerritta S, Dr. Arun S School of Engineering, Vels University, Chennai
CHENNAI - INDIA Emotion based E-learning System using Physiological Signals School of Engineering, Vels University, Chennai Outline Introduction Existing Research works on Emotion Recognition Research
More informationDrive-reducing behaviors (eating, drinking) Drive (hunger, thirst) Need (food, water)
Instinct Theory: we are motivated by our inborn automated behaviors that generally lead to survival. But instincts only explain why we do a small fraction of our behaviors. Does this behavior adequately
More informationRecognising Emotions from Keyboard Stroke Pattern
Recognising Emotions from Keyboard Stroke Pattern Preeti Khanna Faculty SBM, SVKM s NMIMS Vile Parle, Mumbai M.Sasikumar Associate Director CDAC, Kharghar Navi Mumbai ABSTRACT In day to day life, emotions
More informationThe SpiritualityApps.net Travel Guide
The SpiritualityApps.net Travel Guide CONTENTS Intrepid Exploring Mind Body Tool app A Place Called Balance Rebalance app Being Happy Inner Kung Fu Game Feeling Younger Move Well app Being Your Own Guide
More informationFudan University, China
Cyber Psychosocial and Physical (CPP) Computation Based on Social Neuromechanism -Joint research work by Fudan University and University of Novi Sad By Professor Weihui Dai Fudan University, China 1 Agenda
More informationFacial Feature Model for Emotion Recognition Using Fuzzy Reasoning
Facial Feature Model for Emotion Recognition Using Fuzzy Reasoning Renan Contreras, Oleg Starostenko, Vicente Alarcon-Aquino, and Leticia Flores-Pulido CENTIA, Department of Computing, Electronics and
More informationBlue Eyes Technology
Blue Eyes Technology D.D. Mondal #1, Arti Gupta *2, Tarang Soni *3, Neha Dandekar *4 1 Professor, Dept. of Electronics and Telecommunication, Sinhgad Institute of Technology and Science, Narhe, Maharastra,
More informationMental State Recognition by using Brain Waves
Indian Journal of Science and Technology, Vol 9(33), DOI: 10.17485/ijst/2016/v9i33/99622, September 2016 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 Mental State Recognition by using Brain Waves
More informationA Human-Markov Chain Monte Carlo Method For Investigating Facial Expression Categorization
A Human-Markov Chain Monte Carlo Method For Investigating Facial Expression Categorization Daniel McDuff (djmcduff@mit.edu) MIT Media Laboratory Cambridge, MA 02139 USA Abstract This paper demonstrates
More informationMotivation represents the reasons for people's actions, desires, and needs. Typically, this unit is described as a goal
Motivation What is motivation? Motivation represents the reasons for people's actions, desires, and needs. Reasons here implies some sort of desired end state Typically, this unit is described as a goal
More informationOpen Research Online The Open University s repository of research publications and other research outputs
Open Research Online The Open University s repository of research publications and other research outputs Toward Emotionally Accessible Massive Open Online Courses (MOOCs) Conference or Workshop Item How
More informationBrain Training and Self-Quantification
Recommended Smart Phone Apps! There are literally thousands of Apps available that are designed specifically to help you improve your health and wellness. Apps can be extremely helpful for you on your
More informationAudiovisual to Sign Language Translator
Technical Disclosure Commons Defensive Publications Series July 17, 2018 Audiovisual to Sign Language Translator Manikandan Gopalakrishnan Follow this and additional works at: https://www.tdcommons.org/dpubs_series
More informationEMOTION DETECTION THROUGH SPEECH AND FACIAL EXPRESSIONS
EMOTION DETECTION THROUGH SPEECH AND FACIAL EXPRESSIONS 1 KRISHNA MOHAN KUDIRI, 2 ABAS MD SAID AND 3 M YUNUS NAYAN 1 Computer and Information Sciences, Universiti Teknologi PETRONAS, Malaysia 2 Assoc.
More informationTHE ANALYTICS EDGE. Intelligence, Happiness, and Health x The Analytics Edge
THE ANALYTICS EDGE Intelligence, Happiness, and Health 15.071x The Analytics Edge Data is Powerful and Everywhere 2.7 Zettabytes of electronic data exist in the world today 2,700,000,000,000,000,000,000
More informationIDENTIFYING STRESS BASED ON COMMUNICATIONS IN SOCIAL NETWORKS
IDENTIFYING STRESS BASED ON COMMUNICATIONS IN SOCIAL NETWORKS 1 Manimegalai. C and 2 Prakash Narayanan. C manimegalaic153@gmail.com and cprakashmca@gmail.com 1PG Student and 2 Assistant Professor, Department
More informationSignals from Text: Sentiment, Intent, Emotion, Deception
Signals from Text: Sentiment, Intent, Emotion, Deception Stephen Pulman TheySay Ltd, www.theysay.io and Dept. of Computer Science, Oxford University stephen.pulman@cs.ox.ac.uk March 9, 2017 Text Analytics
More informationPSYC 222 Motivation and Emotions
PSYC 222 Motivation and Emotions Session 6 The Concept of Emotion Lecturer: Dr. Annabella Osei-Tutu, Psychology Department Contact Information: aopare-henaku@ug.edu.gh College of Education School of Continuing
More informationIEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 5, JULY
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 5, JULY 2011 1057 A Framework for Automatic Human Emotion Classification Using Emotion Profiles Emily Mower, Student Member, IEEE,
More informationTowards Unobtrusive Emotion Recognition for Affective Social Communication
The 9th Annual IEEE Consumer Communications and Networking Conference - Special Session Affective Computing for Future Consumer Electronics Towards Unobtrusive Emotion Recognition for Affective Social
More informationTalking Heads for the Web: what for? Koray Balci Fabio Pianesi Massimo Zancanaro
Talking Heads for the Web: what for? Koray Balci Fabio Pianesi Massimo Zancanaro Outline XFace an open source MPEG4-FAP based 3D Talking Head Standardization issues (beyond MPEG4) Synthetic Agents the
More informationOutline. Emotion. Emotions According to Darwin. Emotions: Information Processing 10/8/2012
Outline Emotion What are emotions? Why do we have emotions? How do we express emotions? Cultural regulation of emotion Eliciting events Cultural display rules Social Emotions Behavioral component Characteristic
More informationFACIAL EXPRESSION RECOGNITION FROM IMAGE SEQUENCES USING SELF-ORGANIZING MAPS
International Archives of Photogrammetry and Remote Sensing. Vol. XXXII, Part 5. Hakodate 1998 FACIAL EXPRESSION RECOGNITION FROM IMAGE SEQUENCES USING SELF-ORGANIZING MAPS Ayako KATOH*, Yasuhiro FUKUI**
More informationFrom Sentiment to Emotion Analysis in Social Networks
From Sentiment to Emotion Analysis in Social Networks Jie Tang Department of Computer Science and Technology Tsinghua University, China 1 From Info. Space to Social Space Info. Space! Revolutionary changes!
More informationLecture 6: Social Cognition (Seeking Accuracy) Part I: Non-verbal communication Part II: Attribution
Lecture 6: Social Cognition (Seeking Accuracy) Part I: Non-verbal communication Part II: Attribution Social Perception A fundamental process through which people come to understand their social world.
More information5 Minute Strategies to Support Healthy Treatment and Recovery
HPW-000030 TAKE FIVE 5 Minute Strategies to Support Healthy Treatment and Recovery Below you will find quick strategies, each related to one of 15 different moods commonly experienced by people coping
More informationEffect of Sensor Fusion for Recognition of Emotional States Using Voice, Face Image and Thermal Image of Face
Effect of Sensor Fusion for Recognition of Emotional States Using Voice, Face Image and Thermal Image of Face Yasunari Yoshitomi 1, Sung-Ill Kim 2, Takako Kawano 3 and Tetsuro Kitazoe 1 1:Department of
More informationIntroduction to Machine Learning. Katherine Heller Deep Learning Summer School 2018
Introduction to Machine Learning Katherine Heller Deep Learning Summer School 2018 Outline Kinds of machine learning Linear regression Regularization Bayesian methods Logistic Regression Why we do this
More informationANALYSIS OF FACIAL FEATURES OF DRIVERS UNDER COGNITIVE AND VISUAL DISTRACTIONS
ANALYSIS OF FACIAL FEATURES OF DRIVERS UNDER COGNITIVE AND VISUAL DISTRACTIONS Nanxiang Li and Carlos Busso Multimodal Signal Processing (MSP) Laboratory Department of Electrical Engineering, The University
More informationEMOTIONS are one of the most essential components of
1 Hidden Markov Model for Emotion Detection in Speech Cyprien de Lichy, Pratyush Havelia, Raunaq Rewari Abstract This paper seeks to classify speech inputs into emotion labels. Emotions are key to effective
More informationAccessible Computing Research for Users who are Deaf and Hard of Hearing (DHH)
Accessible Computing Research for Users who are Deaf and Hard of Hearing (DHH) Matt Huenerfauth Raja Kushalnagar Rochester Institute of Technology DHH Auditory Issues Links Accents/Intonation Listening
More informationTemporal Context and the Recognition of Emotion from Facial Expression
Temporal Context and the Recognition of Emotion from Facial Expression Rana El Kaliouby 1, Peter Robinson 1, Simeon Keates 2 1 Computer Laboratory University of Cambridge Cambridge CB3 0FD, U.K. {rana.el-kaliouby,
More informationSCHIZOPHRENIA, AS SEEN BY A
SCHIZOPHRENIA, AS SEEN BY A DEPTH CAMERA AND OTHER SENSORS Daphna Weinshall 1 School of Computer Science & Engin. Hebrew University of Jerusalem, Israel RESEARCH GOAL Motivation: current psychiatric diagnosis
More informationImplementation of Perception Classification based on BDI Model using Bayesian Classifier
Implementation of Perception Classification based on BDI Model using Bayesian Classifier Vishwanath Y 1 Murali T S 2 Dr M.V Vijayakumar 3 1 Research Scholar, Dept. of Computer Science & Engineering, Jain
More informationD4.10 Demonstrator 4 EoT Application
Horizon 2020 PROGRAMME ICT-01-2014: Smart Cyber-Physical Systems This project has received funding from the European Union s Horizon 2020 research and innovation programme under Grant Agreement No 643924
More informationPrediction of Psychological Disorder using ANN
Prediction of Psychological Disorder using ANN Purva D. Kekatpure #1, Prof. Rekha S. Sugandhi *2 # Department of Computer Engineering, M.I.T. College of Engineering Kothrud, Pune, India, University of
More informationThe Vine Assessment System by LifeCubby
The Vine Assessment System by LifeCubby A Fully Integrated Platform for Observation, Daily Reporting, Communications and Assessment For Early Childhood Professionals and the Families that they Serve Alignment
More informationdid you feel sad or depressed? did you feel sad or depressed for most of the day, nearly every day?
Name: Age: Date: PDSQ This form asks you about emotions, moods, thoughts, and behaviors. For each question, circle YES in the column next to that question, if it describes how you have been acting, feeling,
More informationGlove for Gesture Recognition using Flex Sensor
Glove for Gesture Recognition using Flex Sensor Mandar Tawde 1, Hariom Singh 2, Shoeb Shaikh 3 1,2,3 Computer Engineering, Universal College of Engineering, Kaman Survey Number 146, Chinchoti Anjur Phata
More informationThe Make Time Programme
The Make Time Programme Guidance notes Thank you for making time this November to help end mental health discrimination in schools. Statistically, three students in every class in your school will experience
More informationFILTWAM. A Framework for Online Affective Computing in Serious Games. Kiavash Bahreini Wim Westera Rob Nadolski
FILTWAM A Framework for Online Affective Computing in Serious Games Kiavash Bahreini Wim Westera Rob Nadolski 4th International Conference on Games and Virtual Worlds for Serious Applications, VS-GAMES
More informationThis is a repository copy of Measuring the effect of public health campaigns on Twitter: the case of World Autism Awareness Day.
This is a repository copy of Measuring the effect of public health campaigns on Twitter: the case of World Autism Awareness Day. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/127215/
More informationJanuary - April Adult, Community and Family Learning
January - April 2017 Adult, Community and Family Learning INTRODUCTION WELL-BEING COURSES Welcome to Adult Community & Family Learning, January - April Well-being Course Guide. We hope you enjoy this terms
More informationAn Online ADR System Using a Tool for Animated Agents
An Online ADR System Using a Tool for Animated Agents Masahide Yuasa, Takahiro Tanaka, Yoshiaki Yasumura, Katsumi Nitta Department of Computational Intelligence and Systems Science, Tokyo Institute of
More information1. INTRODUCTION. Vision based Multi-feature HGR Algorithms for HCI using ISL Page 1
1. INTRODUCTION Sign language interpretation is one of the HCI applications where hand gesture plays important role for communication. This chapter discusses sign language interpretation system with present
More informationFormulating Emotion Perception as a Probabilistic Model with Application to Categorical Emotion Classification
Formulating Emotion Perception as a Probabilistic Model with Application to Categorical Emotion Classification Reza Lotfian and Carlos Busso Multimodal Signal Processing (MSP) lab The University of Texas
More informationOutline. Teager Energy and Modulation Features for Speech Applications. Dept. of ECE Technical Univ. of Crete
Teager Energy and Modulation Features for Speech Applications Alexandros Summariza(on Potamianos and Emo(on Tracking in Movies Dept. of ECE Technical Univ. of Crete Alexandros Potamianos, NatIONAL Tech.
More informationPSYCHOLOGIST-PATIENT SERVICES
PSYCHOLOGIST-PATIENT SERVICES PSYCHOLOGICAL SERVICES Welcome to my practice. Because you will be putting a good deal of time and energy into therapy, you should choose a psychologist carefully. I strongly
More informationAnalyzing Personality through Social Media Profile Picture Choice
Analyzing Personality through Social Media Profile Picture Choice Leqi Liu, Daniel Preoţiuc-Pietro, Zahra Riahi Mohsen E. Moghaddam, Lyle Ungar ICWSM 2016 Positive Psychology Center University of Pennsylvania
More informationR Jagdeesh Kanan* et al. International Journal of Pharmacy & Technology
ISSN: 0975-766X CODEN: IJPTFI Available Online through Research Article www.ijptonline.com FACIAL EMOTION RECOGNITION USING NEURAL NETWORK Kashyap Chiranjiv Devendra, Azad Singh Tomar, Pratigyna.N.Javali,
More informationASC-Inclusion. The Case, Initiatives and Impact. Interactive Emotion Games. Björn Schuller
ASC-Inclusion Interactive Emotion Games The Case, Initiatives and Impact Björn Schuller Institute for Human-Machine Interaction Technische Universität München, Germany DGEI Expert Workshop, 23/24 January
More informationIntroduction to Sentiment Analysis
Introduction to Sentiment Analysis Machine Learning and Modelling for Social Networks Lloyd Sanders, Olivia Woolley, Iza Moize, Nino Antulov-Fantulin D-GESS: Computational Social Science Overview What
More informationClassification of Local Language Disaster Related Tweets in Micro Blogs
Classification of Local Language Disaster Related Tweets in Micro Blogs Randy Joy Magno Ventayen Pangasinan State University, Philippines dayjx@yahoo.com Date Received: November 5, 2017; Date Revised:
More informationPlease take time to read this document carefully. It forms part of the agreement between you and your counsellor and Insight Counselling.
Informed Consent Please take time to read this document carefully. It forms part of the agreement between you and your counsellor and Insight Counselling. AGREEMENT FOR COUNSELLING SERVICES CONDUCTED BY
More informationEmotions. These aspects are generally stronger in emotional responses than with moods. The duration of emotions tend to be shorter than moods.
LP 8D emotions & James/Lange 1 Emotions An emotion is a complex psychological state that involves subjective experience, physiological response, and behavioral or expressive responses. These aspects are
More informationApps to help those with special needs.
Apps to help those with special needs. 1 Benjamin Saracco NJ Reference & Digital Projects Librarian bsaracco@njstatelib.org ext: 115 The power of modern day tablets and smartphones Most smartphones and
More informationThis is the author s version of a work that was submitted/accepted for publication in the following source:
This is the author s version of a work that was submitted/accepted for publication in the following source: Moshfeghi, Yashar, Zuccon, Guido, & Jose, Joemon M. (2011) Using emotion to diversify document
More informationGuidance on Benign Behavioral Interventions: Exempt Category Three 45 CFR (d)(3)(i)
Wayne State University Institutional Review Board (IRB) WSU IRB Administration Office 87 East Canfield, Second Floor Detroit, MI, 48201 313-577-1628 irb.wayne.edu Guidance on Benign Behavioral Interventions:
More informationRESTore TM. Clinician Manual for Single User. Insomnia and Sleep Disorders. A step by step manual to help you guide your clients through the program
RESTore TM Insomnia and Sleep Disorders Clinician Manual for Single User A step by step manual to help you guide your clients through the program Version 10 July, 2016 Table of Contents Introduction...
More informationHow to Create Better Performing Bayesian Networks: A Heuristic Approach for Variable Selection
How to Create Better Performing Bayesian Networks: A Heuristic Approach for Variable Selection Esma Nur Cinicioglu * and Gülseren Büyükuğur Istanbul University, School of Business, Quantitative Methods
More informationSource and Description Category of Practice Level of CI User How to Use Additional Information. Intermediate- Advanced. Beginner- Advanced
Source and Description Category of Practice Level of CI User How to Use Additional Information Randall s ESL Lab: http://www.esllab.com/ Provide practice in listening and comprehending dialogue. Comprehension
More informationFORENSIC HYPNOSIS WITH THE DEAF AND HEARING IMPAIRED
FORENSIC HYPNOSIS WITH THE DEAF AND HEARING IMPAIRED By: Inspector Marx Howell, BS (ret.) Unfortunately, I had not given much thought to the use of hypnosis with a deaf or hearing impaired individual until
More informationThe Ordinal Nature of Emotions. Georgios N. Yannakakis, Roddy Cowie and Carlos Busso
The Ordinal Nature of Emotions Georgios N. Yannakakis, Roddy Cowie and Carlos Busso The story It seems that a rank-based FeelTrace yields higher inter-rater agreement Indeed, FeelTrace should actually
More informationLarge Scale Analysis of Health Communications on the Social Web. Michael J. Paul Johns Hopkins University
Large Scale Analysis of Health Communications on the Social Web Michael J. Paul Johns Hopkins University 3rd-year PhD student Who am I? Background: computer science (not an expert in health, medicine,
More informationPerson Perception. Forming Impressions of Others. Mar 5, 2012, Banu Cingöz Ulu
Person Perception Forming Impressions of Others Mar 5, 2012, Banu Cingöz Ulu Person Perception person perception: how we come to know about others temporary states, emotions, intentions and desires impression
More informationSelf Help Journals Anger Management
Self Help Journals Anger Management Anger is defined as... strong feelings of irritation, annoyance, or rage What is anger? Feeling angry is part of being human. It is a natural response to being attacked,
More informationDiscovering Facial Expressions for States of Amused, Persuaded, Informed, Sentimental and Inspired
Discovering Facial Expressions for States of Amused, Persuaded, Informed, Sentimental and Inspired Daniel McDuff Microsoft Research, Redmond, WA, USA This work was performed while at Affectiva damcduff@microsoftcom
More informationCSE 258 Lecture 1.5. Web Mining and Recommender Systems. Supervised learning Regression
CSE 258 Lecture 1.5 Web Mining and Recommender Systems Supervised learning Regression What is supervised learning? Supervised learning is the process of trying to infer from labeled data the underlying
More information