A Robust Ontology of Emotion Objects Michal Ptaszynski 1, Rafal Rzepka 2, Kenji Araki 2, Yoshio Momouchi 3

Transcription

1 A Robust Ontology of Emotion Objects Michal Ptaszynski 1, Rafal Rzepka 2, Kenji Araki 2, Yoshio Momouchi 3 1) JSPS Research Fellow / Hokkai-Gakuen University, High-Tech Research Center 2) Hokkaido University, Graduate School of Information Science and Technology 3) Hokkai-Gakuen University, Department of Electronics and Information Engineering

2 A Robust Ontology of Emotion Objects Michal Ptaszynski 1, Rafal Rzepka 2, Kenji Araki 2, Yoshio Momouchi 3 1) JSPS Research Fellow / Hokkai-Gakuen University, High-Tech Research Center 2) Hokkaido University, Graduate School of Information Science and Technology 3) Hokkai-Gakuen University, Department of Electronics and Information Engineering

3 Presentation Outline Introduction Previous Research Emotion ontologies Emotion object annotation / extraction Emotion object extraction Method description Evaluation Ontology construction Conclusions and Future Work

4 Introduction Emotions have been studied from various perspectives: Psychology Neurobiology Philosophy

5 Introduction Emotions have been studied from various perspectives: Psychology Neurobiology Philosophy One of the ways to study emotions is to study their FORMAL OBJECTS

6 Introduction FORMAL OBJECTS axiological properties which individuate emotions, make them intelligible and give them correctness conditions [1, 2, 3]. 1. Wilson, J. R. S \textit{emotion and Object}, Cambridge University Press. 2. Mulligan, K \textit{intentionality, Knowledge and Formal Objects}, Electronic Festschrift for W. Rabinowicz, T. Ronnow-Rasmussen et al. (eds.) Teroni, F ``Emotions and Formal Objects", \textit{dialectica}, pp Kenny, A \textit{action, Emotion and Will}, Routledge, 2003 (reprint from 1963). 5. Lazarus, R. S ``Cognition and Motivation in Emotion", \textit{american Psychologist}, Vol. 46, pp Solomon, R. C \textit{the Passions: Emotions and the Meaning of Life}, Hackett Publishing.

7 Introduction FORMAL OBJECTS axiological properties which individuate emotions, make them intelligible and give them correctness conditions [1, 2, 3]. Emotions are necessarily about something [4, 5, 6] (have intentionality) 1. Wilson, J. R. S \textit{emotion and Object}, Cambridge University Press. 2. Mulligan, K \textit{intentionality, Knowledge and Formal Objects}, Electronic Festschrift for W. Rabinowicz, T. Ronnow-Rasmussen et al. (eds.) Teroni, F ``Emotions and Formal Objects", \textit{dialectica}, pp Kenny, A \textit{action, Emotion and Will}, Routledge, 2003 (reprint from 1963). 5. Lazarus, R. S ``Cognition and Motivation in Emotion", \textit{american Psychologist}, Vol. 46, pp Solomon, R. C \textit{the Passions: Emotions and the Meaning of Life}, Hackett Publishing.

8 Introduction FORMAL OBJECTS Bottleneck

9 Introduction FORMAL OBJECTS Bottleneck When I am afraid there is an object of my fear (e.g. spiders).

10 Introduction FORMAL OBJECTS Bottleneck When I am afraid there is an object of my fear (e.g. spiders). Too general

11 Introduction FORMAL OBJECTS Bottleneck When I am afraid there is an object of my fear (e.g. spiders). Eventually we end talking about particular objects Too general

12 Introduction FORMAL OBJECTS Bottleneck When I am afraid there is an object of my fear (e.g. spiders). Eventually we end talking about particular objects Too general

13 Introduction FORMAL OBJECTS Formal objects are formalized particular objects [3] 1. Teroni, F ``Emotions and Formal Objects", \textit{dialectica}, pp

14 Introduction FORMAL OBJECTS Formal objects are formalized particular objects [3] Perhaps we can study formal objects as formalizations of particular objects? 1. Teroni, F ``Emotions and Formal Objects", \textit{dialectica}, pp

15 Introduction FORMAL OBJECTS Formal objects are formalized particular objects [3] Perhaps we can study formal objects as formalizations of particular objects? need a big ontology of particular emotion objects (~emotion causes). 1. Teroni, F ``Emotions and Formal Objects", \textit{dialectica}, pp

16 Previous Research Emotion ontologies WordNet-Affect [1] (English) Ontology for description of emotional cues [2] (English) Emotion ontology for Chinese [3] (Chinese) Ontology of smileys (emoticons) [4] (Emoticons) Emotion ontology for Italian [5] (Italian) 1. Strapparava, C. and Valitutti, A ``WordNet-Affect: an affective extension of WordNet", In Proc. of LREC}, Vol. 4, pp Obrenovic, Z., Garay, N., L?ez, J. M., Fajardo, I., Cearreta, I ``An Ontology for Description of Emotional Cues", In Proceedings of Proceedings of the First international conference on Affective Computing and Intelligent Interaction (ACII'05)}, pp Yan, J., Bracewell, D. B., Ren F. and Kuroiwa, S ``The Creation of a Chinese Emotion Ontology Based on HowNet", Engineering Letters}, 16:1, EL\_16\_1\_ Radulovic, F. and Milikic, N ``Smiley Ontology", In Proc. First Int? Workshop Social Networks Interoperability}, Shanghai, China. 5. Baldoni, M., Baroglio, C., Patti V. and Rena P ``From Tags to Emotions: Ontology-driven Sentiment Analysis in the Social SemanticWeb", In Proceedings of the 5th International Workshop on New Challenges in Distributed Information Filtering and Retrieval}, Palermo, Italy.

17 Previous Research Emotion ontologies WordNet-Affect [1] (English) Ontology for description of emotional cues [2] (English) Emotion ontology for Chinese [3] (Chinese) Ontology of smileys (emoticons) [4] (Emoticons) Emotion ontology for Italian [5] (Italian) 1. Strapparava, C. and Valitutti, A ``WordNet-Affect: an affective extension of WordNet", In Proc. of LREC}, Vol. 4, pp Obrenovic, Z., Garay, N., L?ez, J. M., Fajardo, I., Cearreta, I ``An Ontology for Description of Emotional Cues", In Proceedings of Proceedings of the First international conference on Affective Computing and Intelligent Interaction (ACII'05)}, pp Yan, J., Bracewell, D. B., Ren F. and Kuroiwa, S ``The Creation of a Chinese Emotion Ontology Based on HowNet", Engineering Letters}, 16:1, EL\_16\_1\_ Radulovic, F. and Milikic, N ``Smiley Ontology", In Proc. First Int? Workshop Social Networks Interoperability}, Shanghai, China. 5. Baldoni, M., Baroglio, C., Patti V. and Rena P ``From Tags to Emotions: Ontology-driven Sentiment Analysis in the Social SemanticWeb", In Proceedings of the 5th International Workshop on New Challenges in Distributed Information Filtering and Retrieval}, Palermo, Italy.

18 Previous Research Emotion object annotation / extraction Chinese [1] English [2] * opinion/attitude object Japanese [3] * opinion/attitude object 1. Quan, C., Ren, F ``A blog emotion corpus for emotional expression analysis in Chinese", Computer Speech \& Language}, Vol. 24, Issue 4, pp Wiebe, J., Wilson, T. and Cardie, C ``Annotating expressions of opinions and emotions in language". Language Resources and Evaluation}, Vol. 39, Issue 2-3, pp Hashimoto, C., Kurohashi, S., Kawahara, D., Shinzato, K. and Nagata, M ``Construction of a Blog Corpus with Syntactic, Anaphoric, and Sentiment Annotations" [in Japanese], Journal of Natural Language Processing}, Vol 18, No. 2, pp

19 Previous Research Emotion object annotation / extraction Chinese [1] English [2] * opinion/attitude object Japanese [3] * opinion/attitude object John loves his red shiny Porshe boxster. attitude=positive, opinion object=porshe boxster (red) emotion=love, emotion object=porshe boxster (red)

20 Previous Research Emotion object annotation / extraction Chinese [1] English [2] * opinion/attitude object Japanese [3] * opinion/attitude object John loves his red shiny Porshe boxster. attitude=positive, opinion object=porshe boxster (red) emotion=love, emotion Many emotions object=porshe boxster can (red) be positive (joy, fondness, relief) Only about 4000 instances

21 Previous Research Emotion object annotation / extraction Chinese [1] English [2] * opinion/attitude object Japanese [3] * opinion/attitude object John loves his red shiny Porshe boxster. attitude=positive, opinion object=porshe boxster (red) emotion=love, emotion Many emotions object=porshe boxster can (red) be positive (joy, fondness, relief) Only about 4000 instances

22 Emotion object extraction Source of extraction: YACIS corpus 5.6 bil. words, 354 mil. sentences in 13 mil. documents. Tokenized, lemmatized, annotated with POS, dependency structure, named entities. Emotion classes, emotive expressions, valence/activation, emoticons

23 Emotion object extraction Method description 彼女に振られたから悲しい... Kanojo ni furareta kara kanashii [emotion cause/object] [causality] [emotive expression] Oe CAUS Xe

24 Emotion object extraction Method description 彼女に振られたから悲しい... Kanojo ni furareta kara kanashii [emotion cause/object] [causality] [emotive expression] Oe CAUS Xe YACIS is annotated with emotions YACIS is also annotated with grammar

25 Emotion object extraction Method description Oe CAUS Xe For all: CAUS(.*{0,5})Xe in YACIS Extract near: Oe Additional distance between causality and emotive expression

26 Emotion object extraction Extracted 19,459,165 emotion objects

27 Emotion object extraction Evaluation 418 sentences in YACIS evaluation dataset for affect analysis systems [1] Annotations by 42 people (students) Emotion type expressed in sentence Where is the emotion object of the expressed emotion? [1] Ptaszynski, M., Maciejewski, J., Dybala, P., Rzepka, R., Araki, K CAO: Fully Automatic Emoticon Analysis System, In Proc. of the 24th AAAI Conference on Artificial Intelligence (AAAI-10), pp

28 Emotion object extraction Evaluation 418 sentences in YACIS evaluation dataset for affect analysis systems [1] Annotations by 42 people (students) Emotion type expressed in sentence Where is the emotion object of the expressed emotion? 80% of objects (334/418) were extracted correctly

29 Emotion object extraction Evaluation 80% of objects (334/418) were extracted correctly At least 20% of error In 20 mil. sentences = at least 4,000,000 sentences are extracted incorrectly (need to deal with that later)

30 Emotion object extraction Evaluation Success cases:

31 Emotion object extraction Evaluation Error cases:

32 Emotion object extraction Evaluation Error cases: Mostly errors in causality (not always used as causality)

33 Ontology construction Used Emotion Markup Language (EmotionML) Included in ontology: Emotion object (as object) Emotion classes Emotion dimensions (valence/activation) Number of characters Parts of Speech Semantic Categories Schroder, M., Baggia, P., Burkhardt, F., Oltramari, A., Pelachaud, C., Peter, C., Zovato, E ``Emotion markup language (EmotionML) 1.0.",

34 Ontology construction Used Emotion Markup Language (EmotionML) Included in ontology: Emotion object (as object) Emotion classes Emotion dimensions (valence/activation) Number of characters Parts of Speech Semantic Categories Based on Nakamura s Emotive Extression Dictionary [1] Based on Russell s 2D model of emotions [2] These could be important [2,3] Based on Bunrui Goihyo [4] 1. Nakamura. Kanjo hyogen jiten [Dictionary of Emotive Expressions] (in Japanese), Tokyodo, J. A. Russell. A circumplex model of affect. J. of Personality and Social Psychology, 39(6): (1980). 3. Quan, C., Ren, F ``A blog emotion corpus for emotional expression analysis in Chinese", Computer Speech & Language, Vol. 24, Issue 4, pp Matsumoto, K., Konishi, Y., Sayama, H., Ren, F ``Analysis of Wakamono Kotoba Emotion Corpus and Its Application in Emotion Estimation", \textit{international Journal of Advanced Intelligence}, Vol. 3, No. 1, pp The National Institute for Japanese Language, ``Bunrui Goihyo (Word List by Semantic Principles, Revised and Enlarged Edition)", kokken.go.jp/en/publications/bunrui\_goihyo/

35 Ontology construction

36 Ontology construction Nakamura s Emotive Extression Dictionary [1] Russell s 2D model of emotions [2] No. of characters [2,3] Parts of Speech Bunrui Goihyo [4]

37 Conclusions Proposed study of formal objects of emotions as: study of formalized particular objects Presented a method for emotion object extraction The method was evaluated on 80%

38 Conclusions Constructed emotion object ontology Used EmotionML Included in ontology: Emotion obejcts Emotion classes Valence/activation POS Semantic categories

39 Future Work Get rid of 20% error Perhaps translate into OWL? (OWL-XML) Try performing reasoning based on emotion objects

40 Thank you for your attention! Michal Ptaszynski

41

42