Distillation of Knowledge from the Research Literatures on Alzheimer s Dementia

Transcription

1 JSCI Distillation of Knowledge from the Research Literatures on Alzheimer s Dementia Wutthipong Kongburan, Mark Chignell, and Jonathan H. Chan School of Information Technology King Mongkut's University of Technology Thonburi

2 Agenda 2 INTRODUCTION PROPOSED METHOD EXPERIMENT, RESULT AND DISCUSSION CONCLUSION AND FUTURE WORK

3 Agenda 3 INTRODUCTION PROPOSED METHOD EXPERIMENTAL RESULT AND DISCUSSION CONCLUSION AND FUTURE WORK

4 4

5 Alzheimer Disease 5

6 Number of publications related to Alzheimer treatment added into PubMed every year #Publications 6

7 Text Mining Research & Applications 7 the process of automatic deriving high-quality information from natural language text

8 Overview of Information Extraction 8 Omega-3 fatty acids in fish may help prevent cognitive decline in Alzheimer patient.

9 Named Entity Recognition (NER) 9 Classify tokens in to predefined categories such as person name, organizations, diseases, proteins.

10 NER Features and Models Campos, David, José Luís Oliveira, and Sérgio Matos. Biomedical named entity recognition: a survey of machine-learning tools. INTECH Open Access Publisher,

11 NER Features 11

12 Conditional Random Fields (CRFs) 12 a type of discriminative probabilistic model. O is observation words sequence S is label sequence Linear chain CRFs define the conditional probability of a state sequence given an input sequence to be: Z 0 is a normalization factor of all state sequences [0, 1] f j (s i 1, s i, o, i) is one of m functions that describes a feature j is a learned weight for each such feature function (define) If j < 0 : CRFs to avoid using this feature If j = 0 : this feature does not affect the probability If j > 0 : improve probability of S s i 1, s i represent previous and current label for observation words position i

13 Conditional Random Fields (CRFs) 13 Morphological feature Prefix memantin- Extract feature/ Train model Training Corpus Classifier/ Model Testing token memantinchlorid NER f j (s i 1, s i, o, i) 1 if s i = Intervention and o begins with memantin- P(Disease memantinchlorid) = Otherwise P(Other memantinchlorid) = 0.0 = 1 P(Intervention memantinchlorid) = 1.0 Z 0 is a normalization factor memantine memantine monotherapy memantine treatment Intervention Intervention Intervention memantinchlorid Intervention

14 14 Distillation of Knowledge from the Research Literatures on Alzheimer s Dementia Text mining technology may assist in distilling knowledge from the vast corpus of research literature on Alzheimer s dementia.

15 Agenda 15 INTRODUCTION PROPOSED METHOD EXPERIMENTAL RESULT AND DISCUSSION CONCLUSION AND FUTURE WORK

16 Proposed method 16 AD Intervention corpus Train classifier Named entity recognition Manually annotated sentence Manual annotation Annotation results Comparison Evaluation results Medical abstracts

17 Corpus construction 50 abstracts 17 Alzheimer treatment Alzheimer treatment Nonpharmacologic treatment for Alzheimer 20 abstracts 10 abstracts 20 abstracts Title Abstract

18 Annotation Procedure 18 The three labels assigned are Disease, Intervention, and Other. All entities to be annotated were nouns. A general term will be excluded. Pronouns and co-references were excluded. Special characters (e.g., quote, dash, or parenthesis) at the beginning or end of entities were not considered.

19 Disease entity 19 Disease included both synonymous mentions and abbreviated forms of AD.

20 Intervention entity 20 Any object or action that is performed by doctor or other clinician targeted in order to help the AD patient. Treatment, prevention, diagnosis, cause, risk factor Such typical treatment - the side effects. Medical interventions alternative treatment increasing patient satisfaction lead to better health outcomes

21 Agenda 21 INTRODUCTION PROPOSED METHOD EXPERIMENTAL RESULT AND DISCUSSION CONCLUSION AND FUTURE WORK

22 Experimental Design 22 AD Intervention corpus Train classifier Named entity recognition Manually annotated sentence Manual annotation Annotation results Comparison Evaluation results Medical abstracts

23 Alzheimer treatment Experiment (1) 23 first 10 webpages AD Intervention corpus Train classifier Named entity recognition Manually annotated sentence Manual annotation Annotation results Comparison Evaluation results Medical abstracts

24 Measure Performance Precision Recall F1-score Accuracy Experiment (1) 24

25 Discussion 25 Further analysis on confusion matrix, false positive and false negative tokens of intervention entity errors between intervention and other class -> such intervention entities are not in corpus (e.g., Aromatherapy, relaxing song, art therapy, coconut oil, pet therapy, Rivastigmine or Exelon, Galantamine or Razadyne). errors between intervention and disease class -> entity's boundary. For instance, Disease Alzheimer s should be labeled as Disease, however when the token is Disease Alzheimer s drugs, they must be labeled as Intervention. a case sensitive in configuration. Although we can exclude a proper noun from annotation, such as Alzheimer s Healthcare Center, a mislabeled entity can occur for example, Memantine is not annotated as Intervention.

26 Alzheimer treatment Experiment (2) 26 Search criteria Normal search Unseen/new Intervention unfamiliar music, dance therapy, environmental cueing, Chinese medicine, coral calcium, animalassisted therapy, multi-sensory therapy, massage physical therapy, intranasal insulin therapy physical therapy, intranasal insulin therapy, antiepileptic drugs, light therapy, flashing light therapy, mouse s spine flashing light therapy, routine screening biogen therapy, nilvadipine, BACE inhibitors

27 Agenda 27 INTRODUCTION PROPOSED METHOD EXPERIMENTAL RESULT AND DISCUSSION CONCLUSION AND FUTURE WORK

28 Conclusion and Future work 28

29 29