Introduction to Medical Computing
|
|
- Della Murphy
- 5 years ago
- Views:
Transcription
1 CS Introduction to Medical Computing Stephen M. Watt
2 Artificial Intelligence in Medicine Notes by Jacquelyne Forgette, March University of Western Ontario CS Stephen M. Watt
3 AIM Artificial Intelligence in Medicine Introduction to Artificial Intelligence Motivate AI for medical use Machine learning techniques Testing Procedures Applications Summary
4 What is it? Why is it great? What has been done?
5 Artificial Intelligence Homo sapiens - man the wise For thousands of years, we have tried to understand how we think. Psychology, philosophy, neuroscience, sociology... Beyond how we think... We want to build intelligent entities. Artificial intelligence S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
6 Artificial Intelligence What characteristics would an intelligent entity exhibit? What makes humans intelligent?
7 Ex: Sherlock Holmes The Science of Deduction This is what I do: 1. I observe everything. 2. From what I observe, I deduce everything. 3. When I've eliminated the impossible, whatever remains, no matter how mad it might seem, must be the truth.
8 Characteristics suggested in class Deductive reasoning Emotion Self aware Inductive reasoning Path planning Altruistic behaviour Abstract organization of thoughts Plan actions according to goals Recognize objects learning
9 Artificial Human Logic: Deduction if a then b Induction generalize from examples Rationality choose actions that achieve the best outcome Inference deriving logical conclusions from a premise that assumed to be true Planning set goals by looking to the future achieve goals Perception Social contacts warp perception Personality can warp perception Motion and manipulation Manipulating objects Learning Localization Navigation Knowledge representation (commonsense) The amount of useful and useless facts any person has knowledge of is astronomical Natural language processing Understand a question Carry a conversation Social intelligence Social etiquette Social networks (not Facebook) Creativity Find a solution outside of the conventional problem domain Create art and music Computer vision Know what you re seeing S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
10 Acting Humanly The Turing Test Proposed by Alan Turing in 1950 Operational definition of intelligence Computer will pass the test if a human interrogator cannot tell whether written responses to questions are from a human or a computer. Natural language processing Knowledge representation Reasoning Learning S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
11 Further Turing Test states that physical simulation of a person is irrelevant to intelligence. Total Turing Test adds that a machine would need Computer vision to perceive objects Robotics to manipulate objects and move about its environment S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
12 History Work in AI started after WW II, and the name itself was coined in 1956 (Russell, 2010) It was astonishing whenever a computer accomplished anything remotely clever. The novelty of a new idea Reality set in. Promising systems would fail miserably on more difficult problems. Used weak methods based on general-purpose mechanisms. Could not scale to larger problems. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
13 History Knowledge based systems. Uses more powerful methods based on domain specific knowledge. If you give the computer domain specific knowledge, it would be able to handle more typical cases in a narrow area of expertise. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
14 MYCIN (Early 1970s) Expert system created to diagnose blood infections. It contained 450 rules that were carefully crafted by expert medical professionals, textbooks and case studies. The rules also had certainty factors, that seemed to reflect how doctors naturally assessed the impact of evidence on a diagnosis. It performed as well as some experts and considerably better than junior doctors. Was never used in practice Required around 30 minutes of the user answering questions before it gave an answer. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
15 CADUCEUS (1980s) An improvement on MYCIN with a broader field of diagnosis. Expert system for medical diagnosis. Extensive knowledge base. Created by Harry Pople and Jack Meyers
16 History 1980-Present AI became an industry Present AI went scientific. Old theories are expanded, tested, analyzed and rigorously proven Present Re-emergence of intelligent agents. Interested in a general agent, rather than specific tasks Present Availability of large data sets. New applications of AI because of available data, not new techniques. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
17 State of the Art AI Robotic Vehicles Speech Recognition Autonomous planning and scheduling Game Playing Spam Filtering Logistics Planning Robotics Machine Translation Many more... S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2010.
18 State of the Art - Watson Watch more about Watson:
19 Assistance, insight, discovery...
20 Why is AI important for medicine? Automatically do tasks that a human would do in any aspect of the medical profession. Better results Shorter amount of time Do mundane tasks Provide insights Save money! Save patients!
21 Adaptation, pattern discovery...
22 Machine Learning Sub-field of AI that is concerned with learning. Find patterns Adapt to new unforeseen situations Learn from mistakes Draw new conclusions Rule based systems have no learning, so they are only as good as the rules programmers include. Igor Kononenko, 2001
23 Thinking learning and remembering Humans don t just think, we learn from our mistakes and our behaviour changes as the situation changes. Machine learning techniques are used to learn a system that makes good decisions by remembering previous outcomes and generalizing to unknown situations.
24 Adaptation, pattern discovery...
25 Decision Tree Learning Most widely used method for inductive inference. Induction Getting a general idea from specific examples. It approximates discrete valued functions. Capable of learning disjunctive [or] expressions. Robust to noisy data. Method to solve the classification problem Igor Kononenko, 2001 and Mitchell, 1997
26 Make a decision Given this information: Outlook is sunny, Temperature is Hot Humidity is High Wind is Strong Question Should we play tennis? Yes or No? Mitchell, 1997
27 Decision tree Attribute Mitchell, 1997 Tree takes an instance, and classifies it: yes or no.
28 Decision tree Values Mitchell, 1997 Tree takes an instance, and classifies it: yes or no.
29 Decision tree Leafs of the tree indicate the resulting classification. Mitchell, 1997 Tree takes an instance, and classifies it: yes or no.
30 Make a decision Given this information: Outlook is sunny, Attribute Temperature is Hot Humidity is High Wind is Strong An attribute has one value, from a set of values: {Sunny, Overcast, Rain} Question Should we play tennis? Yes or No? Given an instance, we want to classify it into one of two classes, yes or no. Classification problem. Mitchell, 1997
31 Decision tree Given an instance, start at the top of the tree, and work downwards. Outlook is sunny, Temperature is Hot Humidity is High Wind is Strong Classification is NO Tree takes an instance, and classifies it: yes or no. Mitchell, 1997
32 Disjunction of conjunctions (Outlook = Sunny AND Humidity = Normal) OR (Outlook = Overcast) OR (Outlook = Rain AND Wind= Weak) OR AND Mitchell, 1997
33 Decision Trees Must Be Built A tree is constructed from training examples. Once tree is constructed, we are able to classify new instances, that were not in the examples. Effectiveness of the tree depends on the correctness of the new classification.
34 Building a Decision Tree Tree is built by using a set of training examples In this case, each example contains Attribute values <wind=strong,... > Desired result (yes or no)
35 Training Data Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No Mitchell, 1997
36 Building Decision Trees What attribute is the most important? What attribute should be at the top of the tree? From this set of training examples, we want to build a decision tree that will fit the training data. Fits the training data if each example is tested on the tree and the classification result is identical to the training example. Mitchell, 1997
37 Information Theory Entropy is a measure of the (im)purity in a collection of training examples Entropy is 0 if all examples belong to the same class Entropy is 1 if each class contains an equal number of examples If the collection contains unequal number of examples in each class, the entropy will be between 0 and 1. Mitchell, 1997
38 Entropy Entropy is a measure of the (im)purity in a collection of training examples A collection S, and the number of possible classifications c. Where pi is the proportion of the ith classification in S.
39 Entropy Half of the classifications are positive and half are negative. Entropy = 1 The entropy function relative to a Boolean classification, as the proportion of positive examples, P varies between 0 and 1. None of the classifications are positive. Entropy = 0 All of the classifications are positive. Entropy = 0 Mitchell, 1997
40 Example (Tennis) S is a collection of 14 examples of either yes or no for playing tennis on a Saturday. [9+,5-] = 0.940
41 [9+,5-] 9 positive results and 5 negative. Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
42 Information Gain Information gain is used to measure how well an attribute separates the training examples according to their target classification Where Values(A) is the set of all possible values for the attribute A, and Sv is the subset of the collection S for which attribute A has value v. Mitchell, 1997
43 Example Gain(S, Wind) We want to know how wind strength separates the training data. We calculated this already for the Entropy example Values(A)={Strong, Weak} Because A is wind Mitchell, 1997
44 Need to find out the values of Sweak and Sstrong and their corresponding entropy values.
45 Sweak = [6+,2-] Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
46 Sstrong = [3+,3-] Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
47 Entropy of Sweak
48 Calculate the Gain of Wind All the values were equally separated making entropy 1 Sstrong = [3+,3-] Mitchell, 1997
49 Information gain for all 4 attributes Outlook attribute provides the best prediction of the target attribute, PlayTennis, given these training examples. Outlook becomes the root node. Gain(S, Outlook) = Gain(S, Humidity) = Gain(S, Wind) = Gain(S, Temperature) = Mitchell, 1997
50 After first separation What attribute should go here? Mitchell, 1997
51 Sunny = [2+,3-] Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
52 Overcast = [4+,0-] Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
53 Rain= [3+,2-] Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
54 Outlook is Sunny With respect to the fact that the outlook must be sunny Mitchell, 1997
55 Building The Tree Keep calculating Gain and extending the tree until all braches lead to (yes or no) or until there are no more attributes.... Mitchell, 1997
56 Adaptation, pattern discovery...
57 Bayesian Theory Example 1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get a positive mammography. 9.6% of women without breast cancer will also get a positive mammography. Question: A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?
58 Bayesian Theory We know that 1% of women in this age group who get regular screenings have cancer. Now we know that the test was positive, how much does the probability of cancer increase? 1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get a positive mammography. 9.6% of women without breast cancer will also get a positive mammography.
59 Bayesian Theory Question: Question: A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer? -OR- If 10,000 women in this age group undergo a routine screening, about what fraction of women with a positive mammography will actually have breast cancer? 1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get a positive mammography. 9.6% of women without breast cancer will also get a positive mammography.
60 Example with 10,000 women
61
62
63 Total of =1030 Women had a positive mammography
64
65 Bayes Theorem The original proportion of patients with breast cancer is known as the prior probability... P(A) The chance that a patient with breast cancer gets a positive mammography, and the chance that a patient without breast cancer gets a positive mammography, are known as the two conditional probabilities... P(B A) and P(B ~ A) Mitchell, 1997
66 Bayes Theorem Provides ways to calculate posterior probability P(A B) from prior and conditional probabilities. Mitchell, 1997
67 Mathematically P(A) = 0.01 P(~A) = 0.99 P(B A) = 0.8 a woman has cancer a woman doesn't have cancer positive mammography given that she does have cancer. P(B ~ A) = positive mammography given that she doesn't have cancer
68 Calculate new probability
69 Naive Bayes Classifier Bayesian method was developed to tackle the classification problem (remember the decision tree example) Learning task consists of a set of instances x, that are described by a conjunction of attribute values and the target function f(x) can take on any value from some finite set V. (same as decision tree) Mitchell, 1997
70 Naive Bayes Classifier We have a set of training examples Then, a new instance is given by a tuple <a1, a2,..., an> The learner must predict the target value of the given instance, by using the training examples. Mitchell, 1997
71 Naive Bayes Classifier Where denotes the target value output. V = {Yes,No} For each possible classification, calculate the probability that the instance belongs in that target category. Mitchell, 1997
72 Example New instance: <Outlook=sunny, Temperature=cool, Humidity=high, Wind=strong> Now we need to estimate the 10 needed probabilities from the training data. Mitchell, 1997
73 Estimate probabilities from training data P(PlayTennis = yes) = 9/14 = 0.64 P(PlayTennis = no) = 5/14 = 0.36 P(Wind = strong PlayTennis = yes) = 3/9 = 0.33 P(Wind = strong PlayTennis = no) = 3/5 = 0.60 P(Humidity = high PlayTennis = yes) = 3/9 = 0.33 P(Humidity = high PlayTennis = no) = 4/5 = 0.8 P(Temperature = cool PlayTennis = yes) = 3/9 = 0.33 P(Temperature = cool PlayTennis = no) = 1/5 = 0.2 P(Outlook = sunny PlayTennis = yes) = 2/9 = 0.22 P(Outlook = sunny PlayTennis = no) = 3/5 = 0.6 Mitchell, 1997
74 Mitchell, 1997 P(Wind = strong PlayTennis = yes) = 3/9 = 0.33 Day Outlook Temperature Humidity Wind Play Tennis? D1 Sunny Hot High Weak No D2 Sunny Hot High Strong No D3 Overcast Hot High Weak Yes D4 Rain Mild High Weak Yes D5 Rain Cool Normal Weak Yes D6 Rain Cool Normal Strong No D7 Overcast Cool Normal Strong Yes D8 Sunny Mild High Weak No D9 Sunny Cool Normal Weak Yes D10 Rain Mild Normal Weak Yes D11 Sunny Mild Normal Strong Yes D12 Overcast Mild High Strong Yes D13 Overcast Hot Normal Weak Yes D14 Rain Mild High Strong No
75 Mitchell, 1997 Example (cont.)
76 Example (cont.) The bayes classifier assigns the value PlayTennis=no to this new instance Normalization gives the conditional probability that the target is no, given the observed attribute values. Given the instance we are 79.5% sure that we should not play tennis. Mitchell, 1997
77
78 Over-fitting Generalization is very important to correctly classifying previously unknown instances. Over-fitting exists because the criterion used for training the model is not the same as the criterion used to judge the efficiency the model. Mitchell, 1997
79 Prevent Over-fitting in DT If over-fitting occurs, the system will effectively memorize the training data, and not be able to generalize to new instances. Techniques exist for preventing over-fitting Early stopping stop growing the tree at a certain depth Pruning For decision trees, you want to get rid parts of the tree that don t really matter for the classification. Mitchell, 1997
80 Assessing a Classification System With problems of over-fitting, noisy and incomplete data, it is necessary to assess the effectiveness of a learned system. Can only verify the correctness of a classification, when the correct classification is already known. Cross-validation uses a portion of the training data to validate the method Mitchell, 1997
81 Cross-Validation
82
83 AIM in clinical practice Acute care systems Decision support systems Educational systems Laboratory systems Medial Imaging Quality assurance and administration
84 Clinical Decision Support System CDSS/CDS Computer software that is designed to provide assistance for physicians and other health professionals in regards to decision making tasks. Clinical DSSs are typically designed to integrate a medical knowledge base, patient data and an inference engine to generate case specific advice.
85 Medical Diagnosis Requirements Good performance Performance of physicians can be used as a lower bounds to measure performance of algorithms Deal with missing data Patient records may lack data Deal with noisy data Data has uncertainty and errors Transparency of diagnostic knowledge Physicians should be able to analyze and understand the generated knowledge Ability to explain decisions Given an unexpected answer, the physician will require additional explanation in order to seriously consider the system s suggestion Reduce the number of tests needed Tests are costly and time consuming, the system should be able to reliably diagnose a patient based on limited amount of data Igor Kononenko, 2001 and Mitchell, 1997
86 Performance Comparison of ML Methods Classifier Performance Transparency Explanation Reduction Missing data Decision Trees Good Very Good Good Good Acceptable Naive Bayes Very Good Good Very Good No Very Good Neural Network Very Good Poor Poor No Acceptable K-NN Very Good Poor Acceptable No Acceptable The Naive Bayes classifier, though simple, is one of the best classification methods for medical diagnosis. Results extrapolated from Igor Kononenko, 2001 and Mitchell, 1997
87 Future Trends in AIM Looking at the reliability of a single prediction instead of overall reliability of the method. Machine learning in complementary medicine, to verify some unexplained phenomena. Evaluate the effect of different t-shirts on the human bio-electromagnetic (BEM) field. Evaluate the effect of cell phones on the human BEM field.
88
89 Summary AI is the study and design of intelligent agents AIM is the application of AI in any aspect of the medical field Machine Learning techniques are used when learning (adapt to new information) is needed Decision Trees and the Naive Bayes classifier are methods used to solve classification problems
90 Summary Classification Given an instance, need to predict in what class it belongs. An instance consists of set of attributes (Windy, Outlook, Temperature, Humidity...) each with a finite set of values (Windy={Weak, Strong}, Humidity={High, Normal}...) Training data includes a set of instances with their correct classifications.
91 Summary Validation is the stage in which the learned system is tested. AI is used in Acute care systems Decision support systems Educational systems Laboratory systems Medial Imaging Quality assurance and administration
92 T.M. Mitchell. Machine Learning. McGraw-Hill Series in Computer Science. McGraw-Hill, S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall Series in Artificial Intelligence. Prentice Hall, Igor Kononenko. Machine learning for medical diagnosis: history, state of the art and perspective. Aritificial Intelligence in Medicine, 23(1):89 109, 2001 "Decision support systems" March <
Lazy Associative Classification
Lazy Associative Classification By Adriano Veloso,Wagner Meira Jr., Mohammad J. Zaki Presented by: Fariba Mahdavifard Department of Computing Science University of Alberta Decision Tree (Eager) Associative
More informationCS343: Artificial Intelligence
CS343: Artificial Intelligence Introduction: Part 2 Prof. Scott Niekum University of Texas at Austin [Based on slides created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All materials
More informationPART - A 1. Define Artificial Intelligence formulated by Haugeland. The exciting new effort to make computers think machines with minds in the full and literal sense. 2. Define Artificial Intelligence
More informationArtificial Intelligence Programming Probability
Artificial Intelligence Programming Probability Chris Brooks Department of Computer Science University of San Francisco Department of Computer Science University of San Francisco p.1/25 17-0: Uncertainty
More informationKECERDASAN BUATAN 3. By Sirait. Hasanuddin Sirait, MT
KECERDASAN BUATAN 3 By @Ir.Hasanuddin@ Sirait Why study AI Cognitive Science: As a way to understand how natural minds and mental phenomena work e.g., visual perception, memory, learning, language, etc.
More informationWhat is Artificial Intelligence? A definition of Artificial Intelligence. Systems that act like humans. Notes
What is? It is a young area of science (1956) Its goals are what we consider Intelligent behaviour There are many approaches from different points of view It has received influence from very diverse areas
More informationArtificial Intelligence. Admin.
15-381 Artificial Intelligence Admin. Instructor: Martial Hebert, NSH 4101, x8-2585 Textbook: Recommended (optional) textbook: Russell and Norvig's "Artificial Intelligence: A Modern Approach (2 nd edition)
More informationEEL-5840 Elements of {Artificial} Machine Intelligence
Menu Introduction Syllabus Grading: Last 2 Yrs Class Average 3.55; {3.7 Fall 2012 w/24 students & 3.45 Fall 2013} General Comments Copyright Dr. A. Antonio Arroyo Page 2 vs. Artificial Intelligence? DEF:
More informationLecture 2: Foundations of Concept Learning
Lecture 2: Foundations of Concept Learning Cognitive Systems - Machine Learning Part I: Basic Approaches to Concept Learning Version Space, Candidate Elimination, Inductive Bias last change October 18,
More informationWhat is AI? The science of making machines that:
What is AI? The science of making machines that: Think like humans Think rationally Act like humans Act rationally Thinking Like Humans? The cognitive science approach: 1960s ``cognitive revolution'':
More informationArtificial Intelligence
Politecnico di Milano Artificial Intelligence Artificial Intelligence From intelligence to rationality? Viola Schiaffonati viola.schiaffonati@polimi.it Can machine think? 2 The birth of Artificial Intelligence
More informationExpert System Profile
Expert System Profile GENERAL Domain: Medical Main General Function: Diagnosis System Name: INTERNIST-I/ CADUCEUS (or INTERNIST-II) Dates: 1970 s 1980 s Researchers: Ph.D. Harry Pople, M.D. Jack D. Myers
More informationLecture 3: Bayesian Networks 1
Lecture 3: Bayesian Networks 1 Jingpeng Li 1 Content Reminder from previous lecture: Bayes theorem Bayesian networks Why are they currently interesting? Detailed example from medical diagnostics Bayesian
More information1 What is an Agent? CHAPTER 2: INTELLIGENT AGENTS
1 What is an Agent? CHAPTER 2: INTELLIGENT AGENTS http://www.csc.liv.ac.uk/ mjw/pubs/imas/ The main point about agents is they are autonomous: capable of acting independently, exhibiting control over their
More informationArtificial Intelligence For Homeopathic Remedy Selection
Artificial Intelligence For Homeopathic Remedy Selection A. R. Pawar, amrut.pawar@yahoo.co.in, S. N. Kini, snkini@gmail.com, M. R. More mangeshmore88@gmail.com Department of Computer Science and Engineering,
More informationCOURSE DESCRIPTIONS 科目簡介
COURSE DESCRIPTIONS 科目簡介 COURSES FOR 4-YEAR UNDERGRADUATE PROGRAMMES PSY2101 Introduction to Psychology (3 credits) The purpose of this course is to introduce fundamental concepts and theories in psychology
More informationArtificial Intelligence Lecture 7
Artificial Intelligence Lecture 7 Lecture plan AI in general (ch. 1) Search based AI (ch. 4) search, games, planning, optimization Agents (ch. 8) applied AI techniques in robots, software agents,... Knowledge
More informationCS324-Artificial Intelligence
CS324-Artificial Intelligence Lecture 3: Intelligent Agents Waheed Noor Computer Science and Information Technology, University of Balochistan, Quetta, Pakistan Waheed Noor (CS&IT, UoB, Quetta) CS324-Artificial
More informationVisual book review 1 Safe and Sound, AI in hazardous applications by John Fox and Subrata Das
Visual book review 1 Safe and Sound, AI in hazardous applications by John Fox and Subrata Das Boris Kovalerchuk Dept. of Computer Science Central Washington University, Ellensburg, WA 98926-7520 borisk@cwu.edu
More informationAI and Philosophy. Gilbert Harman. Thursday, October 9, What is the difference between people and other animals?
AI and Philosophy Gilbert Harman Thursday, October 9, 2008 A Philosophical Question about Personal Identity What is it to be a person? What is the difference between people and other animals? Classical
More informationCS 4365: Artificial Intelligence Recap. Vibhav Gogate
CS 4365: Artificial Intelligence Recap Vibhav Gogate Exam Topics Search BFS, DFS, UCS, A* (tree and graph) Completeness and Optimality Heuristics: admissibility and consistency CSPs Constraint graphs,
More informationApplication of artificial intelligence in military aptitude tests
AARMS Vol. 6, No. 4 (2007) 785 790 EDUCATION Application of artificial intelligence in military aptitude tests ATTILA KIRÁDY Miklós Zrínyi National Defence University, Budapest, Hungary The projective
More informationBayes Theorem Application: Estimating Outcomes in Terms of Probability
Bayes Theorem Application: Estimating Outcomes in Terms of Probability The better the estimates, the better the outcomes. It s true in engineering and in just about everything else. Decisions and judgments
More informationCOMP329 Robotics and Autonomous Systems Lecture 15: Agents and Intentions. Dr Terry R. Payne Department of Computer Science
COMP329 Robotics and Autonomous Systems Lecture 15: Agents and Intentions Dr Terry R. Payne Department of Computer Science General control architecture Localisation Environment Model Local Map Position
More informationIntelligent Machines That Act Rationally. Hang Li Bytedance AI Lab
Intelligent Machines That Act Rationally Hang Li Bytedance AI Lab Four Definitions of Artificial Intelligence Building intelligent machines (i.e., intelligent computers) Thinking humanly Acting humanly
More informationMarcus Hutter Canberra, ACT, 0200, Australia
Marcus Hutter Canberra, ACT, 0200, Australia http://www.hutter1.net/ Australian National University Abstract The approaches to Artificial Intelligence (AI) in the last century may be labelled as (a) trying
More informationCPS331 Lecture: Coping with Uncertainty; Discussion of Dreyfus Reading
CPS331 Lecture: Coping with Uncertainty; Discussion of Dreyfus Reading Objectives: 1. To discuss ways of handling uncertainty (probability; Mycin CF) 2. To discuss Dreyfus views on expert systems Materials:
More informationMechanical rationality, decision making and emotions
Mechanical rationality, decision making and emotions Olga Markič University of Ljubljana olga.markic@guest.arnes.si 1. Rationality - Instrumental rationality and negative view of emotion 2. The possibility
More informationImplementation of Perception Classification based on BDI Model using Bayesian Classifier
Implementation of Perception Classification based on BDI Model using Bayesian Classifier Vishwanath Y 1 Murali T S 2 Dr M.V Vijayakumar 3 1 Research Scholar, Dept. of Computer Science & Engineering, Jain
More informationDefinitions. The science of making machines that: This slide deck courtesy of Dan Klein at UC Berkeley
Definitions The science of making machines that: Think like humans Think rationally Act like humans Act rationally This slide deck courtesy of Dan Klein at UC Berkeley Acting Like Humans? Turing (1950)
More informationAppendix I Teaching outcomes of the degree programme (art. 1.3)
Appendix I Teaching outcomes of the degree programme (art. 1.3) The Master graduate in Computing Science is fully acquainted with the basic terms and techniques used in Computing Science, and is familiar
More informationIntelligent Machines That Act Rationally. Hang Li Toutiao AI Lab
Intelligent Machines That Act Rationally Hang Li Toutiao AI Lab Four Definitions of Artificial Intelligence Building intelligent machines (i.e., intelligent computers) Thinking humanly Acting humanly Thinking
More informationIntroduction to Machine Learning. Katherine Heller Deep Learning Summer School 2018
Introduction to Machine Learning Katherine Heller Deep Learning Summer School 2018 Outline Kinds of machine learning Linear regression Regularization Bayesian methods Logistic Regression Why we do this
More informationPredicting Breast Cancer Survivability Rates
Predicting Breast Cancer Survivability Rates For data collected from Saudi Arabia Registries Ghofran Othoum 1 and Wadee Al-Halabi 2 1 Computer Science, Effat University, Jeddah, Saudi Arabia 2 Computer
More informationKnowledge Based Systems
Knowledge Based Systems Human Expert A human expert is a specialist for a specific differentiated application field who creates solutions to customer problems in this respective field and supports them
More informationCS 771 Artificial Intelligence. Intelligent Agents
CS 771 Artificial Intelligence Intelligent Agents What is AI? Views of AI fall into four categories 1. Thinking humanly 2. Acting humanly 3. Thinking rationally 4. Acting rationally Acting/Thinking Humanly/Rationally
More informationModels for Inexact Reasoning. Imprecision and Approximate Reasoning. Miguel García Remesal Department of Artificial Intelligence
Models for Inexact Reasoning Introduction to Uncertainty, Imprecision and Approximate Reasoning Miguel García Remesal Department of Artificial Intelligence mgremesal@fi.upm.es Uncertainty and Imprecision
More informationPositive and Unlabeled Relational Classification through Label Frequency Estimation
Positive and Unlabeled Relational Classification through Label Frequency Estimation Jessa Bekker and Jesse Davis Computer Science Department, KU Leuven, Belgium firstname.lastname@cs.kuleuven.be Abstract.
More informationPositive and Unlabeled Relational Classification through Label Frequency Estimation
Positive and Unlabeled Relational Classification through Label Frequency Estimation Jessa Bekker and Jesse Davis Computer Science Department, KU Leuven, Belgium firstname.lastname@cs.kuleuven.be Abstract.
More informationArtificial Doctors In A Human Era
Artificial Doctors In A Human Era The term Artificial Intelligence (AI) is overused today. Unfortunately, this often leads to a misunderstanding of what AI is. Artificial intelligence is an umbrella term
More informationOverview. cis32-spring2003-parsons-lect15 2
EXPERT SYSTEMS Overview The last lecture looked at rules as a technique for knowledge representation. In a while we will go on to look at logic as a means of knowledge representation. First, however, we
More informationA Comparison of Collaborative Filtering Methods for Medication Reconciliation
A Comparison of Collaborative Filtering Methods for Medication Reconciliation Huanian Zheng, Rema Padman, Daniel B. Neill The H. John Heinz III College, Carnegie Mellon University, Pittsburgh, PA, 15213,
More informationAn expert system (Autodoc) for diagnosing diseases and prescribing medication using visual basic.net
Information Technology Research Journal Vol.2(2), pp. 20 24, November, 2012 Available online http://resjournals.com/itj ISSN: 2026-6715 2012 International Research Journals Full Length Research Paper An
More informationOverview EXPERT SYSTEMS. What is an expert system?
EXPERT SYSTEMS Overview The last lecture looked at rules as a technique for knowledge representation. In a while we will go on to look at logic as a means of knowledge representation. First, however, we
More informationOscillatory Neural Network for Image Segmentation with Biased Competition for Attention
Oscillatory Neural Network for Image Segmentation with Biased Competition for Attention Tapani Raiko and Harri Valpola School of Science and Technology Aalto University (formerly Helsinki University of
More informationFuzzy Decision Tree FID
Fuzzy Decision Tree FID Cezary Z. Janikow Krzysztof Kawa Math & Computer Science Department Math & Computer Science Department University of Missouri St. Louis University of Missouri St. Louis St. Louis,
More informationA Theory of Complexity and its Relevance to Better Decision Making
A Theory of Complexity and its Relevance to Better Decision Making Author Denis Hicks 1, Glocomnet, European Institute for Industrial Leadership, Brussels, Belgium Published 1 st September 2017 The idea
More informationFodor on Functionalism EMILY HULL
Fodor on Functionalism EMILY HULL Deficiencies in Other Theories Dualism Failure to account for mental causation Immaterial substance cannot cause physical events If mental processes were a different substance
More informationAI and Philosophy. Gilbert Harman. Tuesday, December 4, Early Work in Computational Linguistics (including MT Lab at MIT)
AI and Philosophy Gilbert Harman Tuesday, December 4, 2007 My Background Web site http://www.princeton.edu/~harman Philosophy Early Work in Computational Linguistics (including MT Lab at MIT) Cognitive
More informationResearch Methodology in Social Sciences. by Dr. Rina Astini
Research Methodology in Social Sciences by Dr. Rina Astini Email : rina_astini@mercubuana.ac.id What is Research? Re ---------------- Search Re means (once more, afresh, anew) or (back; with return to
More informationChapter 2. Knowledge Representation: Reasoning, Issues, and Acquisition. Teaching Notes
Chapter 2 Knowledge Representation: Reasoning, Issues, and Acquisition Teaching Notes This chapter explains how knowledge is represented in artificial intelligence. The topic may be launched by introducing
More informationFleishman s Taxonomy of Human Abilities
Fleishman s Taxonomy of Human Abilities Ability Taxonomy: Introduction At I/O Solutions, we utilize research to build selection tools that are effective and valid. Part of this effort is to use an ability
More informationIdentifying Parkinson s Patients: A Functional Gradient Boosting Approach
Identifying Parkinson s Patients: A Functional Gradient Boosting Approach Devendra Singh Dhami 1, Ameet Soni 2, David Page 3, and Sriraam Natarajan 1 1 Indiana University Bloomington 2 Swarthmore College
More informationA Scoring Policy for Simulated Soccer Agents Using Reinforcement Learning
A Scoring Policy for Simulated Soccer Agents Using Reinforcement Learning Azam Rabiee Computer Science and Engineering Isfahan University, Isfahan, Iran azamrabiei@yahoo.com Nasser Ghasem-Aghaee Computer
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single
More informationMuddy Tasks and the Necessity of Autonomous Mental Development
Muddy Tasks and the Necessity of Autonomous Mental Development Juyang Weng Embodied Intelligence Laboratory Department of Computer Science and Engineering Michigan State University East Lansing, MI 48824
More informationL6: Overview. with side orders of lecture revision, pokemon, and silly experiments. Dani Navarro
L6: Overview with side orders of lecture revision, pokemon, and silly experiments Dani Navarro Part 1: Dani Navarro L1: Introduction L2: Attention L3: Similarity L4: Reasoning L5: A case study Part 2:
More informationNatural Scene Statistics and Perception. W.S. Geisler
Natural Scene Statistics and Perception W.S. Geisler Some Important Visual Tasks Identification of objects and materials Navigation through the environment Estimation of motion trajectories and speeds
More informationDesign Methodology. 4th year 1 nd Semester. M.S.C. Madyan Rashan. Room No Academic Year
College of Engineering Department of Interior Design Design Methodology 4th year 1 nd Semester M.S.C. Madyan Rashan Room No. 313 Academic Year 2018-2019 Course Name Course Code INDS 315 Lecturer in Charge
More informationLesson 87 Bayes Theorem
Lesson 87 Bayes Theorem HL2 Math - Santowski Bayes Theorem! Main theorem: Suppose we know We would like to use this information to find if possible. Discovered by Reverend Thomas Bayes 1 Bayes Theorem!
More informationPHLA The Philosophy of Mind - II
The Philosophy of Mind - II Three non-dualist theories of mind Behaviourism Mind/Brain Identity Theory Functionalism They all agree that a materialist viewpoint is the most promising starting point for
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis
More informationSupport system for breast cancer treatment
Support system for breast cancer treatment SNEZANA ADZEMOVIC Civil Hospital of Cacak, Cara Lazara bb, 32000 Cacak, SERBIA Abstract:-The aim of this paper is to seek out optimal relation between diagnostic
More informationRepresentativeness heuristics
Representativeness heuristics 1-1 People judge probabilities by the degree to which A is representative of B, that is, by the degree to which A resembles B. A can be sample and B a population, or A can
More informationCausal Knowledge Modeling for Traditional Chinese Medicine using OWL 2
Causal Knowledge Modeling for Traditional Chinese Medicine using OWL 2 Peiqin Gu College of Computer Science, Zhejiang University, P.R.China gupeiqin@zju.edu.cn Abstract. Unlike Western Medicine, those
More informationIs it possible to gain new knowledge by deduction?
Is it possible to gain new knowledge by deduction? Abstract In this paper I will try to defend the hypothesis that it is possible to gain new knowledge through deduction. In order to achieve that goal,
More informationModule 1. Introduction. Version 1 CSE IIT, Kharagpur
Module 1 Introduction Lesson 2 Introduction to Agent 1.3.1 Introduction to Agents An agent acts in an environment. Percepts Agent Environment Actions An agent perceives its environment through sensors.
More informationThe Limits of Artificial Intelligence
The Limits of Artificial Intelligence The Limits of Artificial Intelligence What does it mean to think or to feel? What is mind? Does mind really exist? To what extent are minds functionally dependent
More informationHypothesis-Driven Research
Hypothesis-Driven Research Research types Descriptive science: observe, describe and categorize the facts Discovery science: measure variables to decide general patterns based on inductive reasoning Hypothesis-driven
More informationErrol Davis Director of Research and Development Sound Linked Data Inc. Erik Arisholm Lead Engineer Sound Linked Data Inc.
An Advanced Pseudo-Random Data Generator that improves data representations and reduces errors in pattern recognition in a Numeric Knowledge Modeling System Errol Davis Director of Research and Development
More informationThe Scientific Method
Course "Empirical Evaluation in Informatics" The Scientific Method Prof. Dr. Lutz Prechelt Freie Universität Berlin, Institut für Informatik http://www.inf.fu-berlin.de/inst/ag-se/ Science and insight
More informationAgents and Environments
Artificial Intelligence Programming s and s Chris Brooks 3-2: Overview What makes an agent? Defining an environment Types of agent programs 3-3: Overview What makes an agent? Defining an environment Types
More informationDAY 2 RESULTS WORKSHOP 7 KEYS TO C HANGING A NYTHING IN Y OUR LIFE TODAY!
H DAY 2 RESULTS WORKSHOP 7 KEYS TO C HANGING A NYTHING IN Y OUR LIFE TODAY! appy, vibrant, successful people think and behave in certain ways, as do miserable and unfulfilled people. In other words, there
More informationNature of Science and Scientific Method Guided Notes
Anything present in the environment, around the world, living, non-living everything is included in science. Science can be knowledge, science can be a fun, it can be a fact, a discovery, a law, a solved
More informationIntroduction and Historical Background. August 22, 2007
1 Cognitive Bases of Behavior Introduction and Historical Background August 22, 2007 2 Cognitive Psychology Concerned with full range of psychological processes from sensation to knowledge representation
More informationHigh-level Vision. Bernd Neumann Slides for the course in WS 2004/05. Faculty of Informatics Hamburg University Germany
High-level Vision Bernd Neumann Slides for the course in WS 2004/05 Faculty of Informatics Hamburg University Germany neumann@informatik.uni-hamburg.de http://kogs-www.informatik.uni-hamburg.de 1 Contents
More informationTowards Learning to Ignore Irrelevant State Variables
Towards Learning to Ignore Irrelevant State Variables Nicholas K. Jong and Peter Stone Department of Computer Sciences University of Texas at Austin Austin, Texas 78712 {nkj,pstone}@cs.utexas.edu Abstract
More informationOverview. What is an agent?
Artificial Intelligence Programming s and s Chris Brooks Overview What makes an agent? Defining an environment Overview What makes an agent? Defining an environment Department of Computer Science University
More informationDynamic Rule-based Agent
International Journal of Engineering Research and Technology. ISSN 0974-3154 Volume 11, Number 4 (2018), pp. 605-613 International Research Publication House http://www.irphouse.com Dynamic Rule-based
More informationPS3021, PS3022, PS4040
School of Psychology Important Degree Information: B.Sc./M.A. Honours The general requirements are 480 credits over a period of normally 4 years (and not more than 5 years) or part-time equivalent; the
More informationUnderstanding the True Realities of Influencing. What do you need to do in order to be Influential?
Understanding the True Realities of Influencing. What do you need to do in order to be Influential? Background and why Influencing is increasingly important? At Oakwood Learning we have carried out our
More information(SAT). d) inhibiting automatized responses.
Which of the following findings does NOT support the existence of task-specific mental resources? 1. a) It is more difficult to combine two verbal tasks than one verbal task and one spatial task. 2. b)
More informationDYNAMICISM & ROBOTICS
DYNAMICISM & ROBOTICS Phil/Psych 256 Chris Eliasmith Dynamicism and Robotics A different way of being inspired by biology by behavior Recapitulate evolution (sort of) A challenge to both connectionism
More informationChoose an approach for your research problem
Choose an approach for your research problem This course is about doing empirical research with experiments, so your general approach to research has already been chosen by your professor. It s important
More informationComputational Neuroscience. Instructor: Odelia Schwartz
Computational Neuroscience 2017 1 Instructor: Odelia Schwartz From the NIH web site: Committee report: Brain 2025: A Scientific Vision (from 2014) #1. Discovering diversity: Identify and provide experimental
More information[1] provides a philosophical introduction to the subject. Simon [21] discusses numerous topics in economics; see [2] for a broad economic survey.
Draft of an article to appear in The MIT Encyclopedia of the Cognitive Sciences (Rob Wilson and Frank Kiel, editors), Cambridge, Massachusetts: MIT Press, 1997. Copyright c 1997 Jon Doyle. All rights reserved
More informationCS221 / Autumn 2017 / Liang & Ermon. Lecture 19: Conclusion
CS221 / Autumn 2017 / Liang & Ermon Lecture 19: Conclusion Outlook AI is everywhere: IT, transportation, manifacturing, etc. AI being used to make decisions for: education, credit, employment, advertising,
More informationKnowledge Structurisation by Multi-agent Approach in a Non-formalizable Subject Area of Health and Medicine
Proceedings of the International Conference of Control, Dynamic Systems, and Robotics Ottawa, Ontario, Canada, May 15-16 2014 Paper No. 102 Knowledge Structurisation by Multi-agent Approach in a Non-formalizable
More informationABSTRACT I. INTRODUCTION. Mohd Thousif Ahemad TSKC Faculty Nagarjuna Govt. College(A) Nalgonda, Telangana, India
International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2018 IJSRCSEIT Volume 3 Issue 1 ISSN : 2456-3307 Data Mining Techniques to Predict Cancer Diseases
More informationArtificial Intelligence
Artificial Intelligence COMP-241, Level-6 Mohammad Fahim Akhtar, Dr. Mohammad Hasan Department of Computer Science Jazan University, KSA Chapter 2: Intelligent Agents In which we discuss the nature of
More informationSCUOLA DI SPECIALIZZAZIONE IN FISICA MEDICA. Sistemi di Elaborazione dell Informazione. Introduzione. Ruggero Donida Labati
SCUOLA DI SPECIALIZZAZIONE IN FISICA MEDICA Sistemi di Elaborazione dell Informazione Introduzione Ruggero Donida Labati Dipartimento di Informatica via Bramante 65, 26013 Crema (CR), Italy http://homes.di.unimi.it/donida
More informationProbability and Sample space
Probability and Sample space We call a phenomenon random if individual outcomes are uncertain but there is a regular distribution of outcomes in a large number of repetitions. The probability of any outcome
More informationLECTURE 5: REACTIVE AND HYBRID ARCHITECTURES
Reactive Architectures LECTURE 5: REACTIVE AND HYBRID ARCHITECTURES An Introduction to MultiAgent Systems http://www.csc.liv.ac.uk/~mjw/pubs/imas There are many unsolved (some would say insoluble) problems
More informationModeling State Space Search Technique for a Real World Adversarial Problem Solving
Modeling State Space Search Technique for a Real World Adversarial Problem Solving Kester O. OMOREGIE Computer Science Department, Auchi Polytechnic, Auchi, NIGERIA Stella C. CHIEMEKE Computer Science
More informationThe Nature of Science: What is Science? A Effective Synthesis for Science Instruction. What is Science, Really?
The Nature of : A Missing Foundation for Teaching and Learning International Education Conference Singapore 2006 William F. McComas, Ph.D. Parks Family Professor of Education College of Education and Health
More informationCourse Departmental Prefix and #: Title: Course Departmental Prefix and #: Title: Course Departmental Prefix and #: Title:
Psychology Major Tracking Sheet AB Requirements Eleven (11) courses in psychology are required for the major. The major is devised to provide breadth and depth, a small group course in psychology, and
More informationDeliberating on Ontologies: The Present Situation. Simon Milton Department of Information Systems, The University of Melbourne
Deliberating on Ontologies: The Present Situation Simon Milton Department of, The University of Melbourne 1. Helping data models better map the world 2. Finding the role of ontology where theories of agency
More informationThe Six Thinking Hats
The Six Thinking Hats Make Winning Presentations Run Effective Meetings Steve Carr support@twocarrs.com @theothercarr www.twocarrs.com/scarr 1 Your Typical Planning Meeting That went well 2 Why are meetings
More information