Agents and Environments
|
|
- Clement Carpenter
- 6 years ago
- Views:
Transcription
1 Artificial Intelligence Programming s and s Chris Brooks 3-2: Overview What makes an agent? Defining an environment Types of agent programs 3-3: Overview What makes an agent? Defining an environment Types of agent programs Department of Computer Science University of San Francisco cisco p. 1/?? cisco p. 2/?? Department of Computer Science University of San Fra 3-4: Intelligent s The idea of developing intelligent agents has been a unifying one for AI. Previously, subdisciplines were fairly balkanized. Learning, knowledge representation, search, vision, etc. programs that may require several of these abilities. 3-5: What is an agent? There are lots of potential definitions... R & N: An agent is anything that can be viewed as perceiving its environment through sensors and acting on that environment through actuators. Woolridge: An agent is a computer system that is situated in an environment and is capable of autonomous action. 3-6: Qualities of an agent Autonomy Adaptation Goal-directed behavior Has beliefs and intentions Proactive Situated within an environment cisco p. 4/?? cisco p. 5/?? Department of Computer Science University of San Fra
2 3-7: Autonomy Autonomy is a quality often attributed to agents. An autonomous agent is able to rely on its percepts and past experience to make decisions, rather than asking a human for help. This is a thorny area - most agents will not have complete autonomy. When might we not want an agent to have complete autonomy? Challenge: Designing an agent that can reason about its own autonomy and know when to ask for help. 3-8: -oriented Programming We can also think of agents as a programming paradigm. The next logical step after objects. Objects do it for free, agents do it for money. Objects are receivers of actions, agents are actors. It s less useful to think of agent as an objective label than as a subjective description. Agency is a useful abstraction for us as programmers. Allows us to think about a program at a higher level. Treat something as an agent if that helps to understand, predict, or explain its behavior. Thermostats as agents 3-9: Usefulness of the agent metaphor Why bother with all this? We already know how to write programs. s tend to be open-ended programs Difficult to specify in advance what they should do in all cases. It s helpful to talk about them as if they were intelligent. The robot wants to find the power supply. The server believes that the client has reset. This assigning of mental states to programs is called the intentional stance. cisco p. 7/?? cisco p. 8/?? Department of Computer Science University of San Fra 3-10: s and s 3-11: Programs 3-12: Example: Vacuum-cleaner World? Percepts Actions One shift from other courses: we ll think explicitly about an agent s environment and how that affects execution. Percepts: Information delivered to an agent s sensors. (light, sound, EM waves, signals) : An agent s mechanisms for gathering data about its environment. (eyes, ears, photoelectric cells,...) : An agent s mechanisms for affecting its environment. (Wheels, arms, radios, lights, etc) Actions: Actual changes to the environment. (running, rolling) We can describe our agent s behavior as a function F: Action = F(current-percept, percept-history). Maps a percept sequence to an action. Actually implementing this function is the work of an agent program. That s what we ll spend most of our time on. Robotic vacuum cleaners are actually on the market. $150 at Amazon A reflex agent (mostly) cisco p. 10/?? cisco p. 11/??
3 3-13: Example: Vacuum-cleaner World A Let s start with a very simple approximation. Two rooms, A and B. Each room can be either clean or dirty. This is the agent s environment. B : Dirt sensor, location. : Vacuum, wheels. Percepts: Clean, Dirty Actions: Move left, move right, suck, do nothing. 3-14: Example: Vacuum-cleaner World In this simple world, we could list all the possible percept sequences and associated actions. This is known as a table-based or lookup agent. Question: How do we fill in the best action for each percept sequence? Great for simple worlds, but doesn t scale. We need a more compact representation for this table. 3-15: Rationality Roughly, rationality means doing the right thing More precision is needed - what is the right thing? We need a definition of success. Begin with a performance measure This is a condition or state of the world we d like the agent to achieve. Both rooms are clean. (perhaps more criteria, such as minimizing time, power consumed, or number of actions taken) We might prefer a scalar measure or a boolean condition. cisco p. 13/?? cisco p. 14/?? 3-16: Rationality Notice that this is a specification of an outcome, rather than how an agent should behave. A rational action is one that tries to maximize an agent s performance measure, given its percepts and actions. R & N: Rational agents: For each possible percept sequence, a rational agent should select an action that is expected to maximize its performance measure, given the evidence provided by the percept sequence and whatever built-in knowledge the agent has. 3-17: Rationality expected vs. actual. We don t require that our agent be able to predict the future, or predict unlikely events. Information gathering might also be a rational action. Crossing the street without looking is irrational Rational agents must be able to learn (except in very simple, well-understood environments). Learning is defined as improving an agent s performance. This could mean reducing uncertainty, or taking observations into account. 3-18: Overview What makes an agent? Defining an environment Types of agent programs cisco p. 16/?? cisco p. 17/??
4 3-19: s A criterion for being an agent is existing in an environment. Not necessarily physical - could be a software environment. R & N refer to the task environment Consists of: Performance measure available to the agent available to the agent 3-20: Characteristics of the Observability Deterministic/stochastic Episodic vs sequential Static vs Dynamic Discrete vs continuous Single-agent vs multi-agent 3-21: Observability The environment is fully observable if the agent s sensors always give it complete information about the relevant parts of the environment. Is there anything the agent needs to know that it cannot sense? Chess-playing: fully observable. What about the other player? Vacuum cleaner: partially observable (can t see if there s dirt in the adjacent square) cisco p. 19/?? cisco p. 20/?? 3-22: Deterministic/stochastic We can think of the world as going through state transitions. CurrentState agentactions newstate If the state transition is unique, the world is deterministic. Does an action always produce the same result? chess-playing: deterministic Vacuum world: deterministic Driving a car: stochastic 3-23: Deterministic/stochastic Note: we re avoiding splitting hairs with quantum-mechanical questions here - it s possible that the world could be deterministic, but appear stochastic due to its complexity. How does the world appear to the agent. 3-24: Episodic vs Sequential Episodic: each action is independent. perceives, decides, acts. Start again. Next decision does not depend on previous states. A spam-filtering agent is episodic. If the agent must take a series of actions to accomplish a task or achieve a goal, the environment is sequential. Future decisions must be considered. Driving a car is sequential. cisco p. 22/?? cisco p. 23/??
5 3-25: Static vs Dynamic A static environment holds still while the agent is deciding on an action. is not under time pressure to come to a decision. Spam-filtering is static. Chess-playing is static. A dynamic environment changes while the agent is deciding what action to take. Harder: the agent must act quickly enough Driving a car is dynamic 3-26: Static vs Dynamic Semidynamic: the environment doesn t change, but the performance measure changes over time. Taking a timed test playing chess with a clock. Still pressure to act quickly. 3-27: Discrete vs. Continuous We can talk about discrete vs continuous in terms of the agent s percepts, actions, or possible states of the environment. If the possible values for any of these are a discrete set, then the environment is discrete wrt that characteristic. Discrete is not the same as finite. A spam-filtering environment is discrete, even though there s a (countably) infinite number of possible s. cisco p. 25/?? cisco p. 26/?? 3-28: Discrete vs. Continuous A continuous environment has continuously-changing variables. Steering angles in a car-driving environment. Real-valued sensor readings. (we can split hairs about precision here; the point is whether or not there s a distinguishable change between two values) Time is the element we ll often be concerned with. 3-29: Single-agent vs. Multiagent Single-agent. Our agent is acting on its own. World may still be stochastic Spam-filtering is single-agent. Multi-agent: The actions/goals/strategies of other agents must be taken into account. Chess-playing, bidding in an auction Issues Even though a world may have other agents, we may choose to treat it as single-agent and stochastic for complexity reasons. e.g. an agent controlling traffic signals. Cooperative vs. Competitive 3-30: Some examples Chess-playing, Monopoly-playing, slot-machine playing Robot getting me coffee in Harney Mars orbiter Web-crawling agent Conversational agent Medical diagnosis agent cisco p. 28/?? cisco p. 29/??
6 3-31: Overview What makes an agent? Defining an environment Types of agent programs 3-32: Types of agent programs Typically, we can t enumerate every possible percept sequence and action. Too many possibilities. We as programmers may not know what to do for each sequence. We may not understand the problem well enough. Need to create a more compact representation. 3-33: Types of agent programs Table-driven agent Reflex agent Model-based reflex agent Goal-based agent Utility-based agent Learning agent cisco p. 31/?? cisco p. 32/?? 3-34: Table-driven agent 3-35: Examples of table-driven agents 3-36: Reflex agent Keep a dictionary that maps percept sequences to actions. Exception handlers Given the current percept, select an action. class TableDriven(): """This agent selects an action based on the percept sequence. It is practical only for tiny domains.""" def init (self, table): #Supply as table a dictionary of all {percept_sequence:action} pairs. percepts = [] def program(percept): percepts.append(percept) action = table.get(tuple(percepts)) return action Square root/logarithm tables Won t scale to AI environments. Chess: percept sequences. And this is an easy environment. Deterministic, fully observable. Taxi driving: ,000,000,000 entries for one hour of driving. Also: highly redundant and uninformative Many percept sequences may lead to the same action. Designer has no guidance as to how to fill in the table. Ignore history. Condition-action rules What the world is like now What action I should do now cisco p. 34/?? cisco p. 35/??
7 3-37: Reflex agent Given the current percept, select an action. class ReflexVacuum(): "A reflex agent for the two-state vacuum environment. [Fig. 2.8]" def program((location, status)): if status == Dirty : return Suck elif location == loc_a: return Right elif location == loc_b: return Left This agent will only be rational if the best action can be chosen based only on the current percepts. 3-38: Reflex s Examples of reflex agents Thermostat agent Spam-filtering agent (sometimes) Insight: table can be represented more compactly as a set of condition-action rules. Problems: Writing rules that apply in all cases is hard. Often it s necessary to remember some of the past. 3-39: Model-based reflex agent A model-based reflex agent maintains an internal representation of the world. Actions are selected based on the model and the current percepts. State How the world evolves What my actions do Condition-action rules What the world is like now What action I should do now cisco p. 37/?? cisco p. 38/?? 3-40: Model-based reflex agent A model-based reflex agent maintains an internal representation of the world. Sometimes we ll refer to this as keeping state about the world. Actions are selected based on the model and the current percepts. class ModelBasedVacuum(): "An agent that keeps track of what locations are clean or dirty." def init (self): model = loc_a: None, loc_b: None def program((location, status)): "Same as ReflexVacuum, except if everything is clean, do NoOp" model[location] = status ## Update the model here if model[loc_a] == model[loc_b] == Clean : return NoOp elif status == Dirty : return Suck elif location == loc_a: return Right elif location == loc_b: return Left 3-41: Model-based reflex agent Maintaining a representation of the environment is extremely useful. Allows the agent to remember things. Can anticipate future events. Can make predictions about unseen parts of the environment. Still uses rules, conditioned on the model and the sensors. Much of our time will be spent constructing and manipulating models. 3-42: Model-based reflex agent Examples of model-based agents Vacuum-cleaner agent (with a map) Spam-filtering agent (maybe) Factory robots cisco p. 40/?? cisco p. 41/??
8 3-43: Types of models 3-44: Goal-based agent 3-45: Goal-based agent Attributes and values Probability distributions over variables Data structures Maps Graphs Finite State Machines Facts about the world State How the world evolves What my actions do Goals What the world is like now What it will be like if I do action A What action I should do now Knowing the current state of the environment is not always enough. The right action may also depend upon what the agent is trying to accomplish. Select actions that will help accomplish goals. Search and planning are used to solve this problem. Goal-based reasoning is very useful for sequential environments. Chess-playing Taxi driving Spaceship piloting The right action to take for a given percept sequence depends upon the agent s knowledge (its model), its current state (percepts) and what it is trying to achieve currently. Future lectures will look at using search to accomplish goals. cisco p. 43/?? cisco p. 44/?? 3-46: Utility-based agent 3-47: Utility-based agent 3-48: Utility-based agent Goals may not be enough in high-complexity environments. There may be many action sequences that achieve a goal. Utility is used to compare the relative desirability of action sequences. Maps states to real numbers. Can be an estimate of cost, time, or relative value of different outcomes. Utilities are very useful in dealing with partially observable or stochastic environments. State How the world evolves What my actions do Utility What the world is like now What it will be like if I do action A How happy I will be in such a state What action I should do now Utilities are sometimes a controversial issue in AI. Assumption: outcomes can be linearly ordered (with ties) on a consistent scale. Example: Taxi driving agent. What is the utility of driving off the Bay Bridge? Requires designer to explicitly evaluate outcomes. (Qualitative vs quantitative) Utilities are very useful in domains with probability and/or money. Online trading, exploration in uncertain environments, gambling. cisco p. 46/?? cisco p. 47/??
9 3-49: Learning 3-50: Learning 3-51: Learning Often, an agent may need to update its agent program. Programmers may not completely understand the environment. The environment may change over time. Coding by hand may be tedious. A learning agent is one that improves its performance wrt a set of tasks over time. Learning (or adaptation) is essential in complex environments. A learning agent needs both a performance element and a learning element Performance element: Select current action(s) Learning element: evaluate the correctness of the performance element. Performance standard feedback learning goals Critic Learning element changes knowledge Performance element Problem generator cisco p. 49/?? cisco p. 50/?? 3-52: Learning 3-53: Summary 3-54: Next week(s)... Learning can happen offline or online. Learning can be passive or active. Learning can be supervised or unsupervised. Credit assignment is a big problem when learning in sequential environments. Often, learning is treated as a separate topic in AI; we ll try to integrate it in with other topics. An agent is an autonomous program situated in an environment. An agent behaves rationally if it acts to optimize its expected performance measure. Characterizing the environment can help us decide how to build an agent. More complex environments often require more sophisticated agent programs. We get into our first meaty topic: search. We ll look at how agents can perform goal-directed behavior by searching through a space of possible outcomes. Uninformed search. Applying domain knowledge - heuristic search, constraint satisfaction Searching enormous spaces: genetic algorithms and simulated annealing. cisco p. 52/?? cisco p. 53/??
Overview. What is an agent?
Artificial Intelligence Programming s and s Chris Brooks Overview What makes an agent? Defining an environment Overview What makes an agent? Defining an environment Department of Computer Science University
More informationAI Programming CS F-04 Agent Oriented Programming
AI Programming CS662-2008F-04 Agent Oriented Programming David Galles Department of Computer Science University of San Francisco 04-0: Agents & Environments What is an Agent What is an Environment Types
More informationChapter 2: Intelligent Agents
Chapter 2: Intelligent Agents Outline Last class, introduced AI and rational agent Today s class, focus on intelligent agents Agent and environments Nature of environments influences agent design Basic
More informationAgents and Environments
Agents and Environments Berlin Chen 2004 Reference: 1. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Chapter 2 AI 2004 Berlin Chen 1 What is an Agent An agent interacts with its
More informationAgents and Environments. Stephen G. Ware CSCI 4525 / 5525
Agents and Environments Stephen G. Ware CSCI 4525 / 5525 Agents An agent (software or hardware) has: Sensors that perceive its environment Actuators that change its environment Environment Sensors Actuators
More informationWeb-Mining Agents Cooperating Agents for Information Retrieval
Web-Mining Agents Cooperating Agents for Information Retrieval Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme Karsten Martiny (Übungen) Literature Chapters 2, 6, 13, 15-17
More informationIntroduction to Artificial Intelligence 2 nd semester 2016/2017. Chapter 2: Intelligent Agents
Introduction to Artificial Intelligence 2 nd semester 2016/2017 Chapter 2: Intelligent Agents Mohamed B. Abubaker Palestine Technical College Deir El-Balah 1 Agents and Environments An agent is anything
More informationIntelligent Agents. Outline. Agents. Agents and environments
Outline Intelligent Agents Chapter 2 Source: AI: A Modern Approach, 2 nd Ed Stuart Russell and Peter Norvig Agents and environments Rationality (Performance measure, Environment, Actuators, Sensors) Environment
More informationArtificial Intelligence
Artificial Intelligence Intelligent Agents Chapter 2 & 27 What is an Agent? An intelligent agent perceives its environment with sensors and acts upon that environment through actuators 2 Examples of Agents
More informationIntelligent Autonomous Agents. Ralf Möller, Rainer Marrone Hamburg University of Technology
Intelligent Autonomous Agents Ralf Möller, Rainer Marrone Hamburg University of Technology Lab class Tutor: Rainer Marrone Time: Monday 12:15-13:00 Locaton: SBS93 A0.13.1/2 w Starting in Week 3 Literature
More informationIntelligent Agents. Chapter 2 ICS 171, Fall 2009
Intelligent Agents Chapter 2 ICS 171, Fall 2009 Discussion \\Why is the Chinese room argument impractical and how would we have to change the Turing test so that it is not subject to this criticism? Godel
More informationCS 771 Artificial Intelligence. Intelligent Agents
CS 771 Artificial Intelligence Intelligent Agents What is AI? Views of AI fall into four categories 1. Thinking humanly 2. Acting humanly 3. Thinking rationally 4. Acting rationally Acting/Thinking Humanly/Rationally
More informationAgents and State Spaces. CSCI 446: Artificial Intelligence
Agents and State Spaces CSCI 446: Artificial Intelligence Overview Agents and environments Rationality Agent types Specifying the task environment Performance measure Environment Actuators Sensors Search
More informationDr. Mustafa Jarrar. Chapter 2 Intelligent Agents. Sina Institute, University of Birzeit
Lecture Notes, Advanced Artificial Intelligence (SCOM7341) Sina Institute, University of Birzeit 2 nd Semester, 2012 Advanced Artificial Intelligence (SCOM7341) Chapter 2 Intelligent Agents Dr. Mustafa
More informationArtificial Intelligence Lecture 7
Artificial Intelligence Lecture 7 Lecture plan AI in general (ch. 1) Search based AI (ch. 4) search, games, planning, optimization Agents (ch. 8) applied AI techniques in robots, software agents,... Knowledge
More informationWeb-Mining Agents Cooperating Agents for Information Retrieval
Web-Mining Agents Cooperating Agents for Information Retrieval Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme Tanya Braun (Übungen) Organizational Issues: Assignments Start:
More informationIntelligent Agents. Soleymani. Artificial Intelligence: A Modern Approach, Chapter 2
Intelligent Agents CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2016 Soleymani Artificial Intelligence: A Modern Approach, Chapter 2 Outline Agents and environments
More informationIntelligent Agents. CmpE 540 Principles of Artificial Intelligence
CmpE 540 Principles of Artificial Intelligence Intelligent Agents Pınar Yolum pinar.yolum@boun.edu.tr Department of Computer Engineering Boğaziçi University 1 Chapter 2 (Based mostly on the course slides
More informationCS 331: Artificial Intelligence Intelligent Agents
CS 331: Artificial Intelligence Intelligent Agents 1 General Properties of AI Systems Sensors Reasoning Actuators Percepts Actions Environment This part is called an agent. Agent: anything that perceives
More informationPrincess Nora University Faculty of Computer & Information Systems ARTIFICIAL INTELLIGENCE (CS 370D) Computer Science Department
Princess Nora University Faculty of Computer & Information Systems 1 ARTIFICIAL INTELLIGENCE (CS 370D) Computer Science Department (CHAPTER-3) INTELLIGENT AGENTS (Course coordinator) CHAPTER OUTLINE What
More informationCS 331: Artificial Intelligence Intelligent Agents
CS 331: Artificial Intelligence Intelligent Agents 1 General Properties of AI Systems Sensors Reasoning Actuators Percepts Actions Environment This part is called an agent. Agent: anything that perceives
More informationArtificial Intelligence. Intelligent Agents
Artificial Intelligence Intelligent Agents Agent Agent is anything that perceives its environment through sensors and acts upon that environment through effectors. Another definition later (Minsky) Humans
More informationIntelligent Agents. BBM 405 Fundamentals of Artificial Intelligence Pinar Duygulu Hacettepe University. Slides are mostly adapted from AIMA
1 Intelligent Agents BBM 405 Fundamentals of Artificial Intelligence Pinar Duygulu Hacettepe University Slides are mostly adapted from AIMA Outline 2 Agents and environments Rationality PEAS (Performance
More informationAgents. This course is about designing intelligent agents Agents and environments. Rationality. The vacuum-cleaner world
This course is about designing intelligent agents and environments Rationality The vacuum-cleaner world The concept of rational behavior. Environment types Agent types 1 An agent is an entity that perceives
More informationIntelligent Agents. Instructor: Tsung-Che Chiang
Intelligent Agents Instructor: Tsung-Che Chiang tcchiang@ieee.org Department of Computer Science and Information Engineering National Taiwan Normal University Artificial Intelligence, Spring, 2010 Outline
More informationArtificial Intelligence Agents and Environments 1
Artificial Intelligence and Environments 1 Instructor: Dr. B. John Oommen Chancellor s Professor Fellow: IEEE; Fellow: IAPR School of Computer Science, Carleton University, Canada. 1 The primary source
More informationFoundations of Artificial Intelligence
Foundations of Artificial Intelligence 2. Rational Agents Nature and Structure of Rational Agents and Their Environments Wolfram Burgard, Bernhard Nebel and Martin Riedmiller Albert-Ludwigs-Universität
More informationCS 331: Artificial Intelligence Intelligent Agents. Agent-Related Terms. Question du Jour. Rationality. General Properties of AI Systems
General Properties of AI Systems CS 331: Artificial Intelligence Intelligent Agents Sensors Reasoning Actuators Percepts Actions Environmen nt This part is called an agent. Agent: anything that perceives
More information22c:145 Artificial Intelligence
22c:145 Artificial Intelligence Fall 2005 Intelligent Agents Cesare Tinelli The University of Iowa Copyright 2001-05 Cesare Tinelli and Hantao Zhang. a a These notes are copyrighted material and may not
More informationIntelligent Agents. Instructor: Tsung-Che Chiang
Intelligent Agents Instructor: Tsung-Che Chiang tcchiang@ieee.org Department of Computer Science and Information Engineering National Taiwan Normal University Artificial Intelligence, Spring, 2010 Outline
More informationContents. Foundations of Artificial Intelligence. Agents. Rational Agents
Contents Foundations of Artificial Intelligence 2. Rational s Nature and Structure of Rational s and Their s Wolfram Burgard, Bernhard Nebel, and Martin Riedmiller Albert-Ludwigs-Universität Freiburg May
More informationAgents & Environments Chapter 2. Mausam (Based on slides of Dan Weld, Dieter Fox, Stuart Russell)
Agents & Environments Chapter 2 Mausam (Based on slides of Dan Weld, Dieter Fox, Stuart Russell) Outline Agents and environments Rationality PEAS specification Environment types Agent types 2 Agents An
More informationAgents & Environments Chapter 2. Mausam (Based on slides of Dan Weld, Dieter Fox, Stuart Russell)
Agents & Environments Chapter 2 Mausam (Based on slides of Dan Weld, Dieter Fox, Stuart Russell) Outline Agents and environments Rationality PEAS specification Environment types Agent types D. Weld, D.
More informationVorlesung Grundlagen der Künstlichen Intelligenz
Vorlesung Grundlagen der Künstlichen Intelligenz Reinhard Lafrenz / Prof. A. Knoll Robotics and Embedded Systems Department of Informatics I6 Technische Universität München www6.in.tum.de lafrenz@in.tum.de
More informationAI: Intelligent Agents. Chapter 2
AI: Intelligent Agents Chapter 2 Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types Agents An agent is anything
More informationRational Agents (Chapter 2)
Rational Agents (Chapter 2) Agents An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that environment through actuators Example: Vacuum-Agent Percepts:
More informationOutline. Chapter 2 Agents & Environments. Agents. Types of Agents: Immobots
Outline Chapter 2 Agents & Environments Agents and environments Rationality PEAS specification Environment types Agent types 2 Agents An agent is anything that can be viewed as perceiving its environment
More informationHow do you design an intelligent agent?
Intelligent Agents How do you design an intelligent agent? Definition: An intelligent agent perceives its environment via sensors and acts rationally upon that environment with its effectors. A discrete
More informationIntelligent Agents. Chapter 2
Intelligent Agents Chapter 2 Outline Agents and environments Rationality Task environment: PEAS: Performance measure Environment Actuators Sensors Environment types Agent types Agents and Environments
More informationAgents. Environments Multi-agent systems. January 18th, Agents
Plan for the 2nd hour What is an agent? EDA132: Applied Artificial Intelligence (Chapter 2 of AIMA) PEAS (Performance measure, Environment, Actuators, Sensors) Agent architectures. Jacek Malec Dept. of
More informationIntelligent Agents. Philipp Koehn. 16 February 2017
Intelligent Agents Philipp Koehn 16 February 2017 Agents and Environments 1 Agents include humans, robots, softbots, thermostats, etc. The agent function maps from percept histories to actions: f : P A
More informationAgents. Formalizing Task Environments. What s an agent? The agent and the environment. Environments. Example: the automated taxi driver (PEAS)
What s an agent? Russell and Norvig: An agent is anything that can be viewed as perceiving its environment through sensors and acting on that environment through actuators. (p. 32) Examples: The agent
More informationArtificial Intelligence CS 6364
Artificial Intelligence CS 6364 Professor Dan Moldovan Section 2 Intelligent Agents Intelligent Agents An agent is a thing (e.g. program, or system) that can be viewed as perceiving its environment and
More informationWhat is AI? The science of making machines that: Think rationally. Think like people. Act like people. Act rationally
What is AI? The science of making machines that: Think like people Think rationally Act like people Act rationally Fundamental question for this lecture (and really this whole AI field!): How do you turn
More informationLecture 2 Agents & Environments (Chap. 2) Outline
Lecture 2 Agents & Environments (Chap. 2) Based on slides by UW CSE AI faculty, Dan Klein, Stuart Russell, Andrew Moore Outline Agents and environments Rationality PEAS specification Environment types
More informationAGENT-BASED SYSTEMS. What is an agent? ROBOTICS AND AUTONOMOUS SYSTEMS. Today. that environment in order to meet its delegated objectives.
ROBOTICS AND AUTONOMOUS SYSTEMS Simon Parsons Department of Computer Science University of Liverpool LECTURE 16 comp329-2013-parsons-lect16 2/44 Today We will start on the second part of the course Autonomous
More informationKECERDASAN BUATAN 3. By Sirait. Hasanuddin Sirait, MT
KECERDASAN BUATAN 3 By @Ir.Hasanuddin@ Sirait Why study AI Cognitive Science: As a way to understand how natural minds and mental phenomena work e.g., visual perception, memory, learning, language, etc.
More informationCS324-Artificial Intelligence
CS324-Artificial Intelligence Lecture 3: Intelligent Agents Waheed Noor Computer Science and Information Technology, University of Balochistan, Quetta, Pakistan Waheed Noor (CS&IT, UoB, Quetta) CS324-Artificial
More informationCOMP329 Robotics and Autonomous Systems Lecture 15: Agents and Intentions. Dr Terry R. Payne Department of Computer Science
COMP329 Robotics and Autonomous Systems Lecture 15: Agents and Intentions Dr Terry R. Payne Department of Computer Science General control architecture Localisation Environment Model Local Map Position
More informationSolutions for Chapter 2 Intelligent Agents
Solutions for Chapter 2 Intelligent Agents 2.1 This question tests the student s understanding of environments, rational actions, and performance measures. Any sequential environment in which rewards may
More informationIntelligent Agents. Russell and Norvig: Chapter 2
Intelligent Agents Russell and Norvig: Chapter 2 Intelligent Agent? sensors agent actuators percepts actions environment Definition: An intelligent agent perceives its environment via sensors and acts
More informationArtificial Intelligence Intelligent agents
Artificial Intelligence Intelligent agents Peter Antal antal@mit.bme.hu A.I. September 11, 2015 1 Agents and environments. The concept of rational behavior. Environment properties. Agent structures. Decision
More informationCS343: Artificial Intelligence
CS343: Artificial Intelligence Introduction: Part 2 Prof. Scott Niekum University of Texas at Austin [Based on slides created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All materials
More informationModule 1. Introduction. Version 1 CSE IIT, Kharagpur
Module 1 Introduction Lesson 2 Introduction to Agent 1.3.1 Introduction to Agents An agent acts in an environment. Percepts Agent Environment Actions An agent perceives its environment through sensors.
More informationRational Agents (Ch. 2)
Rational Agents (Ch. 2) Extra credit! Occasionally we will have in-class activities for extra credit (+3%) You do not need to have a full or correct answer to get credit, but you do need to attempt the
More informationArtificial Intelligence
Artificial Intelligence COMP-241, Level-6 Mohammad Fahim Akhtar, Dr. Mohammad Hasan Department of Computer Science Jazan University, KSA Chapter 2: Intelligent Agents In which we discuss the nature of
More informationOutline for Chapter 2. Agents. Agents. Agents and environments. Vacuum- cleaner world. A vacuum- cleaner agent 8/27/15
Outline for Chapter 2 Agents Dr. Melanie Mar/n CS 4480 Agents and environments Ra/onality (Performance measure, Environment, Actuators, Sensors) Agent types Agents Agents and environments An agent is anything
More informationAgents and State Spaces. CSCI 446: Ar*ficial Intelligence Keith Vertanen
Agents and State Spaces CSCI 446: Ar*ficial Intelligence Keith Vertanen Overview Agents and environments Ra*onality Agent types Specifying the task environment Performance measure Environment Actuators
More informationAr#ficial Intelligence
Ar#ficial Intelligence Lecture 2 Vibhav Gogate The University of Texas at Dallas Some material courtesy of Luke Zettlemoyer, Dan Klein, Dan Weld, Alex Ihler and Stuart Russell Announcements Project 0 is
More informationArtificial Intelligence Programming Probability
Artificial Intelligence Programming Probability Chris Brooks Department of Computer Science University of San Francisco Department of Computer Science University of San Francisco p.1/25 17-0: Uncertainty
More informationSilvia Rossi. Agent as Intentional Systems. Lezione n. Corso di Laurea: Informatica. Insegnamento: Sistemi multi-agente.
Silvia Rossi Agent as Intentional Systems 2 Lezione n. Corso di Laurea: Informatica Insegnamento: Sistemi multi-agente Email: silrossi@unina.it A.A. 2014-2015 Agenti e Ambienti (RN, WS) 2 Environments
More informationRational Agents (Ch. 2)
Rational Agents (Ch. 2) Rational agent An agent/robot must be able to perceive and interact with the environment A rational agent is one that always takes the best action (possibly expected best) Agent
More informationAgents. Robert Platt Northeastern University. Some material used from: 1. Russell/Norvig, AIMA 2. Stacy Marsella, CS Seif El-Nasr, CS4100
Agents Robert Platt Northeastern University Some material used from: 1. Russell/Norvig, AIMA 2. Stacy Marsella, CS4100 3. Seif El-Nasr, CS4100 What is an Agent? Sense Agent Environment Act What is an Agent?
More informationPART - A 1. Define Artificial Intelligence formulated by Haugeland. The exciting new effort to make computers think machines with minds in the full and literal sense. 2. Define Artificial Intelligence
More information1 What is an Agent? CHAPTER 2: INTELLIGENT AGENTS
1 What is an Agent? CHAPTER 2: INTELLIGENT AGENTS http://www.csc.liv.ac.uk/ mjw/pubs/imas/ The main point about agents is they are autonomous: capable of acting independently, exhibiting control over their
More informationWhat is AI? The science of making machines that:
What is AI? The science of making machines that: Think like humans Think rationally Act like humans Act rationally Thinking Like Humans? The cognitive science approach: 1960s ``cognitive revolution'':
More informationReactivity and Deliberation in Decision-Making Systems
11 Reactivity and Deliberation in Decision-Making Systems Carle Côté 11.1 Introduction 11.2 Let s Begin at the Beginning 11.3 Common Pitfall #1 : One Decision Model to Rule Them All! 11.4 Common Pitfall
More informationRobotics Summary. Made by: Iskaj Janssen
Robotics Summary Made by: Iskaj Janssen Multiagent system: System composed of multiple agents. Five global computing trends: 1. Ubiquity (computers and intelligence are everywhere) 2. Interconnection (networked
More informationFeeling. Thinking. My Result: My Result: My Result: My Result:
Source of Energy [P]erception of Info [J]udgment of Info External Lifestyle Where You Process How You Inform How You Make How Others See Your Decision-Making Extraverted intuitive Feeling Judging Introvert
More informationSequential Decision Making
Sequential Decision Making Sequential decisions Many (most) real world problems cannot be solved with a single action. Need a longer horizon Ex: Sequential decision problems We start at START and want
More informationBehavior Architectures
Behavior Architectures 5 min reflection You ve read about two very different behavior architectures. What are the most significant functional/design differences between the two approaches? Are they compatible
More informationDefinitions. The science of making machines that: This slide deck courtesy of Dan Klein at UC Berkeley
Definitions The science of making machines that: Think like humans Think rationally Act like humans Act rationally This slide deck courtesy of Dan Klein at UC Berkeley Acting Like Humans? Turing (1950)
More informationCS 4365: Artificial Intelligence Recap. Vibhav Gogate
CS 4365: Artificial Intelligence Recap Vibhav Gogate Exam Topics Search BFS, DFS, UCS, A* (tree and graph) Completeness and Optimality Heuristics: admissibility and consistency CSPs Constraint graphs,
More informationReinforcement Learning
Reinforcement Learning Michèle Sebag ; TP : Herilalaina Rakotoarison TAO, CNRS INRIA Université Paris-Sud Nov. 9h, 28 Credit for slides: Richard Sutton, Freek Stulp, Olivier Pietquin / 44 Introduction
More informationAgent-Based Systems. Agent-Based Systems. Michael Rovatsos. Lecture 5 Reactive and Hybrid Agent Architectures 1 / 19
Agent-Based Systems Michael Rovatsos mrovatso@inf.ed.ac.uk Lecture 5 Reactive and Hybrid Agent Architectures 1 / 19 Where are we? Last time... Practical reasoning agents The BDI architecture Intentions
More informationLECTURE 5: REACTIVE AND HYBRID ARCHITECTURES
Reactive Architectures LECTURE 5: REACTIVE AND HYBRID ARCHITECTURES An Introduction to MultiAgent Systems http://www.csc.liv.ac.uk/~mjw/pubs/imas There are many unsolved (some would say insoluble) problems
More informationChapter 14 My Recovery Plan for My Life
281 1 Decision 4 Activities 5 People 6 Feelings 7 Life Style 8 History 3 Exposure 2 Body Chapter 14 My Recovery Plan for My Life In this chapter you can begin to map out a longer view of your recovery
More informationAssignment 4: True or Quasi-Experiment
Assignment 4: True or Quasi-Experiment Objectives: After completing this assignment, you will be able to Evaluate when you must use an experiment to answer a research question Develop statistical hypotheses
More informationCS148 - Building Intelligent Robots Lecture 5: Autonomus Control Architectures. Instructor: Chad Jenkins (cjenkins)
Lecture 5 Control Architectures Slide 1 CS148 - Building Intelligent Robots Lecture 5: Autonomus Control Architectures Instructor: Chad Jenkins (cjenkins) Lecture 5 Control Architectures Slide 2 Administrivia
More informationSupplementary notes for lecture 8: Computational modeling of cognitive development
Supplementary notes for lecture 8: Computational modeling of cognitive development Slide 1 Why computational modeling is important for studying cognitive development. Let s think about how to study the
More informationCAN T WE ALL JUST GET ALONG?
CAN T WE ALL JUST GET ALONG? Using the Myers-Briggs Type Indicator to Improve Workplace Relations Sara Vancil and Janet Dodson, Fall 2013 RMASFAA Preferences Can you sign your name? What is a preference?
More informationAttention and Concentration Problems Following Traumatic Brain Injury. Patient Information Booklet. Talis Consulting Limited
Attention and Concentration Problems Following Traumatic Brain Injury Patient Information Booklet Talis Consulting Limited What are Attention and Concentration? Attention and concentration are two skills
More informationIntroduction to Deep Reinforcement Learning and Control
Carnegie Mellon School of Computer Science Deep Reinforcement Learning and Control Introduction to Deep Reinforcement Learning and Control Lecture 1, CMU 10703 Katerina Fragkiadaki Logistics 3 assignments
More informationPaul Figueroa. Washington Municipal Clerks Association ANNUAL CONFERENCE. Workplace Bullying: Solutions and Prevention. for
Workplace Bullying: Solutions and Prevention for Washington Municipal Clerks Association ANNUAL CONFERENCE Paul@PeaceEnforcement.com 206-650-5364 Peace Enforcement LLC Bullying described: Why people do
More informationWhat is Artificial Intelligence? A definition of Artificial Intelligence. Systems that act like humans. Notes
What is? It is a young area of science (1956) Its goals are what we consider Intelligent behaviour There are many approaches from different points of view It has received influence from very diverse areas
More informationArtificial Cognitive Systems
Artificial Cognitive Systems David Vernon Carnegie Mellon University Africa vernon@cmu.edu www.vernon.eu Artificial Cognitive Systems 1 Carnegie Mellon University Africa Lecture 2 Paradigms of Cognitive
More informationAn Escalation Model of Consciousness
Bailey!1 Ben Bailey Current Issues in Cognitive Science Mark Feinstein 2015-12-18 An Escalation Model of Consciousness Introduction The idea of consciousness has plagued humanity since its inception. Humans
More informationThe science of the mind: investigating mental health Treating addiction
The science of the mind: investigating mental health Treating addiction : is a Consultant Addiction Psychiatrist. She works in a drug and alcohol clinic which treats clients from an area of London with
More informationSTAGES OF PROFESSIONAL DEVELOPMENT Developed by: Dr. Kathleen E. Allen
STAGES OF PROFESSIONAL DEVELOPMENT Developed by: Dr. Kathleen E. Allen Ownership Engaged Willing to help build organizations Be a good steward Individual ownership Territorialism Ownership over the tasks
More informationBehaviorism: An essential survival tool for practitioners in autism
Behaviorism: An essential survival tool for practitioners in autism What we re going to do today 1. Review the role of radical behaviorism (RB) James M. Johnston, Ph.D., BCBA-D National Autism Conference
More informationThe Missing Link of Risk why Risk Attitude Matters
The Missing Link of Risk why Risk Attitude Matters Workbook to support the conversation between Penny Pullan and Ruth Murray-Webster 7th July 2009 My colleagues and I have spent so much of our time over
More informationArtificial Intelligence
Politecnico di Milano Artificial Intelligence Artificial Intelligence From intelligence to rationality? Viola Schiaffonati viola.schiaffonati@polimi.it Can machine think? 2 The birth of Artificial Intelligence
More informationICS 606. Intelligent Autonomous Agents 1. Intelligent Autonomous Agents ICS 606 / EE 606 Fall Reactive Architectures
Intelligent Autonomous Agents ICS 606 / EE 606 Fall 2011 Nancy E. Reed nreed@hawaii.edu 1 Lecture #5 Reactive and Hybrid Agents Reactive Architectures Brooks and behaviors The subsumption architecture
More informationStep 2 Challenging negative thoughts "Weeding"
Managing Automatic Negative Thoughts (ANTs) Step 1 Identifying negative thoughts "ANTs" Step 2 Challenging negative thoughts "Weeding" Step 3 Planting positive thoughts 'Potting" Step1 Identifying Your
More informationModeling Agents as Qualitative Decision Makers
Modeling Agents as Qualitative Decision Makers Ronen I. Brafman Dept. of Computer Science University of British Columbia Vancouver, B.C. Canada V6T 1Z4 brafman@cs.ubc.ca Moshe Tennenholtz Industrial Engineering
More informationExploration and Exploitation in Reinforcement Learning
Exploration and Exploitation in Reinforcement Learning Melanie Coggan Research supervised by Prof. Doina Precup CRA-W DMP Project at McGill University (2004) 1/18 Introduction A common problem in reinforcement
More informationThe Fallacy of Taking Random Supplements
The Fallacy of Taking Random Supplements Healthview interview with Dr. Paul Eck Healthview: We can see from our conversations that you are totally against people taking random supplements even if people
More informationIntro to HCI evaluation. Measurement & Evaluation of HCC Systems
Intro to HCI evaluation Measurement & Evaluation of HCC Systems Intro Today s goal: Give an overview of the mechanics of how (and why) to evaluate HCC systems Outline: - Basics of user evaluation - Selecting
More informationHigh-level Vision. Bernd Neumann Slides for the course in WS 2004/05. Faculty of Informatics Hamburg University Germany
High-level Vision Bernd Neumann Slides for the course in WS 2004/05 Faculty of Informatics Hamburg University Germany neumann@informatik.uni-hamburg.de http://kogs-www.informatik.uni-hamburg.de 1 Contents
More informationWhat Science Is and Is Not
What Is Science? Key Questions What are the goals of science? What procedures are at the core of scientific methodology? Vocabulary science observation inference hypothesis controlled experiment independent
More information