Pythia WEB ENABLED TIMED INFLUENCE NET MODELING TOOL SAL. Lee W. Wagenhals Alexander H. Levis

Similar documents
Pythia. System Architectures Laboratory INFLUENCE NETS AND BAYESIAN NET APPROACHES FOR COURSE OF ACTION ANALYSIS SAL. Lee W.

New Effects-Based Operations Models in War Games. Lee W. Wagenhals Larry K. Wentz

CS 4365: Artificial Intelligence Recap. Vibhav Gogate

Influence Net Modeling with Causal Strengths: An Evolutionary Approach

IE 5203 Decision Analysis Lab I Probabilistic Modeling, Inference and Decision Making with Netica

An Interactive Modeling Environment for Systems Biology of Aging

ERA: Architectures for Inference

Embracing Complexity in System of Systems Analysis and Architecting

Outline. What s inside this paper? My expectation. Software Defect Prediction. Traditional Method. What s inside this paper?

Probabilistic Graphical Models: Applications in Biomedicine

SAGE. Nick Beard Vice President, IDX Systems Corp.

Causal Knowledge Modeling for Traditional Chinese Medicine using OWL 2

HBML: A Representation Language for Quantitative Behavioral Models in the Human Terrain

A probabilistic method for food web modeling

Bayesian (Belief) Network Models,

Analytical Support for Rapid Initial Assessment

in Engineering Prof. Dr. Michael Havbro Faber ETH Zurich, Switzerland Swiss Federal Institute of Technology

Using Statistical Intervals to Assess System Performance Best Practice

Intent Driven Adversarial Modeling

Analysis of Competing Hypotheses using Subjective Logic (ACH-SL)

STIN2103. Knowledge. engineering expert systems. Wan Hussain Wan Ishak. SOC 2079 Ext.: Url:

Machine Learning and Computational Social Science Intersections and Collisions

Analysis of complex patterns of evidence in legal cases: Wigmore charts vs. Bayesian networks

Lecture 3: Bayesian Networks 1

Continuous/Discrete Non Parametric Bayesian Belief Nets with UNICORN and UNINET

Rethinking Cognitive Architecture!

What Is A Knowledge Representation? Lecture 13

TERRORIST WATCHER: AN INTERACTIVE WEB- BASED VISUAL ANALYTICAL TOOL OF TERRORIST S PERSONAL CHARACTERISTICS

Positive and Unlabeled Relational Classification through Label Frequency Estimation

! Towards a Human Factors Ontology for Cyber Security!

A FRAMEWORK FOR CLINICAL DECISION SUPPORT IN INTERNAL MEDICINE A PRELIMINARY VIEW Kopecky D 1, Adlassnig K-P 1

Mobile, Virtual Enhancements for Rehabilitation (MOVER)

International Journal of Software and Web Sciences (IJSWS)

Guide to Use of SimulConsult s Phenome Software

Analysis of Competing Hypotheses using Subjective Logic (ACH-SL)

Complexity, Networking, and Effects-Based Operations

MTAT Bayesian Networks. Introductory Lecture. Sven Laur University of Tartu

Support system for breast cancer treatment

Detection of Informative Disjunctive Patterns in Support of Clinical

CISC453 Winter Probabilistic Reasoning Part B: AIMA3e Ch

DICOM Conformance Statement

Representing Variable Source Credibility in Intelligence Analysis with Bayesian Networks

Intro, Graph and Search

Stepwise Knowledge Acquisition in a Fuzzy Knowledge Representation Framework

Computational Models for Belief Revision, Group Decisions and Cultural Shifts

Application of Analytical Hierarchy Process and Bayesian Belief Networks for Risk Analysis

Influencing Global Situations: A Collaborative Approach

Fodor on Functionalism EMILY HULL

Mining Medical Data for Causal and Temporal Patterns

ORC: an Ontology Reasoning Component for Diabetes

EBCC Data Analysis Tool (EBCC DAT) Introduction

CS221 / Autumn 2017 / Liang & Ermon. Lecture 19: Conclusion

A Comparison of Collaborative Filtering Methods for Medication Reconciliation

How Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis?

Quantifying location privacy

Positive and Unlabeled Relational Classification through Label Frequency Estimation

Computational Neuroscience. Instructor: Odelia Schwartz

Comparison of Mamdani and Sugeno Fuzzy Interference Systems for the Breast Cancer Risk

CARISMA-LMS Workshop on Statistics for Risk Analysis

Phone Number:

Smart. Training. Developing advanced exercise machines

CHAPTER 6 DESIGN AND ARCHITECTURE OF REAL TIME WEB-CENTRIC TELEHEALTH DIABETES DIAGNOSIS EXPERT SYSTEM

Using Bayesian Networks for Daily Activity Prediction

Logic Model. When do you create a Logic Model? Create your LM at the beginning of an evaluation and review and update it periodically.

A Vision-based Affective Computing System. Jieyu Zhao Ningbo University, China

An architecture description method for Acknowledged System of Systems based on Federated Architecture

Using Bayesian Networks to Analyze Expression Data. Xu Siwei, s Muhammad Ali Faisal, s Tejal Joshi, s

Abstract of the PhD Thesis Intelligent monitoring and early warning system of pandemic viruses

The Human Behaviour-Change Project

Bayesian Networks for the Human Element Leroy A. "Jack" Jackson and MAJ Jonathan K. Alt, US Army Training and Doctrine Command

Collaborative Project of the 7th Framework Programme. WP6: Tools for bio-researchers and clinicians

Exploring Robustness of Plans for Simulation-Based Course of Action Planning: A Framework and an Example

A new formalism for temporal modeling in medical decision-support systems

Errol Davis Director of Research and Development Sound Linked Data Inc. Erik Arisholm Lead Engineer Sound Linked Data Inc.

Development of an Expert System for Distinguishing Headaches from Migraines

White Paper. Human Behavior Analytics with Proxy Interrogatories

Learning Deterministic Causal Networks from Observational Data

Modeling Populations of Interest in Order to Simulate Cultural Response to Influence Activities

Project Logic. Community-led Cancer Screening Project

The Engineering of Emergence in Complex Adaptive Systems. Philosophiae Doctor

Modeling the Role of Theory of Mind in Social Interaction and Influence

A Bayesian Approach to Tackling Hard Computational Challenges

Decisions and Dependence in Influence Diagrams

Kevin Burns. Introduction. Foundation

Neuro-Inspired Statistical. Rensselaer Polytechnic Institute National Science Foundation

3. L EARNING BAYESIAN N ETWORKS FROM DATA A. I NTRODUCTION

Visualizing Temporal Patterns by Clustering Patients

Diagnosis Of the Diabetes Mellitus disease with Fuzzy Inference System Mamdani

PROPOSED WORK PROGRAMME FOR THE CLEARING-HOUSE MECHANISM IN SUPPORT OF THE STRATEGIC PLAN FOR BIODIVERSITY Note by the Executive Secretary

P(HYP)=h. P(CON HYP)=p REL. P(CON HYP)=q REP

Agent-Based Models. Maksudul Alam, Wei Wang

Chapter 2. Knowledge Representation: Reasoning, Issues, and Acquisition. Teaching Notes

Progress in Risk Science and Causality

Analysis A step in the research process that involves describing and then making inferences based on a set of data.

Knowledge Based Systems

International Journal of Computer Science Trends and Technology (IJCST) Volume 5 Issue 1, Jan Feb 2017

Technology Innovation Alert. N o n - i n v a s i v e D i a b e t e s M o n i t o r i n g. 16 December 31 December, Published. Granted.

Implementation of Perception Classification based on BDI Model using Bayesian Classifier

FINAL REPORT CT.98.EP.04

Simplifying Treatment Protocol Development with.. By Healthy at Work and SaluGenecists

Transcription:

Pythia WEB ENABLED TIMED INFLUENCE NET MODELING TOOL Lee W. Wagenhals Alexander H. Levis <lwagenha>,<alevis>@gmu.edu Adversary Behavioral Modeling Maxwell AFB, Montgomery AL March 8-9, 2007 1

Outline Pythia 1.5 (what is it?) Background Influence Net Description Process for Course of Action Analysis Pythia capabilities Conclusion 2

Pythia 1.5 Timed Influence Net Modeling and Analysis tool Developed with support from ONR, AFOSR, and AFRL (and initially with support from AFIWC) Enables analysts to create executable (probabilistic) models that link potential actions (elements of a COA) to effects based on knowledge about the environment Captures the rationale for COAs that explain how actions can achieve effects Given a set of actionable events, determine the Courses of Action that maximize the achievement of desired effects as a function of time Pythia 1.5 has been created in both a stand-alone and a server based versions Visual Studio.NET platform C# as the programming language. The front end of the tool is designed with the help of AddFlow, a Commercial-Off- The-Shelf (COTS) API. 3

Background After the first Gulf war, the Intelligence community needed modeling tools and techniques to determine approaches for influencing leaders such as Saddam Hussein, Milosevic, and others This gave rise (1994) to Influence net modeling, a variant of Bayesian nets. SAIC, supported by GMU, developed SIAM (Situational Influence Analysis Model) for DARPA; this has been used extensively by the Intelligence community as well as others SIAM is a static model that enables the representation of influences (causes) on a person s or organization s behavior. By stimulating selected influences, one tries to modify that entity s behavior The static influence net technology has evolved to an approach using a dynamic model that includes temporal information to determine Courses of Action for Effects-based Operations 4

SIAM: Influence Nets Purpose: assess socio-political influence strategies Objective: extract empirical expertise and knowledge about adversaries and place it in an analytical framework. Tool designed toward five requirements Model Based Support Collaboration amongst domain experts Support mathematically rigorous analysis such that actions could be compared against the effects those actions could influence Be usable by analysts without the need to understand complex Bayesian mathematics or require large quantities of conditional probability values that may be difficult to obtain Provide an intuitive understanding of the complex interaction of cause and effect relationships to decision makers who would compare and select courses of action based on the analysis 5

Influence Net Influence Nets (INs), an instance of the Bayesian framework, were proposed a decade ago to overcome the intractability issues present in BNs. They employ: A non-probabilistic knowledge acquisition interface, termed as the CAST logic [Chang et al., 1994; Rosen and Smith, 1996]. an approximation inference algorithm The modeling of the causal relationships is accomplished by connecting a set of actionable events and a set of desired effects through chains of cause and effect relationships. The strength of such relationships is specified using the CAST logic parameters instead of the probabilities. The required probabilities are internally generated by the CAST logic with the help of user-defined parameters. 6

Elements of an Influence Net Actionable Event Nodes CAST Logic Parameters Influence Arc (Inhibiting) Calculated Conditional Probabilities: P(A E, B) = 0.005 P(A E, B) = 0.950 P(A E, B) = 0.950 P(A E, B) = 0.990 Effect Nodes Marginal Probability: 0.95 Baseline Probability: 0.5 The marginal probability value of each effects node is computed with the help of its Conditional Probability Table (CPT) and the prior probabilities of its parents 7

Timed Influence Nets (TIN) Extension of basic static influence net Models situations where the impact of events (actions or effects) takes some time to reach and be processed by the affected events or conditions The temporal constructs allow a system modeler to specify delays associated with nodes and arcs. These delays may represent the information processing and communication delays present in a given situation. Time Stamps become associated with each node including the input nodes that represent potential actions (and when they will happen) within a course of action Any particular COA triggers a timed sequence of changes in the probability values of the effect nodes. The result can be represented graphically with what is called a probability profile. 8

Timed Influence Nets COA with Earthquake at time 7 Burglary at time 1 Arc Time Delay Node Time Delay = 0 Probability Profile for Dispatch Time 9

Effects Based Modeling for COA Development Actions Model Construction Effects Command Intent Desired End States Set of Desired and Undesired Effects on Red Set of Desired Blue End States 10

Effects Based Modeling for COA Development Actions Model Construction Effects Command Intent Desired End States Probabilistic model relating actionable events to effects through a network of influencing relationships: Influence Net model Set of Desired and Undesired Effects Set of May include Red s Desired COAs Blue End From Red s Point of View States 11

Effects Based Modeling for COA Development Actions Model Construction Effects Command Intent Time-phased broad actions Desired End States Set of Blue s potential Actions that will affect Red. Probabilistic model relating actionable events to effects through a network of influencing relationships: Influence Net model Set of Desired and Undesired Effects Set of May include Red s Desired COAs Blue End From Red s Point of View States 12

Effects Based Modeling for COA Development Actions Model Construction Effects Command Intent Time-phased broad actions Desired End States Set of Blue s potential Actions that will affect Red. Rel IO Fin Ops Trans Pol Probabilistic model relating actionable events to effects through a network of influencing relationships: Influence Net model Set of Desired and Undesired Effects Set of May include Red s Desired COAs Blue End From Red s Point of View States 13

Effects Based Operations Modeling Approach The Effects Based Operations modeling approach starts with the definition of desirable Effects on the Adversary (Red) and the desired end state of Blue Then we work backwards (from right to left) to the Centers of Gravity of Red that influence the desired Effects the arrows show the Cause to Effect relationships (left to right) Then we identify the Operational Functions of Red that affect the COGs, which in turn influence the Effect(s) We continue unfolding backwards in a Cause to Effect chain till we arrive at Actionable Events that can be carried out by Blue Finally, we include other external events, not controlled by Blue, that influence the achievement of the desired Effects on Red There are also Cause to Effect relationships that affect the strength of the influences (e.g., selected Information Operations) 14

Pythia GUI Color and shaped Nodes Tree View Color and shaped arcs Node Parameters 15

Static Probability Propagation Given the marginal probability of the nodes with no parents, the probability of the other nodes is Node Colors Indicate Probability. Prob ~ 1 Prob ~ 0.5 Prob ~ 0 16

Creating and Saving a COA Once an Influence Net has been upgraded to a Timed Influence Net by assigning positive values to some or all of the arc and node time delays, COAs can be created and analyzed Notions of persistence of actions can be captured in the COA 17

Executing a COA Once COA has been created, it can be evaluated by selecting the nodes for which probability profiles will be generated 18

Rapid Reaction Analysis: COA for EBO Attac k of C2: Contr ibuti on to Effec t 4 No Actio ns Attack on Red C2 Red allows Uninter rupted Access to straits: 0.31 0800 BRAT Director briefs Support Cell on urgent problems/issues 1100 Build Influence net model and perform 0900 Develop sensitivity analysis questions and effects of model; collaborate with SMEs 1330 Post analysis results on Game Web C D A C Small ir M Vessels M s S i u n p i p n o g rt 1200 Create Analysis reports 1300 Present analysis results to BRAT Director The approach has been used in Global 1999, 2000, and 2001; Millennium Challenge2002 19

Pythia Capabilities Creating Influence Nets and Timed Influence Nets Static Probability Propagation Sensitivity Analysis Set of Actions Finder (SAF) Course of Action creation and saving Probability Profile Generation Influence Net Analysis Course of Action Probability Profile Comparison Evolutionary Algorithm for COA optimization Temporal Analysis (Queries on what caused a change and what if analysis) Conversion to Time-Sliced Bayesian Net for incorporation of evidence Dynamic Influence Nets to model two types of Persistence. Timed Influence Net Analysis 20

Observations The EBO modeling approach is robust when considering the Attack aspects of a campaign how to affect the adversary But, the current EBO modeling approach needs substantial further development to address the Defend aspects of a campaign: How to prevent the adversary from achieving his effects and How to achieve Blue s end state Furthermore, since the EBO approach starts by considering the effects on the adversary, it is imperative that we model the adversary correctly This leads to the Cultural Modeling of the Adversary if we are to represent the cause to effect relationships reasonably correctly Consequently, personality and cultural modeling are becoming increasingly important 21

Conclusion The Timed Influence Net technology and the Pythia tool for Course of Action Analysis provide a mechanism for modeling and analysis of the effects of actions on an adversary that is embedded in a society Such models represent knowledge created by humans using data and information contained the various sources and data bases to generate knowledge about the situation Pythia has been converted to a server version with a client so that it can be run remotely and be interfaced with other tools Recent research has relaxed the independence assumption without requiring more data input by the analyst The research issue is how these different tools (AutoMap, ORA, Dynet, Pythia, etc.) can be used in combination by analysts to provide better insight into the effects actions will have in an area of operation where the social and cultural factors have a major influence on outcomes 22