Modeling Function of Nectar Foraging of Honeybees using Operant Conditioning

Size: px
Start display at page:

Download "Modeling Function of Nectar Foraging of Honeybees using Operant Conditioning"

Transcription

1 International Journal o Computer Applications ( ) Volume 4 No.7, October 24 Modeling Function o Nectar Foraging o Honeybees using Operant Conditioning Subha Fernando Faculty o Inormation Technology University o Moratuwa Sri Lanka ABSTRACT Behaviors o the colonies o small unsophisticated agents have been analyzed in the literature with the purpose o developing eicient algorithms to solve complex, dynamic and burden problems in other societies. Among them, only a ew research have been conducted in the area o swarm cognition which tries to understand the cognitive behaviors exhibited by human brain by using the cognitive behaviors demonstrated by a colony as a sel-organized entity. In this aspect, the role o a neuron and a role o a insect have been equally considered as an unsophisticated agent which adjusts its actions according to the luctuations o local environment without knowing any global inormation. The cognitive behavior, such as eective labor division o honeybees at ood oraging process, was analyzed in this paper and has been exploited under operant conditioning. The paper has proposed a simple but eective computational model which demonstrates that, the positive reinorcement and the negative reinorcement in operant conditioning are the real actors that aect to the emergent o cognitive behaviors at swarm level when swarm is observed as a sel-organized entity. General Terms Artiicial Intelligence, Swarm Cognition Keywords Swarm Cognition, Operant condition, Honey Bee colonies.. INTRODUCTION A swarm is a large number o unsophisticated agents with limited capabilities, interacting cooperatively and locally among themselves, and environment, with no central control. These local interactions o the agents in a swarm allow the emergent o globally interesting behaviors that is necessary or their survival. The interaction o these social insects can be direct or indirect. Visual or audio contact, such as waggle dance and tremble dance, o honeybees are examples o direct communication while stigmergy or pheromones based communication between social insects are some examples or indirect communication[]. The collective intelligence behavior o these natural organizations such as ood oraging, division o labor, nest building, etc. are emerged in these colonies when the swarm is sel-organized. Sel organization is a set o dynamical mechanisms whereby global representation appears rom the interactions o its lower level components. The ingredients o sel-organism are multiple interactions which results in positive eedback and negative eedback that allows ampliication o random luctuations and control the evolution. This analysis o the natural sel-organized systems has been urther diversiied into the development o eicient algorithms when it comes to the discussion o how natureinspired sel-organized societies can be used to solve and optimize the complex problems in other societies. This swarm-based algorithms are capable o providing low cost, eicient, and robust solutions to solve complex problems in other inormation societies. Ant Colony Optimization (ACO)[2], Artiicial Bee Colony (ABC)[3], and Particle Swarm Optimization(PSO) are such signiicant swarm algorithms which have been introduced by observing the ants ood oraging, bee ood oraging and nest selection, and birds locking respectively. The principle o these algorithms are successully applied in image and data analysis, machine learning, operational research, and in inance and business applications[4]. Moreover many signiicant attempts[5,6] have been made in developing models to demonstrate the dynamicity o these societies, and to investigate how random luctuations o the key parameters o sel-organization aect to the decision making process o the swarm. In the ield o Swarm Cognition, the cooperative interactions o swarm that is necessary or the emergent o collective intelligence such as census decision making, inding the shortest path to the ood sources, etc are exploited in the perspective o understating higher cognitive behaviors in human beings. Swarm cognition[7] works on the basic postulation that a neuron as a part o the brain can be expressed in similar to a social insect as a part o colony. A neuron in isolation has very limited capabilities and depends only on local interactions, however, brain demonstrates highly complex cognitive process similar to what swarm displays as a colony. Sel-organism is the common mechanism that enables these simple units to display higher cognitive behaviors through the cooperative and local interactions between them. Thereore, behavior o a colony and cognitive process o a brain can be explained using simple rules o selorganization. In sel-organizing communities each individual either a insect or a neuron acts according to the inormation it receives rom its local community, without having any global representation, but by ollowing simple individual rules. 2. SELF-ORGANIZATION IN HUMAN BRAIN In order to understand how the key components o selorganization aect to the decision making process o human brain, we explored the swarm o honeybees ood oraging process as a decision making process, which demonstrates smart division o observers in the colony into oragers and receivers to have eicient nectar take in and storing mechanism. This decision making process can be characterized by the inormation which is processing through 45

2 International Journal o Computer Applications ( ) Volume 4 No.7, October 24 multiple local communication and the adaptive behavior o bees which adjust their responses according to their neighborhood environments[8]. This adaptation o honeybees is similar to the adaptation made by neurons when learning occurs at human brain. There a neuron adjust its internal metabolic processes according to its local environmental luctuations by updating its synaptic strength by creating new synaptic connections or by withdrawing existing synaptic connections[9]. Two key types o learning mechanisms have been discussed in the literature which deine the change o behavior according to the responses o the surrounding environments. They are: classical conditioning and operant conditioning. 2. Classical Conditioning Classical conditioning [] explains the learning as: it occurs through the associations between neutral stimulus and environmental stimulus. While in operant conditioning[] learning occurs as changes in behaviors o an individual that are results o the individual's responses to the events that occur in the environment. For example, assume a dog receives tasty oods, soon ater it hears a bell. The dog is very happy to receive the ood and he starts dancing by wagging his tail. Repeating this process many times, the dog starts dancing when he hears the bell. Pavlov[] explained this change o behavior o the dog under classical conditioning. He described the sound o the bell as the neutral stimulus, presentation o oods to the dog as environmental stimulus. The dance o the dog is called naturally occurring response. So by associating this neutral stimulus with the environmental stimulus, the sound o the bell could alone can make the dog dance. Thus, by building this association, the neutral stimulus becomes conditioned stimulus while the dance o the dog is the conditioned response. The conditioned response is the learned response to the neutral stimulus. By pairing and un-pairing this association between the neutral stimulus and environmental stimulus, the dog can be made to learn or unlearn the conditional behavior. 2.2 Operant Conditioning On the other hand, in operant conditioning, learning is described as a change o behavior that is resulted by causes o actions and its consequences [] [3]. According to Skinner, three types o operants can be identiied based on the type o responses o the environment that change the probability o the behavior being repeated: neutral operant (i the responses do not change the probability o the behavior being repeated), reinorces (i the responses increase the probability o the behavior being repeated and these reinorces can either be positive or negative), and punishers (i the responses decrease the probability o the behavior being repeated. The negative reinorce increase the probability when behavior being repeated is withdrawn). The key dierences between the two learning approaches are: in operant conditioning the learner is actively and voluntarily participated while in classical conditioning the learner is passively involuntary participated. In act many studies in the literature have thoroughly discussed the behavior o honeybees when they operate under classical conditioning[4] and rewarding mechanism[5]. In our research, we ocused on an extensive study about the adapting behavior o honeybees under operant conditioning than classical conditioning because the role played by honeybees in a colony is active and voluntary. This paper postulates that cognitive behaviors that are emergent rom a swarm as a sel-organized system can be explained using operant conditioning. And thereby the swarm behaviors can be used to explain the emergent o cognitive behavior at human brain. By doing so, we argue that positive reinorcement and negative reinorcement in operant conditioning are the key actors that control the selorganization o any dynamic system and the emergent o cognitive behavior. The paper is organized as ollows: section 3 describes the nectar oraging process o honeybee colonies, section 4 mathematically models the process described in section 3. And section 5 presents the results o the simple computational model that align to the model presented in section 4. Section 5 discusses and concludes our indings. 3. THE FUNCTION OF NECTAR FORAGING OF HONEYBEES The complexity and dynamicity o the nectar oraging o honeybees was analyzed in the means o identiying key parameters that are necessary or eicient nectar gathering process. It is well known that honeybees communicate through various communication channels such as using pheromones, or tactile dancing with or without some vibrating sounds. Among these techniques, waggle dance is the key communication channel that has been used by honeybees to inorm new rewarding lowering sites to the colony and to recruit new oragers to the newly ound lower patches[6]. The process o waggle dance with its dependent parameters in general ecology o nectar oraging o honeybees can be briely summarized as ollows: A honeybee colony is generally composed o a queen, workers (all workers are emale) and male or drones. The worker bees are almost completely responsible or caring hives, such as cleaning the hive, caring the larvae and youngs, eeding the queen and the drones, making honey, and gathering and storing nectar, water, etc. Thereore around 9% o the bees in the colony are workers, rom % o them are scouts who ind lower patches by searching[7]. A scout keep searching until its energy level is depleted or it inds lower-patches. I it ound a lower patch, it comes to the comb and unloads the nectar sources to receivers at the comb. The receiver takes it to the storage area o the hive. The returned scout can either be a scout again, or a orager, or an unemployed bee. I the returned scout eels that the lower patch rom where it brought the nectar is in high quality and quantity, it perorms waggle dance to recruit more oragers. I it is in considerable quality it simply returns and brings the nectar rom the lower patch. Otherwise, a scout can orget the visited lower patch and settle as an unemployed bee until it is recruited, or it can become a scout again searching or new lower patches. Sometimes orager bees perorm tremble dances to get unemployed bees to engage in nectar-receiving task [8, 9]. Key message that a orager wants to convey through this tremble dance is that it has ound more-rewarding nectar source and no enough receivers to unload them eiciently. Meanwhile by perorming this dance the orager tries to inorm other mate-oragers not to recruit additional oragers to their nectar sources. Thereore, the tremble dances o honeybees help to the colony to keep the balance between nectar storing and nectar take-in. Once oragers unloaded their nectar they may start to perorm waggle dance to recruit unemployed oragers to visit their explored lower patches. I 46

3 International Journal o Computer Applications ( ) Volume 4 No.7, October 24 a orager bee had to wait too long to unload the nectar (when it was unable to ind a receiver), then the orager bee does not perorm the waggle dance to recruit additional oragers bees, because it does not have enough receivers to handle the unloading process. The receiver bee may get delayed or searching urther away through the hive when the hive has not enough vacant storage cells, and it is almost ull. Waggle dance[6,6,2-22] is a communication behavior which conveys the inormation about location, and quality (high concentration, distance, easy to collect, etc) o the ood sources that have been ound. A dancing bee runs orward and perorms the waggle dance as shown in the igure, while she is on the run, she vibrates her abdomen laterally and then comes back to her starting point. According to the sources in the literature, a distance to the ood source is proportioned to the length o this waggle run and the angle o the run to the sun represents the direction o the ood sources. The higher the quality o nectar source, the higher the number o waggle runs per dancing bout and that increases the number o recruiters. Furthermore, the number o recruiters increases in proportion to the probability o returning orger would dance and the number o waggle runs made by her per visit. Through this mechanism honeybee colonies gather nectar more eiciently by sending their oragers to the better lower patches by abandoning less reward lower-patches, recruiting to more-rewarding patches, and searching or new patches. Fig : Waggle dance o a honeybee According to Seeley[2], honeybees measure the proitability o located nectar source by sensing the energetic eiciency o their oraging. Thereore, the number o waggle runs per dance is not directly a linear unction o closeness o the located nectar source to the hive but the energy expenditure per oraging trip. Moreover, through its waggle dance, a dancing bee reports on the current level o energy proitability o her orage site. Thereore, the number o waggle runs per bout is high when the nectar source is abundant, and it is low when it is scarce. The dancing bee does not perorm her dance in one place but distributes it over the dance loor. Thereore when number o orage sites are being reported on the dancing loor, oragers can easily take a random sample o the dance inormation. This allows the colony to allocate oragers to more-rewarding ood sources. 4. MODELING FOOD FORAGING FUNCTION OF HONEYBEES The emergent o cognitive behavior at swarm level, a decision making process which divides the labors at the colony eiciently to streamline the ood oraging process was analyzed in our research. This analysis was carried out to identiy the key actors or reinorcements that enable the swarm as a sel-organized system to demonstrate this highly cognitive task. Here, we have restricted our analysis by considering only the impacts o direct communication o honeybees on this oraging task. Further, we have assumed these bees can remember one lower patch at a time and can harvest only one lower per trip rom the comb as in [6]. Let mathematically model the world o swarm as square-grid o length m (m > and odd integer in meters) in which lower patches are placed on the environment according to a 2 Gaussian distribution N (, ) where is m/ 2 when the comb is placed at the middle o the square. Let the maximum distance a scout can ly without returning the comb is l >. Let quality o the nectar concentration at lower patches ( n U ) are uniormly distributed in three states: low ( unit), moderate (2 units) and high (3 units). Moreover, the available quantity o the nectar in a lower patch is measured in terms o the number o bloomed lowers it has. Let the number o bloomed lowers are randomly distributed using a discrete uniorm distribution rom to N ( n U ~ U(, N) ). Then, the overall quality o nectar a lower patch has, is deined by n n n. Honeybees, in a colony o size U N colony_size, are initially distributed to scouts, oragers, receivers, and observers with probabilities Pr s, Pr, Pr r, and Pro respectively. We adapted the equation rom[22] which measures the quality o the ood sources in terms d and d where d is the max distance rom the comb to a lower patch and d max is the maximum direct distance rom the comb to the edge o the square through the lower patch and, n - the overall quality o the nectar at a lower patch. We can deine the quality o a lower patch as in eq. (). As given in the equation, the higher quality lower patches which locate near to the comb gets higher Q. A scout honeybee starts Levy light to ind these lower patches. dmax Q d d max n () The number o waggle runs (w) perormed by a honeybee is based on Q and it is in the orm o w Q. A returned orager waits time t been brought-in to a receiver in a colony; t wait_ to _ unload wait_ to_ unload to unload nectar that have exp( t / number_ o _ receivers) where number_o_receivers is the number o receivers in the colony at time step t. The expected time duration a honeybee has to wait to unload nectar t wait is measured in terms o the quality o the lower patches that have been reported to the colony so ar. i.e. t.5 ( Q k). I the oraging honeybee has to wait wait t wait t wait _ to_ unload, the orager bee tends to perorm tremble dance. The duration o the tremble dance is t. The parameter k is wait t wait _ to _ unload determined by a honeybee by randomly sampling its neighborhood, i.e. the roughly taking the quality o the lower n patches that have been reported to the comb; so k Qi n. i 47

4 International Journal o Computer Applications ( ) Volume 4 No.7, October 24 I t wait t wait _ to_ unload, is a parameter, the orager stops oraging the current site. A given orager bee can turn either to a scout, or an observer. A orager perorms a waggle dance mainly based on Q, the duration o the waggle bout is restricted by i any tremble dances perormed at the colony. I orager bee encountered trem number o tremble dances that have being currently reported in the comb, then w Q trem/ n / c ; where n is the size o the random sample and c is a constant. A observer bee can turn to a orager, or a receiver or remain as a observer based on the dominant requirement that is exhibited by the random sample that it has taken rom the colony. A receiver bee can change its role to a observer i it has to wait too long to receive nectar, t wait_ to _ receive ; where is a parameter. Under this mathematical model, the energetic eiciency o the nectar source o lower patches oraged by honeybees inluence the entire nectar oraging cycle o the colony. Furthermore, this energetic eiciency, is the key actor that determines the duration o waggle runs perormed and in act it aects to the proper division o labors in the colony. Thereore, we can postulate that, energetic eiciency o the nectar source is the positive reinorcement that a honeybee receives to perorm waggle dance and to recruit more oragers, and the arises o cognitive unction which makes the decision on dividing the labors at the colony appropriately. On contrast, the time duration, a orager bee has to wait to unload its nectar source to a receiver is the negative reinorcement that a honeybee receives rom the environment to discourage the oraging o low quality lower patches compared to what have been reported to the colony. So we can postulate that these two orms o reinorcements rom the environment allow the entire colony to keep its balance between nectar take-in and storage process by eiciently dividing its labors to appropriate task according to the dynamic environmental luctuations (according to the distribution o the quality o the nectar sources that have been reported) and according to the inormation communicated by its surrounding environment to the honeybees. Thereore, a cognitive process, such as decision making which is exhibited by a sel-organized system, is mainly arisen as learning adjustments which are made by each individual as responses to environmental positive and negative reinorcements. 5. RESULTS A simple computer model was developed to simulate the eect o the positive ( Q ) and negative ( t wait_ to _ unload) reinorcements on the labor division at swarm ood oraging process. The total quality o a lower, i.e. Q (reerred as in igures), the mean o the quality o lower patches that have been really reported to the colony, i.e. k (reerred as meanqltyflower in igures), the time duration a honeybee waits to unload the nectar, i.e. t wait_ to _ unload (reerred as in igures) and the expected time duration a honeybee must wait to unload the nectar, i.e. t wait (reerred as m in igures) were monitored in this process in addition to the recording o the number o receivers, the number o oragers and the number o observers in the colony. The computer model had a colony o 5 oragers, 3 observers, and 2 receivers. The overall quality o a lower patch, i.e. Q - (,) was randomly generated. Initially the value o k was set to.3. I Q > k, a observer is turned to a orager, otherwise a orager is turned to an observer. I t, we increase the number o receivers wait t wait _ to _ unload by one and decrease the number o observers by one. Otherwise we decrease the number o receivers by one and increase the number o observers by one. With this simple model we were able to demonstrate the eect o positive and negative reinorcements on each individual's action and thereby the emergent o cognitive behavior at swarm level. From igure 2 to igure 5, each igure consists o three subigures, namely, (a), and. Subigure (a) demonstrates the distribution o honeybees in the colony in terms o the number o receivers, the number o oragers and the number o observers when all the our parameters (, meanqltyflower,, and ) were calculated as deined in the mathematical model. The subigures and show the luctuations o, and meanqltyflower, and meanwtime and related to the scenario depicted in subigure (a) respectively. Figure 2 shows the situation when we let the system to run around steps without enorcing any other constraints. As shown in igure.2, the increases o the number o oragers have decreased the number o observers and has increased the number o receivers. As shown in igure.3. we artiicially set the value o meanqtyflower to. So that we artiicially inormed the colony that the colony has been reported by high quality lower patches which are in the range o. As shown in igure 3, since the quality o the lower patches that have been really reported by the honeybees are less than this artiicial value, o oragers have been increased compared to the expected waiting time, i.e. m. In order to observe behaviors o the colony or lower quality lower patches, we artiicially set meanqtyflower to. So that we artiicially inormed the colony that it has been reported by low quality lower patches and it is in the range o. As shown in igure 4, since the quality o the lower patches that have been really reported by the honeybees are higher than this artiicial value, honeybees were not requested to wait too long to unload the nectar and in act the time they really waited is less than the expected time duration, i.e. < meanwtime. This adjustment o the system has decreased both the number o observers and the number o oragers and consecutively it has increased the number o receivers. Finally, we evaluated the behavior o the system by artiicially setting mtime to.7 as shown in igure.5. As shown in igure 5. when is higher than the expected waiting time, i.e, the system has increased the number o observers, and decreased the number o receivers. When was less than the mwtime, the system has increased the number o receivers and decreased the number o observers. 48

5 Number o Honey Bees Number o Honey Bees International Journal o Computer Applications ( ) Volume 4 No.7, October 24 (a) meanqltyflower - Fig 2: Distribution o Honeybees in the Colony (a) meanqltyflower = mwanqltyflower Fig 3: Distribution o Honeybees in the Colony when meanqltyflower was artiicially set to 8 (a) meanqltyflower = meanqltyflower - Fig 4: Distribution o Honeybees in the Colony when meanqltyflower was artiicially set to 49

6 (a) =.7 International Journal o Computer Applications ( ) Volume 4 No.7, October meanqltyflower Fig 5: Distribution o Honeybees in the Colony when was artiicially set to.7 6. DISCUSSION As shown in igure.2 when the colony was reported by higher quality lower patches compared to what have being reported to the colony so ar, the system has increased the number o oragers, and the number o receivers while the number o observers have been decreased. This was an accepted behavior by the system which has encouraged the oragers who have reported higher quality lower patches by decreasing their real waiting time than the expected waiting time. The that has been reported to the colony has aected to the system as a positive reinorcement, as given igure.3. By increasing the number o observers in the colony, system has assumed that, it allows the oragers who have reported quality lower patches in range, to broadcast their oraging sites eectively to the colony. So the oragers who have reported poor quality lower patches have been discouraged by increasing their real waiting time, i.e., than the expected waiting time, i.e.. Thereore, in this scenario, has been applied on the system as a negative reinorcement to discourage oraging o poor quality lower patches. When quality o the lower patches that have been reported is set to, the system has encouraged oragers who have reported high quality lower patches (igure. 4) by decreasing their real waiting time than the expected waiting time. So it has increased the number o receivers and the number o oragers and decreased the number o observers. Thereore, as expected, the system has considered as a positive reinorcement. Finally when we set to.7 as in igure.5. It has negatively impacted on the system behavior. That is, when is higher than the expected, it has urther decreased the number o receivers, and increased the number o observers, by assuming that, the system is being reported by low quality lower patches. And accordingly, when is less than the expected waiting time, it has increased the number o receivers and the number o oragers, while it has decreased the number o observers, by assuming that the colony has been reported by higher quality lower patches. Through this simple but eective simulation, we could show that the operant conditioning, which explains the responses made by a simple individual to the environmental positive and negative reinorcements as learning adjustments, is the underline phenomena o sel-organization o dynamic system and the exhibition o cognitive behavior, such as division o colony labors eectively at the nectar oraging process. Thereore, similar to the emergent o cognitive behavior at swarm level, the cognitive behavior emergent at human brain can also be explained using operant conditioning by taking the brain as a sel-organized system. As the uture work, the deeper analysis into the emergent o a particular cognitive behavior at human brain is needed to be exploited under operant conditioning as a means o discovering the underlying positive reinorcement and negative reinorcement. Doing so, the adjustment that happen at individual neuronal level to these reinorcements can be taken as the process that resulted in emergent o cognitive behavior. 7. REFERENCES [] Ahmed H. and Glasgow J. 22 Swarm Intelligence: Concepts, Models and Applications, Technical Report , School o Computing, Queen's University, Canada. [2] Blum C. 25 Ant colony optimization: Introduction and recent trends, Physics o Lie Reviews 2 (25) [3] Karaboga D. and Akay B. 29 A Survey: Algorithms Simulating Bee Swarm Intelligence; Artiicial Intelligence Review; 3 (), pp

7 International Journal o Computer Applications ( ) Volume 4 No.7, October 24 [4] Krink T. Swarm Intelligence - Introduction, EVALie Group, Department o Computer Science, University o Aarhus. [5] Myerscough M.R. 23 Dancing or a decision: a matrix model or nest-site choice by honeybees, Proc. R. Soc. Lond. 27(55) [6] Bailis P., Nagpal R. and Werel J. 2 Positional Communication and Private Inormation in Honeybee Foraging Models, in Swarm Intelligence, Eds. Springer Berlin Heidelberg, pp [7] Trianni V. and Tusi E. 2 Swarm Cognition and Artiicial Lie, Advances in Artiicial Lie. Darwin Meets von Neumann, Lecture Notes in Computer Science:5778: [8] Trianni V., Tusi E., Passino, E.M., Marshell J.A.R. 2 Swarm Cognition: an interdisciplinary approach to the study o sel-organizing biological collectives, Swarm Intelligence:5:3-8. [9] Abbott L.F. and Nelson S.B 2 Synaptic Plasticity: taming the beast, Neuroscience, vol.3.pp [] Cherry K, How Classical Conditioning Works, About.com Psychology, 5-Aug-24. [Online]. [] Skinner, B.F. (954). The science o learning and the art o teaching. Harvard Educational Review, 24(2), [2] Skinner, B.F. (95). Are theories o learning necessary? Psychological Review, 57(4), 93-2 [3] Cherry K, What s Dierent Between the Classical and Operant Conditioning?, About.com Psychology, 5-Aug- 24.[Online] [4] Cammaerts M. 24 Classical conditioning, temporal learning and spatial learning in the ant Myrmica sabuleti, Biologia, Bratislava, 59/2: [5] Gil M. 2 Reward expectations in honeybees, Communicative & Integrative Biology 3:2, 95-. [6] Seeley T.D., Mikheyev A. S., and Pagano G. J. 2 Dancing bees tune both duration and rate o waggle-run production in relation to nectar-source proitability, J. Comp. Physiol. [A], vol. 86, no. 9, pp [7] Yahya H. The miracle o the Honeybee 27, chapter 2-3. [8] Thom C 23 The tremble dance o honey bees can be caused by hive-external oraging experience, J. Exp. Biol., vol. 26, no. Pt 3, pp [9] Seeley T.D. 992 The tremble dance o the honey bee: message and meanings, Behav. Ecol. Sociobiol., vol. 3, no. 6, pp [2] Passino K.M. and Seeley T.D. 26 Modeling and analysis o nest-site selection by honeybee swarms: the speed and accuracy trade-o, Behav. Ecol. Sociobiol., vol. 59, no. 3, pp [2] Seeley T. D. 994 Honey bee oragers as sensory units o their colonies, Behav. Ecol. Sociobiol., vol. 34, no., pp [22] Okada R., Ikeno H., Kimura T, Ohashi M, Aonuma H and Ito E. Error in the Honeybee Waggle Dance Improves Foraging Flexibility, SCIENTIFIC REPORTS 4 : 475 IJCA TM : 5

Introduction to Neuroscience: Behavioral Neuroscience Lecture 1: Introduction to Animal Behavior

Introduction to Neuroscience: Behavioral Neuroscience Lecture 1: Introduction to Animal Behavior Introduction to Neuroscience: Behavioral Neuroscience Lecture 1: Introduction to Animal Behavior Tali Kimchi Department of Neurobiology Tali.kimchi@weizmann.ac.il Jakob von Uexküll (1864-1944) Umwelt

More information

Types of behaviors that are elicited in response to simple stimuli

Types of behaviors that are elicited in response to simple stimuli Lecture 19: Animal Behavior I. Background A. Animal behavior reflects and arises from biological properties 1. Exhibited behavior defends on the physiological systems and processes unique to a given organism

More information

Animal Behavior. Types of Communication 4/22/2013

Animal Behavior. Types of Communication 4/22/2013 Animal Behavior A behavior is the nervous system s response to a stimulus and is carried out by the muscular or the hormonal system Behavior is subject to natural selection Behaviors have an impact on

More information

Vibration Signals and the Organisation of Labour in Honey Bee Colonies

Vibration Signals and the Organisation of Labour in Honey Bee Colonies Vibration Signals and the Organisation of Labour in Honey Bee Colonies Stan Schneider A fascinating insight into a means of communication between honey bees ANYONE WHO has ever looked inside a honey bee

More information

Machine Learning Statistical Learning. Prof. Matteo Matteucci

Machine Learning Statistical Learning. Prof. Matteo Matteucci Machine Learning Statistical Learning Pro. Matteo Matteucci Statistical Learning Outline o What Is Statistical Learning? Why estimate? How do we estimate? The trade-o between prediction accuracy & model

More information

Chapter 51 Behavioral Biology

Chapter 51 Behavioral Biology Chapter 51 Behavioral Biology Essential Knowledge 2.C.2 Organisms respond to changes in their external environments 2.E.2 Timing and coordination of physiological events are regulated by multiple mechanisms

More information

Classical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts

Classical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts Learning Classical Conditioning Pavlov study of digestion dogs salivate before getting food learning as signal detection: emphasis on what happens before a given behavior Classical conditioning terms Stimulus:

More information

FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED

FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED Francisco J. Fraga 1, Alan M. Marotta 2 1 National Institute o Telecommunications, Santa Rita do Sapucaí - MG, Brazil 2 National Institute

More information

Cooperation and conflict: How insects interact with each other and their environment

Cooperation and conflict: How insects interact with each other and their environment Cooperation and conflict: How insects interact with each other and their environment Overview Five examples of cooperation and conflict in insects (and its consequences) Cooperation requires communication:

More information

3/30/17. Animal Behavior. What is behavior? Why study behavior?

3/30/17. Animal Behavior. What is behavior? Why study behavior? Animal Behavior meerkat s What is behavior? Behavior everything an animal does & how it does it response to stimuli in its environment innate inherited, instinctive automatic & consistent learned ability

More information

Analysis of Foraging Behavior in Ant Swarms Based on StarLogo Simulation

Analysis of Foraging Behavior in Ant Swarms Based on StarLogo Simulation Proceedings of the 2007 IEEE International Conference on Robotics and Biomimetics December 15-18, 2007, Sanya, China Analysis of Foraging Behavior in Ant Swarms Based on StarLogo Simulation Bailong Liu

More information

Modelling collective foraging by means of individual behaviour rules in honey-bees

Modelling collective foraging by means of individual behaviour rules in honey-bees Behav Ecol Sociobiol (1998) 44: 109±124 Ó Springer-Verlag 1998 ORIGINAL ARTICLE Han de Vries á Jacobus C. Biesmeijer Modelling collective foraging by means of individual behaviour rules in honey-bees Received:

More information

Summary. Introduction to swarm. Modeling Bee Colonies

Summary. Introduction to swarm. Modeling Bee Colonies Summary Introduction to swarm Definitions by Beni, Bonabeau Examples Essential characteristics repeated Differences compared to symbolic AI Modeling Bee Colonies Speculations Rate of egg laying and pollen

More information

Psychology, Ch. 6. Learning Part 1

Psychology, Ch. 6. Learning Part 1 Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening

More information

AP Biology. What is behavior? Behavioral Ecology. Why study behavior? What questions can we ask? Evolutionary perspective.

AP Biology. What is behavior? Behavioral Ecology. Why study behavior? What questions can we ask? Evolutionary perspective. Behavioral Ecology What is behavior? Behavior everything an animal does & how it does it response to stimuli in its environment innate inherited, instinctive automatic & consistent learned ability to learn

More information

AP Biology. What is behavior & Why study it? Animal Behavior. Ethology. What questions do we ask? Innate behavior. Types of behaviors

AP Biology. What is behavior & Why study it? Animal Behavior. Ethology. What questions do we ask? Innate behavior. Types of behaviors Animal Behavior What is behavior & Why study it? Behavior everything an animal does & how it does it response to stimuli in its environment innate = inherited or developmentally fixed learned = develop

More information

On optimal decision-making in brains and social insect colonies Marshall, Bogacz, Dornhaus, Planque, Kovacs,Franks

On optimal decision-making in brains and social insect colonies Marshall, Bogacz, Dornhaus, Planque, Kovacs,Franks On optimal decision-making in brains and social insect colonies Marshall, Bogacz, Dornhaus, Planque, Kovacs,Franks Presented by Reffat Sharmeen, Kolli Sai Namratha Contents Introduction Optimal decision-making

More information

Animal Behavior. AP Biology. meerkats

Animal Behavior. AP Biology. meerkats Animal Behavior meerkats What is behavior? Behavior everything an animal does & how it does it response to stimuli in its environment innate inherited, instinctive automatic & consistent learned QuickTime

More information

Waggle dance behavior associated with seasonal absconding in colonies of the African honey bee, Apis mellifera scutellata

Waggle dance behavior associated with seasonal absconding in colonies of the African honey bee, Apis mellifera scutellata Ins. Soc. 41:115-127 (1994) 1015-1621/94/020115-13 $1.50 + 0.20/0 9 1994 Birkh/iuser Verlag, Basel Waggle dance behavior associated with seasonal absconding in colonies of the African honey bee, Apis mellifera

More information

HONEY BEE BIOLOGY Apprentice Level Training Texas Master Beekeeper Program

HONEY BEE BIOLOGY Apprentice Level Training Texas Master Beekeeper Program HONEY BEE BIOLOGY Apprentice Level Training Texas Master Beekeeper Program Anatomy Overview Three tagmata 1. Head Sensory 2. Thorax Locomotion 3. Abdomen Digestion and reproduction Anatomy Overview O =

More information

Mechanism of inhibition defines CETP activity: a mathematical model for CETP in vitro

Mechanism of inhibition defines CETP activity: a mathematical model for CETP in vitro Mechanism o inhibition deines activity: a mathematical model or in vitro Laura K. Potter, 1,2,* Dennis L. Sprecher, Max C. Walker, and Frank L. Tobin Scientiic Computing and Mathematical Modeling,* GlaxoSmithKline,

More information

EnSt/Bio 295 Exam II This test is worth 100 points; you have approximately 50 minutes. Allocate your time accordingly.

EnSt/Bio 295 Exam II This test is worth 100 points; you have approximately 50 minutes. Allocate your time accordingly. Name: 1 NAME: EnSt/Bio 295 Exam II This test is worth 100 points; you have approximately 50 minutes. Allocate your time accordingly. 1) Describe the following concepts in a few sentences (2 points each)

More information

Bumble bees (Bombus terrestris) store both food and information in honeypots

Bumble bees (Bombus terrestris) store both food and information in honeypots Behavioral Ecology doi:10.1093/beheco/ari040 Advance Access publication 16 March 2005 Bumble bees (Bombus terrestris) store both food and information in honeypots Anna Dornhaus and Lars Chittka Department

More information

C. Anderson, G. Theraulaz, and J.-L. Deneubourg, Self-assemblages in insect societies. Insectes soc. 49 (2002)

C. Anderson, G. Theraulaz, and J.-L. Deneubourg, Self-assemblages in insect societies. Insectes soc. 49 (2002) Self-Organization: Production of organized patterns, resulting from localized interactions within the components of the system, without any central control C. Anderson, G. Theraulaz, and J.-L. Deneubourg,

More information

A Monogenous MBO Approach to Satisfiability

A Monogenous MBO Approach to Satisfiability A Monogenous MBO Approach to Satisfiability Hussein A. Abbass University of New South Wales, School of Computer Science, UC, ADFA Campus, Northcott Drive, Canberra ACT, 2600, Australia, h.abbass@adfa.edu.au

More information

Conditioning and Learning. Chapter 7

Conditioning and Learning. Chapter 7 Conditioning and Learning Chapter 7 Learning is knowledge of skills acquired by instruction or studying. It is a permanent change in behavior due to reinforcement. Reinforcement refers to any event that

More information

Honey Bee Biology. Elina L. Niño Extension Apiculturist

Honey Bee Biology. Elina L. Niño Extension Apiculturist Honey Bee Biology Elina L. Niño Extension Apiculturist listverse.com E.L. Niño Honey Bee Lab Bernardo Niño Staff Res. Assoc. Charley Nye Laidlaw Facility Mngr. Patricia Bohls PhD Student Cameron Jasper

More information

Orion. New! The new Orion. Information for Hearing Care Professionals.

Orion. New!  The new Orion. Information for Hearing Care Professionals. Orion New! www.siemens.com/orion The new Orion. Inormation or Hearing Care Proessionals. Orion. Because the uture belongs to Soundability. Enjoy the sound o lie. With great comort and superior connectivity.

More information

thebiotutor.com A2 Biology OCR Unit F215: Control, genomes and environment Module 4.3 Animal behaviour Notes & Questions

thebiotutor.com A2 Biology OCR Unit F215: Control, genomes and environment Module 4.3 Animal behaviour Notes & Questions thebiotutor.com A2 Biology OCR Unit F215: Control, genomes and environment Module 4.3 Animal behaviour Notes & Questions Andy Todd 1 Explain the advantages to organisms of innate behaviour. Behaviour o

More information

Adaptive leaky integrator models of cerebellar Purkinje cells can learn the clustering of temporal patterns

Adaptive leaky integrator models of cerebellar Purkinje cells can learn the clustering of temporal patterns Neurocomputing 26}27 (1999) 271}276 Adaptive leaky integrator models of cerebellar Purkinje cells can learn the clustering of temporal patterns Volker Steuber*, David J. Willshaw Centre for Cognitive Science,

More information

Science Research. Section 1. From an early age, I was fascinated by math and science. Much of my childhood was

Science Research. Section 1. From an early age, I was fascinated by math and science. Much of my childhood was Rachel Sitts Science Research Section 1 From an early age, I was fascinated by math and science. Much of my childhood was spent blowing bubbles twice the size of my body at the Boston Science Museum and

More information

Essay elaboration. Psychology

Essay elaboration. Psychology Psychology Essay elaboration Overview This activity develops the work started in the specialist terminology in essays activity The aim of this activity is for students to develop their essay writing, by

More information

Introducing the Read-Aloud

Introducing the Read-Aloud Social Insects: Bees and Wasps 4A Note: Introducing the Read-Aloud may have activity options that exceed the time allocated for this part of the lesson. To remain within the time periods allocated for

More information

Animal Behavior. How can we explain behavior? Behavior. Innate or instinctive behavior. Instinctive behavior. Instinctive behavior 11/26/2017

Animal Behavior. How can we explain behavior? Behavior. Innate or instinctive behavior. Instinctive behavior. Instinctive behavior 11/26/2017 Animal Behavior Chapter 51 How can we explain behavior? How it works physiologically Proximate answer The adaptive value of the behavior Ultimate answer So, behavioral scientists study what behavior an

More information

8. 4 types of communication signals: visual, sound, chemical, electrical

8. 4 types of communication signals: visual, sound, chemical, electrical Honors Biology Unit 5 Chapter 35 BEHAVIORAL ADAPTATIONS TO THE ENVIRONMENT 1. stimulus vs. response 2. nature vs. nurture 3. fixed action pattern, innate behaviors 4. imprinting vs. learning 5. types of

More information

1. Distinguish between releaser and modifier hormones. 2. Give and example of a reflex, a fixed action pattern and a stimulus response chain.

1. Distinguish between releaser and modifier hormones. 2. Give and example of a reflex, a fixed action pattern and a stimulus response chain. 1 Study Guide 1. Distinguish between releaser and modifier hormones. 2. Give and example of a reflex, a fixed action pattern and a stimulus response chain. 3. Explain how the results presented in the Figure

More information

THEORIES OF PERSONALITY II

THEORIES OF PERSONALITY II THEORIES OF PERSONALITY II THEORIES OF PERSONALITY II Learning Theory SESSION 8 2014 [Type the abstract of the document here. The abstract is typically a short summary of the contents of the document.

More information

Operant Conditioning

Operant Conditioning Operant Conditioning Classical vs. Operant Conditioning With classical conditioning you can teach a dog to salivate, but you cannot teach it to sit up or roll over. Why? Salivation is an involuntary reflex,

More information

Swarm AI to Detect Deceit in Facial Expressions

Swarm AI to Detect Deceit in Facial Expressions Swarm AI to Detect Deceit in Facial Expressions Louis Rosenberg and Chris Hornbostel Unanimous A.I. San Francisco, CA, USA Louis@Unanimous.ai Niccolo Pescetelli University of Oxford Clarendon, UK niccolo.pescetelli@chch.ox.ac.uk

More information

JUNE 2008 HIGHLIGHTS OF THIS ISSUE. Lafayette School Studies Bees!... Newbee Nuggets... Classifieds, Miscellaneous.

JUNE 2008 HIGHLIGHTS OF THIS ISSUE. Lafayette School Studies Bees!... Newbee Nuggets... Classifieds, Miscellaneous. 2008 BOARD www.diablobees.org JUNE 2008 HIGHLIGHTS OF THIS ISSUE Meetings President Rick Kautch First Vice President Tom Lewis (925) 348-4470 Past President Stan Thomas What s the Buzz?... Lafayette School

More information

Introduction to Neuroscience: Behavioral Neuroscience

Introduction to Neuroscience: Behavioral Neuroscience Introduction to Neuroscience: Behavioral Neuroscience Lecture 1: Introduction to Animal Behavior Tali Kimchi tali.kimchi@weizmann.ac.il * Presentation Materials for Personal Use ONLY Introduction Humans

More information

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play

More information

Learning. Learning: Problems. Chapter 6: Learning

Learning. Learning: Problems. Chapter 6: Learning Chapter 6: Learning 1 Learning 1. In perception we studied that we are responsive to stimuli in the external world. Although some of these stimulus-response associations are innate many are learnt. 2.

More information

BRAIN TUMOR CLASSIFICATION USING GUSTAFSON KESSEL (G-K) FUZZY CLUSTERING ALGORITHM

BRAIN TUMOR CLASSIFICATION USING GUSTAFSON KESSEL (G-K) FUZZY CLUSTERING ALGORITHM BRAIN TUMOR CLASSIFICATION USING GUSTAFSON KESSEL (G-K) FUZZY CLUSTERING ALGORITHM A. S.Shankar, Dr.A.Asokan and Dr.D.Sivakumar Department o Electronics & Instrumentation Engineering, Annamalai Universit,

More information

Name Date Class. As you read Chapter 13, which begins on page 302 of your textbook, answer the following questions.

Name Date Class. As you read Chapter 13, which begins on page 302 of your textbook, answer the following questions. CHAPTER 13 DIRECTED READING WORKSHEET Animals and Behavior As you read Chapter 13, which begins on page 302 of your textbook, answer the following questions. This Really Happened... (p. 302) 1a. What did

More information

Behavioral Animal Adaptations. Survival of organisms

Behavioral Animal Adaptations. Survival of organisms Behavioral Animal Adaptations Survival of organisms ANIMAL BEHAVIOR BEHAVIOR = anything an animal does in response to a stimulus in its environment What is a stimulus for bears beginning to hibernate?

More information

Behavior. What causes behavior? Chapter 35: Behavioral Adaptations. Honors Biology Wide range of activities

Behavior. What causes behavior? Chapter 35: Behavioral Adaptations. Honors Biology Wide range of activities Chapter 35: Behavioral Adaptations Honors Biology 2013 1 Behavior Wide range of activities Both observable actions and chemical communication Response to internal and external environmental stimuli (environmental

More information

Foundations of Individual Behavior

Foundations of Individual Behavior Robbins & Judge Organizational Behavior 13th Edition Foundations of Individual Behavior Bob Stretch Southwestern College 2-0 Chapter Learning Objectives After studying this chapter, you should be able

More information

Introduction to Computational Neuroscience

Introduction to Computational Neuroscience Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single

More information

How to collect raw honeybee pollen from the hive

How to collect raw honeybee pollen from the hive Published on TECA (http://teca.fao.org) How to collect raw honeybee pollen from the hive SUMMARY: Pollen is collected by the honeybees from the anthers of flowers while they visit them. Pollen is stored

More information

Introduction. Keywords Biological edge detection, Artificial bee colony, Unmanned combat air vehicle, Visual attention. Paper type Research paper

Introduction. Keywords Biological edge detection, Artificial bee colony, Unmanned combat air vehicle, Visual attention. Paper type Research paper via improved artificial bee colony and visual attention State Key Laboratory of Virtual Reality Technology and Systems, School of Automation Science and Electrical Engineering, Beihang University (BUAA),

More information

Strengthening Operant Behavior: Schedules of Reinforcement. reinforcement occurs after every desired behavior is exhibited

Strengthening Operant Behavior: Schedules of Reinforcement. reinforcement occurs after every desired behavior is exhibited OPERANT CONDITIONING Strengthening Operant Behavior: Schedules of Reinforcement CONTINUOUS REINFORCEMENT SCHEDULE reinforcement occurs after every desired behavior is exhibited pro: necessary for initial

More information

Information Processing During Transient Responses in the Crayfish Visual System

Information Processing During Transient Responses in the Crayfish Visual System Information Processing During Transient Responses in the Crayfish Visual System Christopher J. Rozell, Don. H. Johnson and Raymon M. Glantz Department of Electrical & Computer Engineering Department of

More information

MBO: Marriage in Honey Bees Optimization A Haplometrosis Polygynous Swarming Approach

MBO: Marriage in Honey Bees Optimization A Haplometrosis Polygynous Swarming Approach MBO: Marriage in Honey Bees Optimization A Haplometrosis Polygynous Swarming Approach Hussein A. Abbass School of Computer Science, University of New South Wales, University College, ADFA Campus, Northcott

More information

Primary Health-Care Physicians Attitude toward Depression in Primary Health-Care Centers Saudi Arabia - Al-Ahsa, 2018

Primary Health-Care Physicians Attitude toward Depression in Primary Health-Care Centers Saudi Arabia - Al-Ahsa, 2018 Original Article Print ISSN: 2321-6379 Online ISSN: 2321-595X DOI: 10.17354/ijss/2018/296 Primary Health-Care Physicians Attitude toward Depression in Primary Health-Care Centers Saudi Arabia - Al-Ahsa,

More information

A Trade-o4 in Task Allocation between Sensitivity to the Environment and Response Time

A Trade-o4 in Task Allocation between Sensitivity to the Environment and Response Time J. theor. Biol. (2001) 208, 165}184 doi:10.1006/jtbi.2000.2210, available online at http://www.idealibrary.com on A Trade-o4 in Task Allocation between Sensitivity to the Environment and Response Time

More information

Behavioural Ecology. This subdiscipline studies the behaviour of individuals in an ecological context.

Behavioural Ecology. This subdiscipline studies the behaviour of individuals in an ecological context. Behavioural Ecology This subdiscipline studies the behaviour of individuals in an ecological context. In general, the behaviours studies are directed toward food, habitat, and mates. In all three, genetics

More information

Key Ideas. Explain how science is different from other forms of human endeavor. Identify the steps that make up scientific methods.

Key Ideas. Explain how science is different from other forms of human endeavor. Identify the steps that make up scientific methods. Key Ideas Explain how science is different from other forms of human endeavor. Identify the steps that make up scientific methods. Analyze how scientific thought changes as new information is collected.

More information

Gifted Students Purpose in Life

Gifted Students Purpose in Life Universal Journal o Educational Research 6(10): 2210-2216, 2018 DOI: 10.13189/ujer.2018.061019 http://www.hrpub.org Gited Students Purpose in Lie Nur Demirbaş Çelik 1, Hüseyin Mertol 2,* 1 Education Faculty,

More information

Learning Convolutional Neural Networks for Graphs

Learning Convolutional Neural Networks for Graphs GA-65449 Learning Convolutional Neural Networks for Graphs Mathias Niepert Mohamed Ahmed Konstantin Kutzkov NEC Laboratories Europe Representation Learning for Graphs Telecom Safety Transportation Industry

More information

Interviewing: The Driver for All Fraud Investigation

Interviewing: The Driver for All Fraud Investigation Interviewing: The Driver for All Fraud Investigation Understanding what they say, what they write, and what it means changes hard work into better results J O N A T H A N E. T U R N E R C F E, C I I M

More information

Grow Your Own Queen Bees Recap. Presented By: Kevin Lewis

Grow Your Own Queen Bees Recap. Presented By: Kevin Lewis Grow Your Own Queen Bees Recap Presented By: Kevin Lewis Queen Rearing Resources: Michael Bush beekeeping website: http://bushfarms.com/bees.htm Queens -A few good queens & Queen Rearing Michael Palmer

More information

C. Proteins can be extracted from waste cooking water, providing nutrients for starving nations.

C. Proteins can be extracted from waste cooking water, providing nutrients for starving nations. Biology Review : The Arthropods Complete this assignment using the following resources: Chapters 36 & 37 in your text book, the book Creepy Crawlies (C.C.), articles found in class on the black table (which

More information

Topics in Animal Cognition. Oliver W. Layton

Topics in Animal Cognition. Oliver W. Layton Topics in Animal Cognition Oliver W. Layton October 9, 2014 About Me Animal Cognition Animal Cognition What is animal cognition? Critical thinking: cognition or learning? What is the representation

More information

THEORETICAL PERSPECTIVES I. Lecturer: Dr. Paul Narh Doku Contact: Department of Psychology, University of Ghana

THEORETICAL PERSPECTIVES I. Lecturer: Dr. Paul Narh Doku Contact: Department of Psychology, University of Ghana THEORETICAL PERSPECTIVES I Lecturer: Dr. Paul Narh Doku Contact: pndoku@ug.edu.gh Department of Psychology, University of Ghana Session Overview This session will deal with the meaning and scope of psychology,

More information

Animal Behavior 2/21/2017. What is Behavior? Understanding Behavior. Types of Behavior. Types of Behavior

Animal Behavior 2/21/2017. What is Behavior? Understanding Behavior. Types of Behavior. Types of Behavior What is Behavior? Behavior everything an animal does & how it does it response to stimuli in its environment Animal Behavior Why Study Behavior? Evolutionary perspective part of phenotype acted upon by

More information

Introduction to Computational Neuroscience

Introduction to Computational Neuroscience Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis

More information

Exploration and Exploitation in Reinforcement Learning

Exploration and Exploitation in Reinforcement Learning Exploration and Exploitation in Reinforcement Learning Melanie Coggan Research supervised by Prof. Doina Precup CRA-W DMP Project at McGill University (2004) 1/18 Introduction A common problem in reinforcement

More information

Module One: Booklet #7

Module One: Booklet #7 Module One: Booklet #7 Is a relatively permanent change in behaviour that results from experience There are various ways is which people learn (we will look at some learning styles in Module 2) We will

More information

Models of Parent-Offspring Conflict Ethology and Behavioral Ecology

Models of Parent-Offspring Conflict Ethology and Behavioral Ecology Models of Parent-Offspring Conflict Ethology and Behavioral Ecology A. In this section we will look the nearly universal conflict that will eventually arise in any species where there is some form of parental

More information

The Factorized Self-Controlled Case Series Method: An Approach for Estimating the Effects of Many Drugs on Many Outcomes

The Factorized Self-Controlled Case Series Method: An Approach for Estimating the Effects of Many Drugs on Many Outcomes The Factorized Sel-Controlled Case Series Method: An Approach or Estimating the Eects o Many Drugs on Many Outcomes Ramin Moghaddass, Cynthia Rudin MIT CSAIL and Sloan School o Management, Massachusetts

More information

I. Classical Conditioning

I. Classical Conditioning Learning Chapter 8 Learning A relatively permanent change in an organism that occur because of prior experience Psychologists must study overt behavior or physical changes to study learning Learning I.

More information

Realization of Visual Representation Task on a Humanoid Robot

Realization of Visual Representation Task on a Humanoid Robot Istanbul Technical University, Robot Intelligence Course Realization of Visual Representation Task on a Humanoid Robot Emeç Erçelik May 31, 2016 1 Introduction It is thought that human brain uses a distributed

More information

Learning. AP PSYCHOLOGY Unit 4

Learning. AP PSYCHOLOGY Unit 4 Learning AP PSYCHOLOGY Unit 4 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction

More information

operant, behaviors because most of our teaching challenges lie there. Companion parrots

operant, behaviors because most of our teaching challenges lie there. Companion parrots Reprinted by Permission of Good Bird Magazine Vol 3-2; Summer 2007 www.goodbirdinc.com Pavlov s Parrots: Understanding and Extinguishing Learned Fear Triggers By S.G. Friedman, Ph.D. When it comes to behavior

More information

Why do people like extra credit?

Why do people like extra credit? Why do people like extra credit? CLASS OBJECTIVES: What is Operant Conditioning? Ch.8-Learning Classical Conditioning was a good start but B. F. Skinner believed that more behaviors can be explained through

More information

Swarm Cognition in Honey Bees

Swarm Cognition in Honey Bees Swarm Cognition in Honey Bees Kevin M. Passino Dept. Electrical and Computer Eng. Ohio State University 215 Neil Avenue, Columbus, OH 4321, USA passino@ece.osu.edu Thomas D. Seeley Dept. Neurobiology and

More information

Psychological Foundations of Curriculum. Kevin Thompson

Psychological Foundations of Curriculum. Kevin Thompson Psychological Foundations of Curriculum Kevin Thompson Focusing Questions 1. In what ways do psychological foundations enable curriculum workers (teachers, supervisors, and curriculum developers) to perform

More information

The function or adaptive value of signals has been broken down into the following classes:

The function or adaptive value of signals has been broken down into the following classes: Communication notes.doc 1 Communication and signals an action on the part of one animal that alters the behavior of another (Wilson 1975). The essence of communication is the relationship between signaler

More information

Early-life experience affects honey bee aggression and resilience to immune challenge

Early-life experience affects honey bee aggression and resilience to immune challenge SUPPLEMENTARY INFORMATION Early-life experience affects honey bee aggression and resilience to immune challenge Clare C. Rittschof, Chelsey B. Coombs, Maryann Frazier, Christina M. Grozinger, Gene E. Robinson

More information

Artificial Bee Colony (ABC) Optimization for the Prediction of Coronary Heart Disease

Artificial Bee Colony (ABC) Optimization for the Prediction of Coronary Heart Disease Artificial Bee Colony (ABC) Optimization for the Prediction of Coronary Heart Disease Sowmya N. and Dr. R.Vijayabhanu, Department of Computer Science, Avinashilingam Institute for Home Science and Higher

More information

Results & Statistics: Description and Correlation. I. Scales of Measurement A Review

Results & Statistics: Description and Correlation. I. Scales of Measurement A Review Results & Statistics: Description and Correlation The description and presentation of results involves a number of topics. These include scales of measurement, descriptive statistics used to summarize

More information

Learning. Learning is a relatively permanent change in behavior acquired through experience or practice.

Learning. Learning is a relatively permanent change in behavior acquired through experience or practice. Learning Learning is a relatively permanent change in behavior acquired through experience or practice. What is Learning? Learning is the process that allows us to adapt (be flexible) to the changing conditions

More information

Chapter 6: Learning The McGraw-Hill Companies, Inc.

Chapter 6: Learning The McGraw-Hill Companies, Inc. Chapter 6: Learning Learning A relatively permanent change in behavior brought about by experience Distinguishes between changes due to maturation and changes brought about by experience Distinguishes

More information

fertility Preservation for canadian cancer Patients

fertility Preservation for canadian cancer Patients ertility Preservation or canadian cancer Patients ertile uture is a national charity that aspires to ensure every young canadian diagnosed with cancer will have the opportunity and means to have a child.

More information

Classical & Operant Conditioning. Learning: Principles and Applications

Classical & Operant Conditioning. Learning: Principles and Applications Classical & Operant Conditioning Learning: Principles and Applications Which Pen Would You Choose? The researchers placed the participants in the room. In this room the participants first viewed purple

More information

Early Stages of Vision Might Explain Data to Information Transformation

Early Stages of Vision Might Explain Data to Information Transformation Early Stages of Vision Might Explain Data to Information Transformation Baran Çürüklü Department of Computer Science and Engineering Mälardalen University Västerås S-721 23, Sweden Abstract. In this paper

More information

Chapter 40 Animal Behavior

Chapter 40 Animal Behavior 40 Animal Behavior Chapter 40 Animal Behavior Key Concepts 40.1 Behavior Is Controlled by the Nervous System but Is Not Necessarily Deterministic 40.2 Behavior Is Influenced by Development and Learning

More information

IN THE iterated prisoner s dilemma (IPD), two players

IN THE iterated prisoner s dilemma (IPD), two players IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, VOL. 11, NO. 6, DECEMBER 2007 689 Multiple Choices and Reputation in Multiagent Interactions Siang Yew Chong, Member, IEEE, and Xin Yao, Fellow, IEEE Abstract

More information

Evolutionary Computation for Modelling and Optimization in Finance

Evolutionary Computation for Modelling and Optimization in Finance Evolutionary Computation for Modelling and Optimization in Finance Sandra Paterlini CEFIN & RECent, University of Modena and Reggio E., Italy Introduction Why do we need Evolutionary Computation (EC)?

More information

DIGITIZING HUMAN BRAIN: BLUE BRAIN PROJECT

DIGITIZING HUMAN BRAIN: BLUE BRAIN PROJECT DIGITIZING HUMAN BRAIN: BLUE BRAIN PROJECT Diwijesh 1, Ms. Pooja Khanna 2 1 M.tech CSE, Amity University 2 Associate Professor, ASET ABSTRACT Human brain is most complex and unique creation of nature which

More information

Study Guide A. Answer Key. Animal Behavior

Study Guide A. Answer Key. Animal Behavior Animal Behavior Answer Key SECTION 1. ADAPTIVE VALUE OF BEHAVIOR 1. stimulus; behavior 2. Internal; body 3. External; surroundings 4. b, c, a 5. constant; stimuli 6. increase; particular 7. internal; external

More information

CLEVELAND COUNTY BEEKEEPERS ASSOCIATION

CLEVELAND COUNTY BEEKEEPERS ASSOCIATION CLEVELAND COUNTY BEEKEEPERS ASSOCIATION June, 2014 Cleveland County, NC By: Steve Gibson, Program Director, Cleveland County Chapter, NCSBA Extension Agent, Agriculture (Retired) June Beekeeping Notes,

More information

Psychological Hodgepodge. Mr. Mattingly Psychology

Psychological Hodgepodge. Mr. Mattingly Psychology Psychological Hodgepodge Mr. Mattingly Psychology The Number: Eight What is conditioning? Conditioning = learned or trained Classical Conditioning = learning procedure where associations are made Usually

More information

Chapter 7 - Learning

Chapter 7 - Learning Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.

More information

October 21. EQ- How does operant conditioning work? SSPBC1

October 21. EQ- How does operant conditioning work? SSPBC1 Agenda: 1.Daily Sheet 2.Review Classical Conditioning (Ex. From real life) 3.Operant Conditioning (notes, video, lab) 4. Supernanny October 21 EQ- How does operant conditioning work? SSPBC1 Table of Contents:

More information

Learning and conditioning

Learning and conditioning AP Psych Review Assignment Spring 2009 Chapter and Topic of this Review Guide: Learning and conditioning Vocab Term Definition of Term Example Learning Any relatively permanent change in behavior that

More information

Lec 02: Estimation & Hypothesis Testing in Animal Ecology

Lec 02: Estimation & Hypothesis Testing in Animal Ecology Lec 02: Estimation & Hypothesis Testing in Animal Ecology Parameter Estimation from Samples Samples We typically observe systems incompletely, i.e., we sample according to a designed protocol. We then

More information

The EAS Master Beekeeper Program. Part 2. Self-test questions. The oral and written exams

The EAS Master Beekeeper Program. Part 2. Self-test questions. The oral and written exams The EAS Master Beekeeper Program Part 2 Self-test questions The oral and written exams THE ORAL EXAM A sample question might go something like this: I took the beekeeping class this year. It is August

More information

BEHAVIORAL THEORY: CLASSICAL AND OPERANT CONDITIONING

BEHAVIORAL THEORY: CLASSICAL AND OPERANT CONDITIONING SPN 1022 LEARNING IN SCIENCE AND MATHEMATICS BEHAVIORAL THEORY: CLASSICAL AND OPERANT CONDITIONING Dr. Johari bin Surif Department of Science and Mathematics Education Faculty of Education UTM 1 BEHAVIOURISM

More information