OPERATIONAL CONDITIONING

1. OPERATIONAL CONDITIONING

2. Learning Theory Behaviorism: originated in the USA in the early 20th century, it is the study of how human beings behave. It began as a negative response to the subjective study of the mind. It also began as a positive response to studies of observable behavior in animals.

3. OPERANT CONDITIONING Organisms often associate their own actions consequences. In operant conditioning, behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher. Both Classical and Operant Conditioning involve acquisition, extinction, spontaneous recovery, generalization, and discrimination.

4. What does it mean? Acquisition Extinction Spontaneous Recovery Generalization Discrimination Acquisition- associating the neutral stimulus with the unconditioned stimulus Extinction- diminishing the conditioned response by no longer using the conditioned stimulus Spontaneous Recovery- reappearance of the conditioned response Generalization- a stimuli that is similar to the conditioned stimulus will illicit a response. Discrimination- the learned ability to distinguish between a conditioned stimulus and stimuli that do not signal an unconditioned stimulus. Acquisition- associating the neutral stimulus with the unconditioned stimulus Extinction- diminishing the conditioned response by no longer using the conditioned stimulus Spontaneous Recovery- reappearance of the conditioned response Generalization- a stimuli that is similar to the conditioned stimulus will illicit a response. Discrimination- the learned ability to distinguish between a conditioned stimulus and stimuli that do not signal an unconditioned stimulus.

5. The Difference Respondent Behavior: behavior that occurs as an automatic response to some stimuli such as the meat powder Operant Behavior: is behavior that operates on the environment, producing consequences.

6. How to tell the difference between classical and operant conditioning Is the organism learning associations between events that it doesn�t control (classical conditioning)? Or� Is the organism learning associations between its behavior and the resulting events (operant conditioning)?

7. Thorndike�s Law of Effect Thorndike�s principle that behaviors followed by favorable consequences become more likely and behaviors followed by unfavorable consequences become less likely. Using Thorndike�s law of effect as a starting point, B.F. Skinner will develop a behavioral technology.

8. Different Way of Thinking How does a cat learn to escape? Why does a cat �operate� on a puzzle box?

9. B.F. Skinner

10. Skinner�s Learning Theory Skinner believed that there are five main obstacles in learning: 1. People have a fear of failure 2. There is a lack of directions 3. There is also a lack of clarity in the direction 4. Positive reinforcement is not used enough 5. The task is not broken down into small enough steps

11. Skinner�s Solution Skinner suggested that with all of the obstacles out of the way any age appropriate skill can be taught using his 5 principles: 1. Have small steps 2. Work from most simple to most complex tasks 3. Repeat the directions as many times as possible 4. Give immediate feedback 5. Give positive reinforcement

12. Skinner Box

13. Operant Chamber Operant Chamber: a chamber containing a bar or key that an animal can manipulate to obtain food or water. The chamber includes a device to record the animal�s rate of bar pressing.

14. Shaping Procedure The rat is placed in a lit box in a dark room. When the rat faces the lever a food pellet is released. Whenever the rat faces or approaches the lever the food pellet is released.

15. Shaping Procedure The next step would be to only release the pellet when the rat approaches the lever. When the rat shows interest in the lever by sniffing it or touching it, it will receive a pellet.

16. Shaping Procedure When the rat puts his paw on the lever a pellet is released. This final step is continued until the rat puts enough pressure on the lever to release a pellet himself.

17. Bart the Bear

18. Classical vs. OperantConditioning

19. Classical vs. Operant Conditioning

21. Types of Reinforcement Reinforcement: any event that strengthens a behavior. Positive Reinforcement: increasing behavior using positive stimuli such as food. Negative Reinforcement: increasing behaviors by stopping or reducing negative stimuli.

22. Primary Reinforcers An innately reinforcing stimulus, such as one that satisfies a biological need. (Food, water, sleep)

23. Continuous Reinforcement Continuous reinforcement � constant delivery of reinforcement for an action; every time a specific action was performed the subject instantly and always received a reinforcement. This method is prone to extinction and is very hard to enforce.

24. Ways to Increase Behavior

25. Schedules of Reinforcement Part of Skinner's analysis of behavior involved not only the power of a single instance of reinforcement, but the effects of particular schedules of reinforcement over time. Skinner's types of schedules of reinforcement involved: 1. interval (fixed or variable) 2. ratio (fixed or variable)

26. Interval Reinforcement (Fixed) � reinforcement is set for certain times. Example: The first response after a fixed time. The behavior increases when the time approaches. (Variable) � times between reinforcement are not set, and often differ. Example: Unpredictable time intervals. Every time a card with diamonds appears from the deck you get sprayed.

27. Ratio Reinforcement (Fixed) � deals with a set amount of work needed to be completed before there is reinforcement. Example: Behavior is reinforced after a set number of responses. One reinforcer for every 30 responses. (Variable) � amount of work needed for the reinforcement differs from the last. Example: Times of reinforcement are unpredictable. Person keeps pulling the handle of the slot machine waiting for the winnings.

28. PUNISHMENT

29. Punishment Punishment is a consequence that decreases the likelihood of a behavior occurring again. Examples: Heavy fines for misbehavior in sports. Sitting in I.S.S. after several tardies to school. Losing eligibility to play sports after poor grades.

30. Punishment cont� Even though punishment suppresses unwanted behavior it does not guide one toward the desirable behavior. Parents of delinquent youth often lack the awareness of how to reinforce the desirable behavior. Psychologists favor positive/negative reinforcement over punishment in child-rearing.

31. Ways to Decrease Behavior

32. Cognition and Operant Conditioning Evidence of cognitive processes has come from studying rats in mazes. Rats exploring a maze with no obvious reward will wander at their leisure. The rats will develop a cognitive map of the maze. When a reward is present the rat can get through the maze very quickly.

33. Latent Learning Latent learning is learning that occurs but is not apparent until there is an incentive to demonstrate it. The result of this theory is that there may be more to learning than associating a response with a consequence.

34. Intrinsic Motivation Intrinsic motivation involves a desire to perform a behavior for its own sake. In experiments, children who were rewarded for a task they already enjoy found the task less desirable. �If I have been bribed into doing this it must not be worth doing.�

35. Extrinsic Motivation Extrinsic motivation involves a desire to perform a behavior due to promised rewards or threats of punishment. You study for the test so you will be rewarded with a good grade. If there was no grade at stake would you study tonight? If yes then you are intrinsically motivated.

36. Contrasting Classical vs. Operant Conditioning Classical Involuntary, automatic Associating Events CR decreases when CS is presented alone.

37. The Air Crib In an effort to help his wife cope with the day to day tasks of child rearing, Skinner � a consummate inventor � thought he might be able to improve upon the standard crib. He invented the 'air-crib' to meet this challenge. An 'air-crib� (also known as a 'baby tender' or humorously as an 'heir conditioner') is an easily-cleaned, temperature and humidity-controlled box Skinner designed to assist in the raising of babies.