Study sheet: HP1000 WK5 Learning

📋 Course Outline

1. Foundations of Learning
2. Classical Conditioning Elements
3. Classical Conditioning Principles
4. Classical Conditioning Applications
5. Operant Conditioning
6. Cognitive and Observational Learning
7. Biological Preparedness and Conditioning
8. Operant Conditioning Foundations
9. Reinforcement and Its Types
10. Schedules of Reinforcement
11. Punishment and Behavior Reduction
12. Neural Bases of Learning
13. Punishment Types and Limitations
14. Effective Punishment Principles
15. Stimulus Control and Behavior Change
16. Biological Constraints and Cognitive Learning
17. Insight Learning in Chimpanzees
18. Learned Helplessness and Control

📖 1. Foundations of Learning

🔑 Key Concepts & Definitions

• Learning : Any relatively permanent change in behavior or mental processes brought about by experience or practice.
• Reflex : An unlearned, involuntary response to a specific stimulus in the environment.
• Fixed action pattern : A motivated, complex behavior with a strong innate basis that is triggered by a broad range of events.

📝 Essential Points

📌 Learning differs from maturation because learning is shaped by experience or practice, whereas maturation consists of genetically controlled biological changes.

💡 Memory Hook

Learning changes through experience, whereas maturation changes through biology.

📖 2. Classical Conditioning Elements

🔑 Key Concepts & Definitions

• Classical conditioning : The process by which a stimulus that produces an innate response becomes associated with a previously neutral stimulus, which then acquires the power to elicit the same response.
• Unconditioned stimulus : A naturally occurring stimulus that leads to an involuntary and unlearned response.
• Conditioned stimulus : A previously neutral stimulus that becomes able to produce a learned response after being paired with an unconditioned stimulus.
• Conditioned response : A learned, reflex-like response to a conditioned stimulus.

📝 Essential Points

• Ivan Pavlov studied classical conditioning using dogs that salivated naturally when food was placed in their mouths.

💡 Memory Hook

NS + UCS → UCR; repeated pairings make CS → CR.

📖 3. Classical Conditioning Principles

🔑 Key Concepts & Definitions

• Extinction : The disappearance or weakening of a learned response after the unconditioned stimulus or reinforcer is removed or absent.

• Spontaneous recovery : The reappearance of a learned response after extinction has occurred.
• Stimulus generalization : The tendency to respond to a stimulus similar to the original conditioned stimulus with the conditioned response.
• Stimulus discrimination : Occurs when an organism learns to respond differently to stimuli because only one of them has been paired with the unconditioned stimulus.

📝 Essential Points

📌 For classical conditioning to occur, the conditioned stimulus must precede the unconditioned stimulus, occur close to it in time, and be paired with it several times.

• Acquisition is the repeated pairing of a neutral stimulus with an unconditioned stimulus until the neutral stimulus becomes a conditioned stimulus.

💡 Memory Hook

Acquisition → extinction → spontaneous recovery.

📖 4. Classical Conditioning Applications

🔑 Key Concepts & Definitions

• Conditioned taste aversion : The development of a nausea or aversive response to a particular taste because that taste was followed by a nausea reaction, sometimes after only one association.
• Biological preparedness : The tendency of animals to learn certain associations more easily because those associations have survival value.
• Vicarious conditioning : The classical conditioning of an involuntary response or emotion by watching another person’s reaction.
• Higher-order conditioning : Occurs when a strong conditioned stimulus is paired with a neutral stimulus, causing the neutral stimulus to become a second conditioned stimulus.

📝 Essential Points

• In the Little Albert experiment, a loud noise served as the unconditioned stimulus, fear of the noise was the unconditioned response, a white rat became the conditioned stimulus, and fear of the rat became the conditioned response after seven pairings.

💡 Memory Hook

Conditioned cues paired with emotional or biological outcomes produce learned responses.

📖 5. Operant Conditioning

🔑 Key Concepts & Definitions

• Operant conditioning : The process by which a voluntary behavior becomes more or less probable depending on its pleasant or unpleasant consequences.
• Reinforcement : Any event or stimulus that follows a response and increases the probability that the response will occur again.
• Primary reinforcer : Intrinsically reinforcing because it fulfills an innate biological need, such as hunger, thirst, touch, pleasure, or affection.
• Secondary reinforcer : Has no inherent value but becomes reinforcing after being paired with primary reinforcers, as with money, praise, or gold stars.

📝 Essential Points

📌 Positive reinforcement adds a pleasant stimulus to increase behavior, negative reinforcement removes an unpleasant stimulus to increase behavior, positive punishment adds an unpleasant stimulus to decrease behavior, and negative punishment removes a pleasant stimulus to decrease behavior.

📌 Thorndike’s law of effect states that a voluntary response followed by a pleasurable consequence tends to be repeated, whereas a response followed by an unpleasant consequence tends not to be repeated. — Edward Thorndike

💡 Memory Hook

Classical conditioning predicts involuntary responses; operant conditioning changes voluntary actions through consequences.

📖 6. Cognitive and Observational Learning

🔑 Key Concepts & Definitions

• Latent learning : Edward Tolman, 1930 — Learning that occurs without reinforcement but is not observable in behavior until there is a reason to demonstrate it.
• Learned helplessness : Martin Seligman — The tendency to fail to act to escape a situation because of a history of repeated failures in the past.
• Observational learning : Learning that occurs by watching social models and the consequences of their behavior rather than through direct experience.

📝 Essential Points

• In Bandura’s Bobo doll experiment, children who witnessed aggression showed more aggressive behavior, no direct reinforcement was needed, and imitation was reduced when the model was punished. — Albert Bandura

• Observational learning requires:

  • attention
  • memory
  • imitation
  • desire

💡 Memory Hook

Attention → memory → imitation → desire.

📖 7. Biological Preparedness and Conditioning

🔑 Key Concepts & Definitions

• Biological preparedness : the tendency of animals to learn certain associations, such as taste and nausea, after only one or a few pairings because the learning has survival value.
• Drug-related conditioned cues : People, settings, and objects repeatedly associated with drug use can become conditioned stimuli that produce a conditioned high response and make drug use harder to resist.

★ Must-know

• Mammals are biologically prepared to associate taste with illness, whereas birds are biologically prepared to associate visual characteristics with illness. — Shapiro et al., 1980

• Monkeys learned to fear toy snakes and crocodiles by watching fearful reactions in other monkeys, but they did not learn to fear flowers or toy rabbits through the same vicarious conditioning.

Further detail

• A moth whose coloring mimics the poisonous monarch butterfly is avoided by birds even though the moth itself is edible.

💡 Memory Hook

Survival value → rapid stimulus–response associations

📖 8. Operant Conditioning Foundations

🔑 Key Concepts & Definitions

• Operant conditioning : the learning of voluntary behavior through the effects of pleasant and unpleasant consequences on responses.
• Operant : any voluntary behavior that is not elicited by specific stimuli.

📝 Essential Points

• In Thorndike’s puzzle-box experiment, cats gradually escaped more quickly after accidentally pressing a lever that produced escape and food.

💡 Memory Hook

Classical conditioning precedes the response; operant conditioning follows it with consequences

📖 9. Reinforcement and Its Types

🔑 Key Concepts & Definitions

• Primary reinforcer : naturally reinforces behavior by meeting a basic biological need, such as hunger, thirst, or touch.
• Secondary reinforcer : becomes reinforcing after being paired with a primary reinforcer, such as money, praise, tokens, or gold stars.

★ Must-know

📌 Positive reinforcement strengthens a response by adding or providing a pleasurable stimulus, whereas negative reinforcement strengthens a response by removing, avoiding, or escaping an unpleasant stimulus.

Further detail

• Secondary reinforcers acquire their reinforcing power through classical conditioning because a previously neutral stimulus becomes associated with pleasure from a primary reinforcer.

• Submitting an income-tax return before the deadline is negatively reinforced when it prevents an unpleasant penalty.

💡 Memory Hook

Positive adds something; negative removes something, but both strengthen behavior

📖 10. Schedules of Reinforcement

🔑 Key Concepts & Definitions

• Partial reinforcement effect : Skinner, 1956 — the tendency for a response reinforced after some but not all correct responses to be more resistant to extinction than a continuously reinforced response.
• Fixed interval schedule : provides reinforcement after the same interval of time has passed, provided at least one correct response occurs.
• Variable interval schedule : provides reinforcement after different intervals of time, requiring a response after each unpredictable interval.
• Fixed ratio schedule : provides reinforcement after the same number of responses each time.
• Variable ratio schedule : provides reinforcement after a different number of responses on each trial or event.

📝 Essential Points

📌 Reinforcement is generally most effective when it follows the desired behavior immediately and is given only for the desired behavior.

💡 Memory Hook

FI, VI, FR, VR

📖 11. Punishment and Behavior Reduction

🔑 Key Concepts & Definitions

• Punishment : any event or object that follows a response and makes that response less likely to happen again.

★ Must-know

📌 Punishment by application decreases behavior by adding something unpleasant, whereas punishment by removal decreases behavior by removing something pleasant or desired.

Further detail

• Spanking or scolding after disobedience is punishment by application because an unpleasant stimulus is added.

• Examples of punishment by removal include:

  • grounding a teenager
  • placing a child in time-out
  • fining someone
  • taking away Internet privileges

💡 Memory Hook

Reinforcement strengthens behavior; punishment weakens it

📖 12. Neural Bases of Learning

📝 Essential Points

• Neurons in the anterior cingulate cortex and the nucleus accumbens participate in learning and reinforcement, and both areas are involved in dopamine release.

• A phone notification sound can become a conditioned stimulus for pleasure because it is associated with the rewarding experience of reading messages.

📖 13. Punishment Types and Limitations

★ Must-know

📌 Punishment by application weakens a response by adding or applying an unpleasant stimulus, whereas punishment by removal weakens a response by removing a pleasurable or desired stimulus.

📌 Negative reinforcement removes an unpleasant stimulus and increases the likelihood of a response, whereas punishment by removal takes away a pleasant stimulus and decreases the likelihood of a response.

• Punishment often suppresses behavior temporarily, after which the behavior may return through spontaneous recovery when the punishment is forgotten.

Further detail

• Examples of punishment by removal include: grounding a teenager, placing a child in time-out, fining someone for breaking the law, taking away Internet privileges after aggressive behavior

• Severe punishment may:

  • cause avoidance of the punisher
  • encourage lying
  • create fear and anxiety
  • model aggression
  • provide attention that reinforces misbehavior

💡 Memory Hook

Add something unpleasant: application; remove something pleasant: removal.

📖 14. Effective Punishment Principles

★ Must-know

• Punishment should immediately follow the behavior it targets because delayed punishment is not effectively associated with that behavior.

• Punishment should be consistent by following through on promised consequences and maintaining or slightly increasing their intensity rather than decreasing it.

• Punishing inappropriate behavior should be paired with reinforcement of the desired replacement behavior whenever possible.

Further detail

• A time-out is a mild punishment by removal in which a misbehaving person is removed from the possibility of positive attention, and for children it should last 1 minute per year of age up to a maximum of 10 minutes.

💡 Memory Hook

Immediate, consistent, then reinforce the desired behavior.

📖 15. Stimulus Control and Behavior Change

🔑 Key Concepts & Definitions

• Discriminative stimulus : a cue that signals which response will produce reinforcement
• Shaping : the reinforcement of successive approximations, or small steps that increasingly resemble a desired complex behavior
• Behavior modification : the application of learning techniques to change undesirable behavior and increase desirable behavior in animals and humans
• Applied behavior analysis : a form of behavior modification that analyzes current behavior, breaks skills into simple steps, and teaches them through reinforcement while gradually withdrawing prompts
• Instinctive drift : an animal’s tendency to revert to genetically controlled patterns of behavior despite operant conditioning
• Token economy : a system that uses tokens as secondary reinforcers that can be accumulated and exchanged for desired items or privileges

📝 Essential Points

• 🔄 Shaping a complex behavior involves: starting with an existing behavior, reinforcing a small approximation, gradually increasing the requirement, reinforcing each successive approximation until the goal is reached

💡 Memory Hook

Cues signal responses; reinforcement strengthens them; shaping builds complex behavior.

📖 16. Biological Constraints and Cognitive Learning

🔑 Key Concepts & Definitions

• Latent learning : Edward Tolman, 1930 — learning that remains hidden until applying it becomes useful

★ Must-know

• In Tolman and Honzik’s 1930 maze experiment, rats that received no reinforcement for the first 9 days solved the maze almost immediately after reinforcement began on Day 10, suggesting that they had formed a cognitive map during unrewarded exploration. — Tolman & Honzik, Introduction and removal of reward and maze learning in rats

Further detail

• Cognitive learning theory developed partly because psychologists argued that thoughts, feelings, expectations, and other mental events influence observable behavior.

💡 Memory Hook

Conditioning changes behavior through consequences, whereas latent learning can remain hidden until useful.

📖 17. Insight Learning in Chimpanzees

🔑 Key Concepts & Definitions

• Insight : the sudden perception of relationships among various parts of a problem, allowing its solution to come quickly

★ Must-know

• In Köhler’s 1925 study, the chimpanzee Sultan first used a stick to rake a banana closer and later fitted two sticks together to create a pole long enough to reach the banana.

Further detail

📌 Köhler concluded that Sultan’s rapid perception of the relationship between the two sticks could not be explained by trial-and-error learning alone.

💡 Memory Hook

Sultan suddenly joins two sticks into one long pole to reach the banana.

📖 18. Learned Helplessness and Control

🔑 Key Concepts & Definitions

• Observational learning : learning a new behavior by watching a model perform that behavior

★ Must-know

📌 The learning-performance distinction states that learning can occur without the learner actually performing the learned behavior.

📌 Consequences influence motivation to imitate: children were more likely to imitate an aggressive model spontaneously when they saw the model rewarded, but they imitated a punished model when promised a reward for demonstrating the behavior. — Bandura, 1965

• In Seligman’s studies, dogs first experienced an inescapable tone paired with a shock, were then placed in a divided box where they could escape by jumping over a low barrier, and nevertheless remained in the shock area instead of escaping.

• In Bandura’s Bobo doll study, children who watched an aggressive adult model later imitated the model’s aggressive actions without receiving reinforcement.

• 🔄 The four elements of observational learning are: (Bandura, 1986):

  1. Attention to the model
  2. Memory for what was done
  3. Imitation of the model’s actions
  4. Desire or motivation to perform the action

Further detail

📌 Seligman proposed that learned helplessness could resemble depression because both may involve powerlessness, hopelessness, apathy, and remaining in unpleasant situations instead of trying to change them.

• The ventromedial prefrontal cortex helps determine whether a stressor is controllable, inhibits the dorsal raphe nucleus, and reduces the amygdala’s response so that effective control can be expressed. — Maier

• Maier and colleagues proposed that training and input from the ventromedial prefrontal cortex are necessary for animals to learn to take control of stressors. — Maier et al., 2006

• Media that models helping behavior can decrease aggressive behavior and increase prosocial behavior in children.

💡 Memory Hook

Repeated uncontrollable failure → reduced attempts to escape, even when escape becomes possible.

📊 Synthesis Tables

Four Forms of Learning

Type	Mechanism	Key outcome
Classical conditioning	Association between stimuli	Predict involuntary responses
Operant conditioning	Consequences of actions	Increase or decrease voluntary behavior
Cognitive learning	Mental processes	Learning can occur without observable behavior
Observational learning	Watching others	Learning can occur without direct experience

Classical and Operant Conditioning

Dimension	Classical conditioning	Operant conditioning
Behavior	Involuntary and automatic	Voluntary and emitted
What forms the association	Antecedent stimuli	Consequences
Learning outcome	A new response to a stimulus	An increased rate of an existing response
Expectancy	The UCS is expected after the CS	Reinforcement is expected after the response