4. Foundations: Skinner

What this lecture covers

After a brief return to Freud (a hypothesis about why the unconscious might have evolved as a tool of self-deception), this lecture turns to the second "grand theory" of the course: behaviorism, as developed and popularized by B. F. Skinner. Bloom presents behaviorism's three radical claims — that behavior is entirely learned, that internal mental states are unscientific, and that learning principles apply equally across species — and works through the three learning mechanisms behaviorists relied on: habituation, classical conditioning, and operant conditioning.

After watching, you should be able to explain classical and operant conditioning with concrete examples, describe techniques like shaping and the partial reinforcement effect, and explain why behaviorism, despite leaving real scientific contributions, is no longer accepted as a complete account of the mind, including Noam Chomsky's critique of its unfalsifiability.

Key ideas

• Behaviorism's core claims: nearly everything is learned rather than innate, mental states like desires and goals are unscientific to invoke, and the same learning principles apply across humans and other animals.
• Habituation: the simplest form of learning, a decline in response to a stimulus after repeated exposure, useful for filtering out familiar, harmless events.
• Classical conditioning: pairing a neutral (conditioned) stimulus with an unconditioned stimulus, as in Pavlov's dogs, so the conditioned stimulus alone eventually produces a learned response; illustrated by the Little Albert experiment and used to explain phobias.
• Extinction and spontaneous recovery: a conditioned response fades without reinforcement (extinction), but can partially return later without retraining (spontaneous recovery).
• Operant (instrumental) conditioning: Skinner's theory that voluntary behaviors are strengthened by reward and weakened by punishment, following Thorndike's law of effect observed in cats escaping puzzle boxes.
• Shaping: training complex behavior by rewarding successive approximations to a goal, rather than waiting for the full behavior to occur.
• Reinforcement schedules and the partial reinforcement effect: intermittent reward (as in slot machines) produces behavior that is more persistent and resistant to extinction than constant reward.
• Why behaviorism was rejected as a complete theory: evidence of innate knowledge, rats forming mental maps without reinforcement (Tolman), species-specific learning constraints (the Garcia effect), and Noam Chomsky's argument that Skinner's application of reinforcement to human language was either trivially true or unfalsifiable.

Walkthrough

A brief review of the unconscious (0:00)

Bloom returns to a question skipped in the Freud lecture: why an unconscious might have evolved. He presents the hypothesis that self-deception makes people better liars, since believing your own false claims makes them harder to detect, illustrating this with an anecdote about Alfred Hitchcock coaxing tears from a child actor.

B. F. Skinner and behaviorism (6:32)

He introduces behaviorism as a school of thought that predates Skinner but that Skinner popularized, contrasting it with Freud's solitary invention of psychoanalysis. He lays out its three radical claims: strong environmentalism (illustrated by John Watson's boast that he could train any infant into any profession), anti-mentalism (rejecting unobservable mental states as unscientific), and the claim that learning principles are the same across species, justifying the study of rats and pigeons as a stand-in for humans.

Habituation and classical conditioning (11:45)

Bloom explains habituation as the simplest form of learning, then presents classical conditioning through Pavlov's discovery that dogs learned to salivate at a bell paired with food, introducing the terms unconditioned/conditioned stimulus and response, reinforced versus unreinforced trials, extinction, and spontaneous recovery. He covers the Little Albert experiment, where a baby's neutral response to a rat became fear after pairing with a loud noise, and applies the framework to phobias, food-related cues for hunger, and speculative accounts of sexual fetishes, noting that modern theory treats conditioning as preparation for an upcoming event rather than simple association.

Operant conditioning (31:18)

He introduces operant conditioning through Thorndike's puzzle-box cats, framing the law of effect as a Darwinian-style selection among behaviors. Using the example of training a pig, Bloom explains positive versus negative reinforcement, shaping through successive approximation, and how reinforcers can themselves become rewarding through pairing (as with saying "good dog"). He then covers reinforcement schedules (fixed/variable, ratio/interval) and the partial reinforcement effect, explaining why intermittent reward, as in slot machines or a child's nagging, produces the most persistent behavior.

Question and answer on behaviorism (45:12)

Students ask about extinction of arbitrary reinforcers like poker chips and whether Skinnerian psychologists shaped prison systems; Bloom explains that token economies in institutions do draw on behaviorist principles even without direct involvement from Skinner himself.

Controversies and criticisms of behaviorism (46:44)

Bloom summarizes why all three of behaviorism's core claims are now considered mistaken: evidence for innate knowledge across domains, Tolman's demonstration that rats form mental maps without reinforcement, and the Garcia effect showing that taste-nausea associations form far more readily than other stimulus-response pairings, revealing species-specific learning constraints. He closes with Noam Chomsky's influential critique of Skinner's book "Verbal Behavior," arguing that applying reinforcement concepts to human language is either trivially true or an unfalsifiable restatement of ordinary explanations, a critique widely credited with ending behaviorism's dominance while its concrete learning mechanisms remain scientifically useful today.

Before you watch

• This lecture follows Lecture 3 on Freud, and continues the course's pattern of presenting a grand theory before critically assessing it.
• Familiarity with the idea of falsifiability from the Freud lecture is useful background for the discussion of Chomsky's critique.

Check your understanding

1. What is the difference between classical conditioning and operant conditioning?
2. How does shaping allow trainers to teach behaviors, like a pig dancing, that would never occur naturally?
3. Why does intermittent reinforcement produce behavior that is harder to extinguish than constant reinforcement?
4. What did Tolman's maze experiments and the Garcia effect each reveal about the limits of pure behaviorism?
5. What is the core of Chomsky's criticism of Skinner's account of human language, and how does it echo the earlier critique of Freud?