Levente L. Orbán
doi: 10.69642/5323
Learning is a central concept in psychology, governing how organisms adapt to their environments. This paper revisits foundational theories of associative learning, with an emphasis on classical conditioning, as discovered by Ivan Pavlov, and operant conditioning, as developed by B.F. Skinner. Drawing from a transcript of a live undergraduate lecture, we explore theoretical models, empirical evidence, practical examples, and mathematical structures underlying these learning mechanisms. The aim is to distill key insights while highlighting the contemporary relevance of behaviorist principles in domains like behavioral design, education, and machine learning.
Learning, broadly defined, is a relatively permanent change in behavior due to experience. From bacteria adjusting to antibiotics to humans forming complex habits, learning allows organisms to adapt beyond the slow mechanism of genetic evolution. In this lecture-based synthesis, we focus on associative learning—mechanisms by which associations between stimuli and responses are formed, particularly classical and operant conditioning.
Psychologists define learning as a change in behavior that results from experience. Unlike reflexes or fixed action patterns which are innate, learning is flexible, allowing organisms to respond to changes in their environment.
Ivan Pavlov, a Russian physiologist, discovered classical conditioning while studying digestive processes in dogs. He observed that dogs salivated not only when food was presented, but also in response to stimuli associated with food delivery (e.g., footsteps, lab coats).
Acquisition occurs when the CS and US are repeatedly paired. Extinction happens when the CS is presented without the US, leading to a weakening of the CR. Spontaneous recovery may occur, indicating the response was suppressed, not unlearned.
Thorndike observed that behaviors followed by satisfying outcomes are more likely to be repeated. His puzzle box experiments with cats demonstrated learning through trial and error.
Skinner designed the operant chamber (“Skinner Box”) to systematically study reinforcement. Rats learned to press levers for food, and pigeons learned to peck discs.
Behavioral schedules can be modeled probabilistically. For example, the expected number of responses in a Variable Ratio schedule before reinforcement is:
E(R) = 1 / p
Extinction curves can be modeled using exponential decay:
CR(t) = CR₀ · e^(−λt)
The distinction between classical and operant conditioning lies in the role of the learner: passive in the former, active in the latter. Yet both are foundational to understanding how behavior is shaped in natural and designed environments.
Associative learning remains a cornerstone of psychological theory and application. While modern neuroscience has shifted the field’s focus, the robustness and elegance of behaviorist insights continue to inform domains ranging from education to AI.
The content of this paper was developed from a live undergraduate lecture given at the University of the South Pacific in March 2025.