operant conditioning

operant conditioning
Name	Operant Conditioning
Field	Behavioral psychology
Founded	Early 20th century
Key people	B.F. Skinner, Edward Thorndike
Related	Behaviorism, Reinforcement, Punishment (psychology)

operant conditioning is a fundamental theory of learning within behavioral psychology that examines how behavior is shaped by its consequences. Pioneered primarily by B.F. Skinner building upon earlier work by Edward Thorndike, it posits that behaviors followed by favorable outcomes are more likely to recur, while those followed by unfavorable outcomes become less frequent. This process of learning through consequences forms the basis for understanding a wide range of behaviors, from simple animal training to complex human social interactions, and has been applied extensively in fields such as applied behavior analysis, education, and clinical therapy.

Principles and concepts

The core principle involves the relationship between a voluntary behavior, known as an operant behavior, and the environmental consequence that follows it. Central concepts include reinforcement, which increases behavior, and punishment (psychology), which decreases it. Reinforcement can be positive reinforcement, involving the presentation of a desirable stimulus like food or praise, or negative reinforcement, involving the removal of an aversive stimulus like a loud noise or electric shock. Similarly, punishment involves either presenting an aversive stimulus or removing a pleasant one. The effectiveness of these consequences is governed by schedules of reinforcement, such as fixed-ratio schedule or variable-interval schedule, studied extensively by Skinner using apparatus like the operant conditioning chamber or "Skinner box." Other key ideas include the role of discriminative stimulus in signaling when a behavior will be reinforced and the process of shaping (psychology) to gradually develop complex behaviors.

Historical background

The intellectual foundations were laid by Edward Thorndike through his experiments with cats in puzzle boxes, leading to his formulation of the law of effect. This early work was absorbed into the broader movement of behaviorism, championed by figures like John B. Watson. B.F. Skinner became the theory's most influential proponent, systematically expanding Thorndike's ideas through rigorous experimentation, often with pigeons and rats, and detailing his philosophy in works like *Walden Two* and *Beyond Freedom and Dignity*. His research at institutions like Harvard University established operant conditioning as a dominant paradigm in mid-20th century psychology, influencing contemporaries such as Keller and Schoenfeld and later figures in applied behavior analysis like Ivar Lovaas.

Procedures and techniques

Standard experimental procedures involve placing a subject, such as a laboratory rat, in a controlled environment like an operant conditioning chamber. The subject learns to perform a specific action, like pressing a lever, to receive a consequence. Techniques for modifying behavior include shaping (psychology), where successive approximations are reinforced, and chaining, used to teach sequences of behaviors. Extinction (psychology) occurs when reinforcement is withheld, leading to a decline in the previously learned behavior. The timing and pattern of delivering consequences, known as schedules of reinforcement, are critical variables, with different schedules like fixed-interval schedule producing distinct patterns of responding, a key finding in the experimental analysis of behavior.

Applications

Applications are vast and impactful, particularly within applied behavior analysis. This approach is used in autism therapy, notably in early intensive interventions developed by Ivar Lovaas. In education, techniques like token economy systems are implemented in classrooms. The principles inform behavior modification programs in clinical psychology for issues like phobias and addiction, and are used in organizational settings for performance management. Animal trainers at facilities like SeaWorld utilize shaping and reinforcement to train complex behaviors. Furthermore, the concepts underlie many parenting strategies and are integrated into some cognitive behavioral therapy protocols.

Comparison with classical conditioning

While both are learning theories within behaviorism, they are fundamentally distinct. Classical conditioning, pioneered by Ivan Pavlov, involves associating an involuntary, reflexive response with a new stimulus, as in Pavlov's experiments with dogs and salivation. In contrast, it deals with voluntary behaviors and their consequences. The work of John B. Watson and Rosalie Rayner in the Little Albert experiment demonstrated classical conditioning of emotional responses, whereas Skinner's work focused on how actions operate on the environment. The two processes often interact in real-world learning, a relationship explored by psychologists like Robert Rescorla.

Criticisms and limitations

Criticisms have emerged from several schools of thought. Cognitive psychology argues it neglects internal mental processes like cognition and intrinsic motivation, a perspective advanced by figures like Albert Bandura in his work on social learning theory. Humanistic psychology, represented by Carl Rogers and Abraham Maslow, criticizes its mechanistic view of human behavior. Ethical concerns have been raised regarding the use of control and manipulation, as suggested by Skinner's novel *Walden Two*. Furthermore, limitations include explaining complex language acquisition, a point contested by Noam Chomsky in his review of Skinner's *Verbal Behavior*, and the phenomenon of instinctive drift observed by Keller Breland and Marian Breland.

Category:Behaviorism Category:Learning