Definition
Operant conditioning is the learning process in which voluntary behavior that an organism emits by “operating” on its environment, that is, operant behavior, increases or decreases depending on the consequences that follow it. Skinner took the position of radical behaviorism, which holds that rather than speculating about inner mental processes, we should precisely analyze the relationship between observable behavior and the environment.
The theory is treated as a basic theory in many fields, including the learning theory unit of educational psychology, behavior modification, applied behavior analysis (ABA), the behavioral model in social work practice, and the design of organizational rewards.
Key Concepts
Difference from classical conditioning
Pavlov's classical conditioning is a process of associating one stimulus with another, such as a bell and food, so that a respondent (involuntary) behavior such as salivation is learned. Operant conditioning differs in that it associates a behavior with its consequence, so that a voluntary behavior such as pressing a lever is learned.
The law of effect
Skinner's theory experimentally refined Thorndike's law of effect: responses followed by satisfying consequences are strengthened, and responses followed by unpleasant consequences are weakened. Thorndike observed that the time cats took to escape from a puzzle box decreased with repeated trials.
Discriminative stimuli and the three-term contingency
Behavior does not occur in a vacuum. Skinner analyzed behavior through the relationship antecedent (discriminative) stimulus – behavior – consequence, the three-term contingency. If pressing a lever produces food only when a light is on, a rat comes to press the lever only when the light is on.
Stages and Components
Four types of reinforcement and punishment
| Stimulus presented | Stimulus removed | |
|---|---|---|
| Behavior increases | Positive reinforcement: praise, pocket money, stickers | Negative reinforcement: nagging stops when homework is finished |
| Behavior decreases | Positive punishment: scolding, demerit points | Negative punishment: loss of game time, time-out |
“Negative reinforcement” is often mistaken for punishment, but negative reinforcement increases a behavior by removing an unpleasant stimulus.
Schedules of reinforcement
- Fixed ratio (FR): reinforcement after a set number of responses (e.g., a bonus for every 10 items produced).
- Variable ratio (VR): reinforcement after an unpredictable number of responses around an average. It produces high response rates and the greatest resistance to extinction (e.g., lotteries, slot machines).
- Fixed interval (FI): reinforcement for the first response after a set time has passed. Responses cluster just before reinforcement (e.g., studying right before a scheduled exam).
- Variable interval (VI): reinforcement at unpredictable time intervals (e.g., unannounced pop quizzes).
Shaping and extinction
Creating a new behavior by reinforcing successive approximations to the target behavior is called shaping (the method of successive approximations). When reinforcement stops, the behavior gradually decreases, which is called extinction; early in extinction, an extinction burst, a temporary surge in the behavior, may occur.
Theorists and Background
Skinner (1904–1990) earned his doctorate in psychology at Harvard University and systematized research on operant conditioning in The Behavior of Organisms (1938). He analyzed behavior quantitatively by devising an apparatus in which rats and pigeons press levers or keys to obtain food (the operant conditioning chamber, commonly called the “Skinner box”) and a cumulative recorder that automatically records responses. Schedules of Reinforcement (1957), written with Ferster, is a landmark study that documented response patterns under different reinforcement arrangements.
Applying learning principles to education, he proposed programmed instruction, which divides material into small steps with immediate feedback, and the teaching machine (1954). These ideas influenced immediate feedback in today's e-learning and mastery learning design. Behaviorism is introduced as the “second force” in psychology, in contrast with psychoanalysis, which emphasized the unconscious.
Cash Note
청년문화예술패스 하반기 추가 발급 — 2006·2007년생 최대 20만 원, 11월 30일까지
3 readers so far
Make Korean friends & friends from around the world learning Korean
Chat easily with people from many countries who love Korea.
Beauty UP
대학생 가성비 기초 루틴 — 꼭 필요한 3단계만 남기기
Psych UP
나의 돈 성향 테스트｜저축 다람쥐? 오늘만 사는 플렉서?
Criticisms and Limitations
- Ignoring cognitive processes: In his review of Skinner's Verbal Behavior, Chomsky (1959) argued that language acquisition cannot be explained by reinforcement alone, and this became one of the triggers of the cognitive revolution.
- Inadequate account of observational learning: Learning by watching others without receiving direct reinforcement was addressed by Bandura's social learning theory.
- Undermining intrinsic motivation: A meta-analysis by Deci, Koestner and Ryan (1999) reported that expected tangible rewards for interesting tasks can reduce intrinsic motivation. This is also compared with the finding of cognitive dissonance theory that small rewards produce greater attitude change.
- Ethical concerns: The theory is criticized for treating human behavior as an object of control and manipulation and for the side effects of punishment (fear, avoidance, aggression).
Applying It in a Report
Classroom management and behavior modification plans
For a student who often leaves their seat during class, you can write a behavior modification plan in this order: baseline measurement → defining the target behavior → token reinforcement and shaping → moving from continuous to intermittent reinforcement → evaluating maintenance and generalization. Supplementing it with Piaget's theory for the learner's level of cognitive development and Vygotsky's scaffolding for the teacher's step-by-step support makes the analysis multifaceted.
The CampusDown library (in Korean) also has reports that apply this theory in practice, such as 「파블로프와 스키너의 행동주의 이론: 고전적 조건화와 조작적 조건형성, 사회복지실천의 행동수정 기법」, 「행동주의 이론의 사회복지 현장에의 적용: 파블로프의 고전적 조건 형성과 스키너의 조작적 조건 형성을 중심으로」. They show how the theory can be connected to real cases. For more, try the '스키너' report search.
The behavioral model in social work practice
Assignments often ask you to write ABC records (antecedent–behavior–consequence) and design reinforcement strategies for cases such as children's problem behavior or independent living skills training. Prioritizing positive reinforcement over punishment and including ethical considerations that respect the client's right to self-determination tends to earn good marks.
References
- Skinner, B. F. (1938). The Behavior of Organisms: An Experimental Analysis. New York: Appleton-Century.
- Skinner, B. F. (1953). Science and Human Behavior. New York: Macmillan.
- Skinner, B. F. (1954). The science of learning and the art of teaching. Harvard Educational Review, 24(2), 86–97.
- Ferster, C. B., & Skinner, B. F. (1957). Schedules of Reinforcement. New York: Appleton-Century-Crofts.
- Thorndike, E. L. (1911). Animal Intelligence: Experimental Studies. New York: Macmillan.
- Chomsky, N. (1959). A review of B. F. Skinner's Verbal Behavior. Language, 35(1), 26–58.
- Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 627–668.