4 Learning & Motivation · 4.1 Learning and motivation

4.1.3 Operant conditioning, Hull and programmed learning

B.F. Skinner's operant conditioning says behaviour is shaped by its consequences (reinforcement makes it more likely, punishment less likely); Clark Hull explained learning as drive reduction building habit strength; and Skinner's ideas became programmed instruction (linear), later answered by Crowder's branching programme.

  • APPSC Paper I
  • Standard level
  • 17 min read
  • Free

Free PDF

Download this PDF

Enter your email once and the PDF is yours. We send exam updates and free material; you can stop them any time.

In the print window, choose Save as PDF.

Core facts

  • Operant conditioning: B.F. Skinner (Burrhus Frederic Skinner, 1904–1990, Harvard), American behaviourist. Also called instrumental conditioning and Type R (response) conditioning; Pavlov's classical conditioning is Type S (stimulus). Skinner coined "operant conditioning" in 1938 (The Behavior of Organisms). He was a radical behaviourist: the mind exists, but only observable behaviour and its consequences should be studied. His short rule: rewarded behaviour is repeated.
  • Operant = a response that operates on the environment and is emitted freely by the organism; a respondent (Pavlov) is elicited by a known stimulus. It is called instrumental because the learner's response is the instrument that brings the reinforcer (APPSC 2019: instrumental conditioning = operant conditioning).
  • Reinforcement = any consequence that strengthens (makes more likely) the response it follows. Positive reinforcement = presenting a rewarding stimulus after a response (APPSC 2019); studies find it the most powerful kind. Punishment = a consequence that weakens the response.
  • Skinner box (operant conditioning chamber): a hungry rat presses a lever and gets a food pellet; later pigeons peck a key.
  • Key principle: behaviour followed by a reinforcer is strengthened (repeated); behaviour followed by no reinforcer weakens (extinction).
  • Shaping: reinforcing successive approximations to the target behaviour (the "Successive" item in APPSC 2025's match was Skinner).
  • Skinner's books: The Behavior of Organisms (1938), operant conditioning set out; Walden Two (1948), a novel about a society run on reinforcement; Science and Human Behavior (1953), asked in APPSC 2025; Verbal Behavior (1957), language learnt by imitation and reinforcement; Schedules of Reinforcement (1957), with C.B. Ferster; The Technology of Teaching (1968), teaching machines and programmed learning; Beyond Freedom and Dignity (1971); About Behaviorism (1974).
  • Language (Skinner): children learn language through imitation and reinforcement (APPSC 2025). Chomsky (1959 review of Verbal Behavior) disagreed: language is innate (LAD).
  • Clark L. Hull (1884–1952, Yale, Institute of Human Relations; method hypothetico-deductive, also called mathematico-deductive): drive-reduction theory, also called need-reduction, systematic behaviour or hypothetico-deductive theory. Book Principles of Behavior (1943); also Essentials of Behavior (1951), A Behavior System (1952).
  • Hull's concepts: drive (D), habit strength (sHr), reinforcement (= drive reduction), reaction potential (sEr = sHr × D), reactive inhibition, goal gradient. Cognitive schemas are NOT Hull's (they belong to Piaget and the cognitive school; APPSC 2025).
  • Programmed instruction: father B.F. Skinner (article "The Science of Learning and the Art of Teaching", 1954); it grew from operant conditioning and Thorndike's law of effect, and Skinner called it the first use of laboratory findings on practical problems of education. Each small step of a programme is a frame. Sidney L. Pressey built the first self-testing teaching machine in the 1920s.
  • Linear programming (Skinner): one fixed path, small steps, learner writes the answer, immediate confirmation; it stresses the correct answer (APPSC 2022).
  • Branching programming: Norman A. Crowder (about 1960), called intrinsic programming; multiple-choice answers; a wrong answer sends the learner to a remedial frame. Principles: exposition, diagnosis, remediation; in book form a scrambled textbook.
  • Mathetics: Thomas F. Gilbert (1962; Greek mathein, to learn), teaches by backward chaining (last step first); principles: chaining, discrimination, generalisation.

Explained

1. The four consequences. "Positive" means something is added, "negative" means something is taken away. Reinforcement always increases a behaviour; punishment always decreases it.

Add a stimulusRemove a stimulusEffect
ReinforcementPositive: praise, marks, sweetsNegative: stop a nagging noise, cancel homeworkBehaviour increases
PunishmentPositive: scolding, extra workNegative: take away play time, a fine (response cost)Behaviour decreases
  • Negative reinforcement is not punishment. A pupil finishes work to escape the teacher's reminders; the work rate goes up.
  • Primary reinforcers satisfy biological needs (food, water). Secondary (conditioned) reinforcers gain value by pairing (praise, grades, stars). Generalised reinforcers buy many things (money, tokens); a token economy in a hostel or class uses them.
  • Premack principle (David Premack, "Grandma's rule"): a preferred activity reinforces a less preferred one: "finish the sums, then play".
  • Skinner preferred reinforcement to punishment: punishment only suppresses behaviour for a while, causes fear and does not teach the right response.
  • Problems of punishment: the behaviour is suppressed, not unlearnt; it breeds fear and aggression (even fear of school); it shows what not to do, not what to do. If used at all, it works best when immediate, consistent, moderate from the start, and paired with a rewarded alternative.

2. Schedules of reinforcement.

  • Continuous reinforcement (CRF): every correct response is rewarded. Fastest for learning a new behaviour, but extinction is also fast.
  • Partial (intermittent) reinforcement: only some responses are rewarded. Learning is slower but more resistant to extinction (partial reinforcement effect).
ScheduleReward givenResponse patternExample
Fixed ratio (FR)After a set number of responsesHigh rate, short pause after rewardPiece-rate wages, a star for every 5 sums
Variable ratio (VR)After an unpredictable numberHighest, steady rate; hardest to extinguishLottery, slot machine, fishing
Fixed interval (FI)First response after a set timeScallop: slow after reward, fast near the timeMonthly salary, studying just before scheduled tests
Variable interval (VI)First response after varying timesModerate, steady rateSurprise tests, checking messages

3. Other operant processes.

  • Shaping: reward closer and closer approximations (teaching a child to write a letter, a pigeon to turn a circle).
  • Chaining: linking simple responses into a sequence, each step reinforcing the one before.
  • Extinction: withholding the reinforcer weakens the response; spontaneous recovery may follow after rest.
  • Discriminative stimulus (SD, "S-dee"): a cue showing when a response will be reinforced (the bell for answering, a green light).
  • Generalisation and discrimination: responding to similar cues, and learning to respond only to the right one.
  • Superstitious behaviour: an accidental link between a response and a reward (Skinner's pigeons, 1948).

4. Classical vs operant conditioning (APPSC 2025 asked the main difference).

PointClassical (Pavlov)Operant (Skinner)
Core ideaPairs two stimuli (CS + US)Consequence after a response shapes it
BehaviourInvoluntary, reflex; elicitedVoluntary; emitted
OrderStimulus comes before response (S → R)Response comes before reward (R → S)
LearnerPassiveActive
TypeType S, respondentType R, instrumental
Animal, apparatusDog, salivationRat or pigeon, Skinner box

5. Operant conditioning in the classroom.

  • Reward right answers immediately; praise effort, not only results.
  • Break skills into small steps and reinforce each (shaping).
  • Use intermittent praise once a habit is formed so that it lasts.
  • Ignore minor attention-seeking (extinction) instead of scolding it.
  • Behaviour modification for discipline in classes and hostels: clear rules, token rewards, time-out. It changes behaviour by planned reinforcement and extinction, so it rests mainly on operant conditioning.
  • Token economy: tokens (stars, points) earned for target behaviour are later exchanged for rewards; used with children with intellectual disability, in de-addiction and in rehabilitation centres.
  • Children with intellectual disability learn self-care (dressing, eating, toilet use) in small steps, each reinforced.
  • Applied behaviour analysis (ABA) grew out of classical conditioning, operant conditioning and social learning theory.
  • Programmed learning, teaching machines and computer-assisted instruction (CAI) grew from it.

6. Hull's drive-reduction theory.

  • Chain: need (lack of food) → drive (hunger, an inner push) → response → goal reached → drive is reduced → that S–R bond is reinforced.
  • Primary drives are inborn (hunger, thirst, pain avoidance); secondary drives are learnt (fear, desire for money or approval).
  • Habit strength (sHr) grows with the number of reinforced trials. Behaviour happens when reaction potential sEr = sHr × D is high enough: a strong habit needs a drive to show itself.
  • Reactive inhibition: fatigue from repeating a response, which rest removes; supports spaced (distributed) practice.
  • Goal gradient: responses near the goal are learnt faster (a rat runs faster as it nears the food).
  • Hull is a neo-behaviourist: he used intervening variables (drive, habit) between S and R and stated his theory as postulates with mathematical equations.
  • Classroom use: link lessons to pupils' needs; reward soon after the response; give practice with rest pauses; build habits through repetition.

7. Programmed instruction (PI). Self-instructional material in which content is broken into small frames; the learner responds to each and is told at once whether the response was right.

Basic principles: small steps, active responding, immediate feedback (knowledge of results acts as reinforcement), self-pacing, logical sequence, student testing (the programme is revised until learners succeed).

PointLinear (Skinner)Branching (Crowder)
PathSame straight path for allPath depends on the learner's answer
Frame sizeVery small stepsLarger frames, more content
ResponseConstructed (learner writes it)Multiple-choice (learner selects)
ErrorsAvoided (target under about 5%)Used to diagnose; wrong answer → remedial frame
BasisOperant conditioning, reinforcementRecognition and correction of mistakes
Also calledExtrinsic programmingIntrinsic programming; "scrambled textbook"

Kinds of frames: introductory (teaching) frames, practice frames, review frames and test (criterion) frames. Prompts are cues given in a frame and slowly removed (fading). RULEG (rule, then example: a deductive order) and EGRUL (example, then rule: an inductive order) are ways of ordering a frame sequence (Evans, Homme and Glaser, 1962).

Steps in preparing a programme: (1) choose the unit, (2) write the objectives in behavioural terms, (3) analyse the content, (4) find the learners' entry behaviour, (5) write the frames, (6) try out (individual, small group, field try-out), (7) revise and validate against error rate and gains.

Merits: self-paced, individualised, immediate feedback (knowledge of results keeps the learner motivated), the learner is active, useful in distance and remedial teaching; a failed programme is revised, the learner is not blamed. Limits: dull for bright pupils (linear), costly to prepare, little room for discussion, suits factual content more than creativity or values.

Common traps

  • ✗ "Negative reinforcement means punishment." ✓ Negative reinforcement removes something unpleasant and increases the behaviour; punishment decreases it.
  • ✗ "Operant behaviour is elicited by a stimulus." ✓ It is emitted; classical (respondent) behaviour is elicited.
  • ✗ "Classical conditioning uses rewards and operant uses punishment." ✓ Classical pairs stimuli; operant uses consequences (reward or punishment) after a response.
  • ✗ "Science and Human Behavior is by William James (or Pavlov)." ✓ B.F. Skinner, 1953.
  • ✗ "Skinner box: dogs." ✓ Rats and pigeons; dogs are Pavlov's.
  • ✗ "Fixed ratio gives the highest, most lasting response." ✓ Variable ratio does.
  • ✗ "Continuous reinforcement makes learning last longest." ✓ It is quickest to learn but quickest to extinguish; partial reinforcement lasts longer.
  • ✗ "Cognitive schemas are Hull's concept." ✓ Hull: drive, habit strength, reinforcement; schemas: Piaget.
  • ✗ "Branching programming was developed by Skinner." ✓ Norman Crowder; Skinner = linear.
  • ✗ "Linear programmes use multiple-choice answers." ✓ Linear uses constructed responses; branching uses multiple choice.
  • ✗ "Pressey's teaching machine came after Skinner's." ✓ Pressey (1920s) came first; Skinner's followed in 1954.
  • ✗ "Fixed ratio and fixed interval are continuous schedules." ✓ FR, VR, FI and VI are all partial (intermittent); continuous = every response reinforced. (The BRAOU Cognitive and Behavioral Processes book calls FR and FI "continuous"; follow the standard.)
  • ✗ "Fixed interval is the easiest schedule to extinguish." ✓ Continuous reinforcement is extinguished most easily; variable ratio resists most. (The same BRAOU book says fixed interval.)
  • ✗ "Negative reinforcement, like punishment, is used to stop unwanted behaviour." ✓ Negative reinforcement always strengthens behaviour; only punishment weakens it. (BRAOU wording and examples mix the two.)
  • ✗ "Skinner was a cognitivist." ✓ A radical behaviourist (a BRAOU heading "Skinner-Cognitivism" is a slip).
  • ✗ "Principles of Behavior is Skinner's book." ✓ It is Hull's (1943); Skinner's 1938 book is The Behavior of Organisms.
  • ✗ "Behaviour modification rests on classical conditioning." ✓ Mainly on operant conditioning (reinforcement, extinction, tokens); desensitisation of phobias is the classical-conditioning therapy.

Quick revision

  • Skinner (radical behaviourist): operant = instrumental = Type R (term 1938); behaviour emitted and shaped by consequences.
  • Skinner box: rat presses lever, pigeon pecks key.
  • Positive = add, negative = remove; reinforcement increases, punishment decreases (suppresses, does not teach).
  • Schedules: FR, VR (highest, most lasting), FI (scallop), VI; partial outlasts continuous.
  • Shaping = reinforcing successive approximations.
  • Books: Behavior of Organisms 1938, Walden Two 1948, Science and Human Behavior 1953, Verbal Behavior 1957, Technology of Teaching 1968.
  • Skinner on language: imitation and reinforcement; Chomsky disagreed.
  • Hull (Yale): drive reduction, habit strength, sEr = sHr × D; Principles of Behavior 1943.
  • Linear PI: Skinner, small steps, constructed answer, correct-answer focus.
  • Branching PI: Crowder, intrinsic, multiple choice, remedial frames (exposition, diagnosis, remediation); Pressey: first teaching machine.
Go deeper: Deeper (beyond what APPSC Paper I usually asks)

Deeper Advanced

1. Skinner's radical behaviourism. Skinner did not deny thoughts and feelings but treated them as private behaviour, also explained by environment and reinforcement history. He rejected inner "drives" as explanations, which is the main difference from Hull. Walden Two and Beyond Freedom and Dignity argue that society should design reinforcement deliberately.

2. Thorndike to Skinner. Thorndike's law of effect (satisfying results stamp in an S–R bond) is the direct ancestor of operant conditioning; Skinner made it precise with rate of response, the cumulative recorder and schedules.

3. Hull's equation and critics. Later Hull added incentive (K, from his student Kenneth Spence) and other terms. The theory was criticised because learning happens without drive reduction (Tolman's latent learning; curiosity and play), and because the equations were too exact for real behaviour.

4. From teaching machines to e-learning. Pressey's machine (1920s) tested; Skinner's (1954) taught. Branching ideas led to adaptive testing and computer-based tutors that choose the next item from the learner's last answer, the same logic as modern adaptive practice apps.

Sources: BRAOU B.A. Psychology, Cognitive and Behavioral Processes (224), Unit 1 (operant conditioning) and Unit 2 (reward, punishment, reinforcement, schedules, behaviour modification); BRAOU B.Ed.SE Learning, Teaching and Assessment (13803), Unit 1 (Skinner, reinforcement, punishment, behaviour modification); BRAOU B.Ed.SE Pedagogy of Teaching Physical Sciences (33802), Unit 5 (programmed instruction: linear, branching, mathetics); B.F. Skinner, The Behavior of Organisms (1938) and The Technology of Teaching (1968) (for terms and dates); C.L. Hull, Principles of Behavior (1943) (for terms and dates); APPSC Hostel Welfare Officer Gr II, Paper II, 2019, 2022 and 2025 papers with final keys (themes only)

Last checked 2026-10-23.

Practise this topic. Questions on Behavioural theories: Pavlov, Watson, Thorndike, Skinner, Hull, with answers explained.

Medha AI writes its own notes and checks them against the sources listed. Medha AI is an independent preparation service. It is not affiliated with, endorsed by or connected to APPSC, TSPSC, MPSC, UPSC or any other commission or government body.