Write short note : Experimental design.

“Write short note : Experimental design.” (1988)

  • An experimental design is a research structure built to establish a causal relationship by having the researcher deliberately manipulate one variable and observing its effect on another, under conditions that rule out alternative explanations.
  • Its systematic logic — random assignment, a control group, and explicit attention to what could confound a causal claim — was formalised for the social sciences chiefly by Donald Campbell and Julian Stanley, whose typology of validity threats remains the standard reference point for evaluating any experiment.
  • Sociology borrows the method cautiously, since manipulating whole social settings the way a laboratory manipulates a physical variable is rarely feasible or ethical.
  • This note treats the experimental method’s own internal structure — its groups, its designs, and its threats to validity — rather than the general staging (problem formulation, hypothesis, sampling) common to all research design.

The Core Structure

  • The independent variable is the one the researcher deliberately manipulates; the dependent variable is the outcome measured for a resulting change.
  • Subjects are divided into an experimental group, which receives the manipulation or treatment, and a control group, which does not — the control group’s outcome represents what would have happened without the intervention.
  • Random assignment of subjects to the two groups is the design’s load-bearing feature: it ensures that, on average, the groups are equivalent on every characteristic except the treatment itself, so any post-treatment difference between them can be attributed to the independent variable rather than to pre-existing group differences.
  • The classic structure adds pre-test and post-test measurement: both groups are measured before the treatment and again afterward, so the change in the experimental group can be compared against the change (if any) in the control group.

The Solomon Four-Group Design

  • The basic pre-test/post-test control-group design has one weakness: the act of pre-testing itself may sensitise subjects and influence their post-test response, confounding the treatment’s true effect.
  • Richard Solomon addressed this by adding two further groups that receive no pre-test at all — one treated, one untreated — alongside the original two pre-tested groups, producing four cells in total.
  • Comparing outcomes across all four groups allows the researcher to isolate the treatment’s effect from any effect of the pre-test itself, at the cost of a considerably larger and more resource-intensive design.

Threats to Internal Validity

  • Internal validity asks whether the observed change can genuinely be attributed to the independent variable rather than to some other factor operating during the study.
  • Campbell and Stanley’s typology names the recurring threats: history (an external event coinciding with the study period), maturation (subjects change naturally over time regardless of treatment), testing effects (exposure to the pre-test itself alters post-test performance), and instrumentation (the measuring instrument or its administration changes between testing points).
  • A well-built experimental design controls for all of these through the control group: since both groups experience the same passage of time, the same external events, and the same instrumentation, any differential change between them isolates the independent variable’s genuine effect.

Threats to External Validity

  • External validity concerns whether a finding generalises beyond the artificial conditions of the study itself — a result produced under tightly controlled, lab-like conditions may not hold in the messier setting of ordinary social life.
  • Reactivity is the sharpest version of this problem: subjects who know they are being studied may behave differently simply because of that awareness, independent of any actual treatment.
  • The Hawthorne effect remains the field’s best-known illustration: at the Western Electric Hawthorne Works, associated with Elton Mayo’s research team, worker productivity rose regardless of how lighting and working conditions were varied — apparently because employees knew they were part of an experiment, not because of the specific conditions tested.
  • Field experiments trade some of this control for greater ecological realism, though at the cost of weaker control over confounding variables than a laboratory setting allows.

Sociology’s Structural Difficulty With True Experiments

  • Randomly assigning entire communities, institutions, or societies to “treatment” and “control” conditions is rarely possible on ethical or practical grounds, which is why controlled experiments occupy a smaller place in sociology than in psychology.
  • Where a true experiment is impossible, sociology has historically substituted Durkheim’s comparative method — a cross-reference only, since that method’s own logic is covered fully elsewhere.
  • Quasi-experimental and natural-experiment designs, which exploit naturally occurring variation instead of researcher-manipulated treatment, are the discipline’s usual compromise between experimental rigour and real-world feasibility.
  • Contemporary field experiments and randomised evaluations, now common in development economics and policy research, extend the classic logic outward from the laboratory — a growing body of replication work in the social sciences has, in turn, pushed the field toward pre-registering hypotheses and designs in advance, reinforcing the same discipline the classical experimental design always demanded.
  • The experimental method offers the strongest available basis for causal inference among social research techniques, precisely because random assignment and a control group jointly rule out most rival explanations.
  • The Solomon four-group design shows how the method’s own logic can be extended to control for a threat — pre-test sensitisation — that the classic design cannot address on its own.
  • Its chief cost is artificiality: the tighter the control, the further the setting drifts from natural social life, which is exactly what the Hawthorne studies exposed.
  • Sociology’s continuing preference for comparative and quasi-experimental substitutes reflects not a rejection of the experimental logic but the structural difficulty of applying it to whole societies.