Experimental Unit vs Observational Unit

The experimental unit is whatever the randomization acts on: the smallest thing in the study that could have been sent to a different treatment on its own. That is the test to apply, and it is what sets the sample size. An experiment's $n$ is the number of experimental units, never the number of measurements taken.

The unit is often not a person. A district compares two reading schedules across 6 classes of 25 students, giving the new schedule to 3 whole classes and leaving 3 on the old one. The schedule was handed to a class, so the class is the experimental unit and the study has 6 units, 3 per group. Treat the 150 students as the units instead and the $\sqrt{n}$ in the standard error becomes $\sqrt{75}$ rather than $\sqrt{3}$, while the conservative degrees of freedom for a two-sample $t$ comparison go from 2, where $t^* = 4.303$, to 74, where $t^* = 1.993$. The interval that comes out is several times too narrow, and the p-value with it.

The sentence to stop writing is "the experiment had 150 subjects." It had 6 experimental units and 150 observational units. Two students in the same class share a teacher, a room, and an hour of the day, so their responses are not independent, and independence is exactly what the analysis assumes. Counting them separately manufactures evidence that was never collected.

The two kinds of unit come apart in the other direction too. If one runner's time is recorded on five separate days under a single assigned shoe, there are five observations and still one experimental unit. Measuring more often makes that runner's estimate steadier; it does not add runners.

Topic 1.13, Experimental Design, lists replication among the four elements of a well-designed experiment, and replication is counted in units: three classes per treatment is replication of three, not of seventy-five.

The observational unit is the who or the what: one car, one student, one school, one day. Everything downstream is defined against it. The variables are what you record about it. The unit helps determine the relevant sample size and independence structure. Name it before computing: identifying it incorrectly can lead to the wrong sample size or inferential method.

A district reports one average test score for each of 40 schools, and those 40 schools hold 40,000 students. The observational unit is a school and $n = 40$. Treating a student as the unit is not a labeling quibble. The same standard deviation of 60 points gives $60 / \sqrt{40} = 9.49$ against $60 / \sqrt{40000} = 0.30$, a standard error 31.6 times smaller, and a 95 percent $t$ interval built on the wrong one comes out about 33 times too narrow.

"We collected data from 40 schools, so our sample size is 40,000." Only if you actually have student-level observations for those 40,000 students. One aggregate number per school gives 40 school-level observations; the students are inside those aggregates rather than individually represented. Collect scores student by student and the unit can instead be one student, but whether those observations are independent is a question the design must answer, not one the table layout settles.

The unit is a choice about the data set rather than a fact about the world, and it can change inside one study. Cross-classify 600 orders from four regions by region and by whether each shipped late, and the unit is one order with $n = 600$; roll the same data up to one late percentage per region and the unit becomes one region with $n = 4$. In an experiment, the unit a treatment is assigned to is the experimental unit, which is often larger than the unit a response is recorded on.

The Fall 2026 course framework defines an observational unit as an item or individual from which a datum is collected, in topic 1.2.

Repeated measurements need extra care: one plant measured on five days could appear in one row with five measurement columns, or in five rows with a day column. The layout does not turn one plant into five independent plants. Specify whether the question concerns plants or plant-day observations and account for the repeated measurements.

Try the descriptive statistics classroom activity: identify one invented packing order as the unit, distinguish its ID from its measurements, then compare packing times between two stations.