Residual vs Standard Error

A residual belongs to one data point and one fitted line, and the order of the subtraction is fixed: $\text{residual} = y - \hat{y}$, observed minus predicted, where $\hat{y}$ (read y-hat) is the height of the line above that point's $x$. The sign is where the meaning lives. A positive residual puts the observation above the line, so the model underpredicted it, and a negative residual puts it below, so the model overpredicted.

Six students study 1, 2, 3, 4, 5 and 6 hours and score 60, 72, 65, 78, 71 and 86. The least-squares line for them is $\hat{y} = 58 + 4x$. For the student who studied 5 hours the line gives $\hat{y} = 58 + 4(5) = 78$, and that student scored 71, so the residual is $71 - 78 = -7$. The line overpredicted that score by 7 points. Doing the same at every $x$ gives residuals of -2, 6, -5, 4, -7 and 4.

The error that costs points is the reversed subtraction. "The residual is 7, so the line missed by 7" keeps the size and throws the direction away, and computing predicted minus observed flips the sign of every residual in the table, turning each overprediction into an underprediction. Say observed minus predicted every time, and read a negative residual as the line sitting above the data point.

Two things bound what a single residual can tell you. It is measured against one particular line, so change the line and every residual changes with it. And for a least-squares line fitted with an intercept the residuals add to exactly zero: here $-2 + 6 - 5 + 4 - 7 + 4 = 0$. Their mean is zero for a good fit and for a hopeless one alike, which is why fit gets judged from the squared residuals and from the shape of the residual plot, never from their average.

Residuals are topic 5.4 in Unit 5, Regression Analysis, of the Fall 2026 AP Statistics course.

The standard error is an estimate. It plays the same role for a statistic that the standard deviation plays for raw data, and it is called a standard error precisely because the quantity it reports is built from statistics rather than parameters. For a sample mean it is $SE_{\bar{x}} = \frac{s}{\sqrt{n}}$, using $s$, the sample standard deviation. For a sample proportion it is $SE_{\hat{p}} = \sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$, using $\hat{p}$ (p-hat, the sample proportion). Put the parameters in instead, $\frac{\sigma}{\sqrt{n}}$ (sigma over the square root of n) and $\sqrt{p(1-p)/n}$, and you have the true standard deviation of the sampling distribution, which is the thing the standard error is estimating. That one swap, statistic in place of parameter, is the whole difference between the two names.

Suppose 25 measurements have a sample standard deviation of $s = 4.5$ grams. Then $SE_{\bar{x}} = \frac{4.5}{\sqrt{25}} = \frac{4.5}{5} = 0.9$ grams. Read the two numbers aloud: individual measurements sit about 4.5 grams from the sample mean, while the sample mean itself sits about 0.9 grams from the population mean across repeated samples of 25.

The misreading is "the standard error tells you how spread out the data are." It does not. That is $s$, and $s$ stays about the same as you collect more data, because a larger sample estimates the same population spread. The standard error shrinks toward zero with $\sqrt{n}$ because it describes a statistic, not an observation.

A second wrong reading is treating a small standard error as proof the estimate is close to the truth. It measures precision, not accuracy. A convenience sample of 4,000 produces a tiny standard error around whatever value its method is centered on, and no amount of precision repairs a center that is wrong.

One boundary worth memorizing: a one-sample z-test for a proportion puts the null value $p_0$ (p-naught) where $\hat{p}$ normally sits, giving $\sqrt{p_0(1-p_0)/n}$, because every quantity in a test is computed as though $H_0$ were true. Otherwise the standard error is the denominator of a standardized test statistic and the second factor in a margin of error.