Sampling Variability vs Sampling Error

Both terms below come up in the same part of the course, and students mix them up. Here is each one defined on its own, side by side, so you can see where they part company.

Sampling variability

Collecting data and study design

Sampling variability is the natural variation in a statistic from one random sample to the next, and it is variation rather than bias.

Two random samples from the same population almost never give the same value, so a sample statistic bounces around the parameter it estimates. For example, two random samples of 50 students from one school might give mean GPAs of 3.12 and 3.05 with nothing wrong in either sample. Sampling variability shrinks as the sample size grows, because the sampling distribution of the statistic gets narrower. Bias behaves differently: it is a systematic push in one direction, and a larger sample does not remove it.

Full entry for sampling variability

Sampling error

Sampling distributions

Sampling error is the ordinary sample-to-sample variation between a statistic and the parameter it estimates. It is not a mistake anyone made.

Sampling error is not an error in the everyday sense, and the name is what trips students up. Even a flawless simple random sample produces a statistic that misses the parameter, purely because a different random sample would have landed somewhere else. If the true population proportion is p=0.50p = 0.50 and one random sample of 100 gives p^=0.46\hat{p} = 0.46 (p-hat, the sample proportion), the sampling error for that sample is 0.460.50=0.040.46 - 0.50 = -0.04. Sampling error shrinks as nn grows, but errors from bad methods, such as undercoverage or nonresponse, are non-sampling errors and a bigger sample will not touch them.

Full entry for sampling error

Where each one fits in the course