Bias of an Estimator vs Variability of an Estimator
Both terms below come up in the same part of the course, and students mix them up. Here is each one defined on its own, side by side, so you can see where they part company.
Bias of an estimator
Sampling distributions
Bias is systematic error in where an estimator's sampling distribution is centered, so the estimator is off target on average.
Bias is about the center of a sampling distribution, not its spread: an estimator is biased when its average value across all samples sits above or below the true parameter. The sample mean is unbiased because (the expected value of x-bar equals mu, the population mean), so it is right on average even though any one sample misses. The range of a sample, by contrast, is biased low, since a sample rarely contains both the population minimum and the population maximum. Collecting more data does not remove bias that comes from how the sample was chosen.
Variability of an estimator
Sampling distributions
Variability is the spread of an estimator's sampling distribution, showing how much estimates jump around from one sample to the next.
Variability describes the spread of an estimator's sampling distribution, so low variability means two different samples would hand you nearly the same answer. It is a separate goal from low bias: an estimator can be centered correctly and still swing wildly, or be very consistent and consistently wrong. Larger samples cut variability, and the square root sets the pace: with , gives , while gives . Only a better sampling design fixes bias.