Biased vs unbiased estimator
By Jude Wallis · Published
An estimator is unbiased when the mean of its sampling distribution equals the parameter it estimates, so it is right on average over all samples. It is biased when that mean sits above or below the parameter. The sample mean and sample proportion are unbiased; the sample maximum is biased.
AP Statistics: Unit 3 (topics 3.1 Estimators). Biased and unbiased estimators belong to Unit 3 topic 3.1, Estimators, in the Fall 2026 AP Statistics course, where an estimator is judged by the center and the spread of its sampling distribution. The sample proportion is the unbiased estimator used throughout Unit 3, and the sample mean plays the same role in Unit 4.
Biased vs unbiased estimator: the short answer
An estimator is a rule for turning a sample into a guess at a population parameter. Because samples vary, the guess varies, and the collection of guesses over all possible samples is the estimator's sampling distribution.
An estimator is unbiased when that sampling distribution is centered exactly on the parameter. Individual estimates miss high and low, and the misses balance out.
An estimator is biased when the sampling distribution is centered somewhere else. The estimates tend to land on one side of the parameter, so there is a systematic error on top of the ordinary sample-to-sample variation.
The labels describe the rule over many samples. They do not describe a single estimate, and they say nothing about how spread out the estimates are.
What makes an estimator unbiased
Write ("theta") for the parameter and ("theta-hat") for the estimator. The estimator is unbiased when
that is, when the mean of its sampling distribution equals the parameter, whatever the parameter's value happens to be.
Three estimators in the course have this property when the data come from a random sample:
- The sample mean ("x-bar") for the population mean .
- The sample proportion ("p-hat") for the population proportion .
- The sample variance , computed with the divisor , for the population variance , when the observations are independent.
Unbiased does not mean accurate in any one sample. In the second worked example below, is unbiased for and cannot equal 0.40 in any sample. The property is about the long-run average, which is the idea topic 3.1 Estimators introduces.
What makes an estimator biased
The bias of an estimator is the gap between the center of its sampling distribution and the parameter:
A negative bias means the estimator tends to come out too low, and a positive bias means too high. Three examples:
- The sample maximum as an estimate of the population maximum. A sample cannot contain a value larger than the largest value in the population, so the sample maximum is either exactly right or too small. Its average over all samples has to fall below the true maximum.
- The variance with divisor in place of . For independent observations its average is , which is below . This is the reason for the , as why divide by n minus 1 shows.
- The sample standard deviation as an estimate of . Even though is unbiased for , taking the square root leaves slightly low on average.
In each case the cause is the formula. No amount of care in drawing the sample removes it.
The differences side by side
| Feature | Unbiased estimator | Biased estimator |
|---|---|---|
| Center of the sampling distribution | Equal to the parameter | Above or below the parameter |
| Bias, | 0 | Not 0 |
| A single estimate | Can still miss the parameter | Can still land close to it |
| Direction of the misses | Balanced high and low | Tilted to one side |
| Examples | for , for , for | Sample maximum, variance with divisor , for |
| What it says about spread | Nothing | Nothing |
The last row matters as much as the first. Bias locates the center of the sampling distribution, and variability measures its width. An unbiased estimator with a wide sampling distribution can produce estimates far from the parameter, and a slightly biased estimator with a narrow one can produce estimates that are reliably close. The two properties are compared in bias vs variability.
When to use which
Given a choice, prefer an unbiased estimator with low variability. That is why inference in the course is built on and : each is centered on its parameter, and each gets less variable as the sample size grows.
A biased estimator is acceptable when the bias is small and well understood. The clearest case is . It runs slightly low as an estimate of , and it is still the standard deviation used in every procedure, because at ordinary sample sizes the shortfall is small.
A biased estimator is a poor choice when the bias is large relative to the precision you need. Estimating a population maximum by the sample maximum from a small sample is an example: the estimate can never be too high and is often too low, and nothing in the sample tells you by how much.
For the three biased examples on this page, the bias shrinks as the sample size increases, though it does not reach zero. That behavior belongs to these formulas and is not a general rule about bias.
The classic mix-up and how to avoid it
The first error is calling a single estimate biased. "My sample mean was 5.5 and the true mean is 5, so my estimate is biased" confuses an ordinary miss with a property of the method. One estimate has an error. Only an estimator, judged over all possible samples, has a bias.
The second error is reading unbiased as correct. An unbiased estimator is centered on the parameter and can still miss it in every individual sample.
The third error is mixing up two sources of bias. This page is about bias that comes from the formula. A separate kind comes from how the data were collected: a convenience sample or a voluntary response sample can push even and off center, because the sample no longer represents the population. Taking a larger sample of the same flawed kind does not fix that, as does a bigger sample fix bias explains. The statement that and are unbiased assumes random sampling.
To check a claim of bias, ask what the estimator averages to over all possible random samples and compare that with the parameter.
Three estimators checked against every possible sample
A population consists of the three values 2, 4, and 9. List all samples of size 2 drawn with replacement. For each, compute the sample mean, the sample variance with divisor , and the sample maximum. Decide which of these is an unbiased estimator of the population mean, the population variance, and the population maximum, respectively.
Find the parameters. Mean: . Variance: . Maximum: 9.
List the 9 equally likely samples: (2,2), (2,4), (2,9), (4,2), (4,4), (4,9), (9,2), (9,4), (9,9).
Sample means, in that order: 2, 3, 5.5, 3, 4, 6.5, 5.5, 6.5, 9. Their sum is 45, so they average .
Sample variances. For two values and , , giving, in order: 0, 2, 24.5, 2, 0, 12.5, 24.5, 12.5, 0. Their sum is 78, so they average .
Sample maximums, in order: 2, 4, 9, 4, 4, 9, 9, 9, 9. Their sum is 59, so they average .
Compare each average with its parameter. The sample mean averages 5 and . The sample variance averages 8.667 and . The sample maximum averages 6.556 and the population maximum is 9, a bias of .
Check the divisor. Using as the divisor halves each variance in the list, so those values average , half of and equal to .
The sample mean is unbiased for : it averages exactly 5. The sample variance with divisor is unbiased for : it averages exactly 8.667. The sample maximum is biased: it averages 6.556 against a true maximum of 9, a bias of . None of the nine sample means equals 5, so being unbiased did not make any individual estimate correct.
An unbiased estimator that never equals the parameter
A spinner lands on red with probability on every spin. It is spun 3 times and is the proportion of spins that land on red. Find the sampling distribution of and its mean, and say whether is unbiased.
The number of reds is binomial with and , so can be 0, , , or 1.
.
.
.
. Check: .
Mean of : .
Compare with the parameter: the mean of the sampling distribution is 0.400 and , so the bias is 0.
The sampling distribution of puts probabilities 0.216, 0.432, 0.288, and 0.064 on the values 0, , , and 1. Its mean is 0.400, equal to , so is unbiased. None of the four possible values equals 0.40, which shows that unbiased describes the center of the sampling distribution and makes no promise about any single estimate.
Frequently asked questions
Does unbiased mean the estimate equals the parameter?
No. Unbiased means the estimates average out to the parameter over all possible samples. Any single estimate can be too high or too low. With three spins of a spinner that lands on red 40% of the time, the sample proportion is unbiased and can only be 0, , , or 1.
Is the sample standard deviation an unbiased estimator?
Not of . The sample variance , with divisor , is unbiased for , but taking the square root leaves slightly too small on average. The shortfall shrinks as the sample size grows, and is still what inference for means uses.
Is an unbiased estimator always better than a biased one?
No. Bias is only one of two properties. An unbiased estimator with high variability can give estimates far from the parameter, while a slightly biased estimator with low variability can be close most of the time. The ideal is no bias and low variability together.