Standard deviation of the sampling distribution
By Jude Wallis · Updated
The true standard deviation of a statistic across all samples of a given size, computed from population parameters rather than estimated from one sample.
This is the actual spread of a statistic over every possible sample of size , and it is computed from parameters. For the sample mean it is (sigma, the population standard deviation, over the square root of n). For the sample proportion it is , using the population proportion . Both are parameters of the sampling distribution, not quantities you can calculate from the data in front of you. Replace with or with and the result is no longer this number: it is the standard error, an estimate of it.
With , samples of give . Quadruple the sample to and it halves to . Halve it again, to 0.75, and you need . Notice the price: the first halving cost 75 extra observations and the second cost 300. Precision bought under a square root gets expensive fast.
The standing misreading is "the standard deviation is 3, so about 95 percent of the values lie within 6 of the mean." The values do not. Individual observations still have , and nothing about the population changed when you started averaging. The 3 describes where sample means of 25 land, and that distinction is what the whole idea of a sampling distribution exists to make.
The number also has a job: it is the denominator of a standardized statistic. Writing turns a distance in grams or dollars into a distance in standard deviations of the sampling distribution, which is the scale a normal table reads.
Two boundaries. The centering result, (mu), needs only random sampling and holds for every and every population shape. The spread formulas above need something extra, namely independent observations, so they hold when sampling with replacement or under the 10% condition. Shape is a third and separate question, answered by the central limit theorem for means and by Large Counts for proportions.
Where this comes up
More sampling distributions terms, or browse the full statistics glossary.