Null Distribution vs Sampling Distribution

Both terms below come up in the same part of the course, and students mix them up. Here is each one defined on its own, side by side, so you can see where they part company.

Null distribution

Hypothesis testing

The null distribution is the sampling distribution of a statistic when the null hypothesis is true; a p-value is an area in its tail.

Every p-value is measured against the null distribution, which answers what your statistic would look like if the null hypothesis were correct. You get that distribution either from theory (a normal, t, or chi-square model) or from simulation, as in a randomization test. For example, under H0:p=0.50H_0: p = 0.50 with n = 100, the null distribution of p-hat (the sample proportion) is approximately normal, centered at 0.50 with standard deviation 0.50(0.50)/100=0.05\sqrt{0.50(0.50)/100} = 0.05. An observed p-hat of 0.60 then sits two standard deviations out, giving a two-sided p-value of about 0.0455.

Full entry for null distribution

Sampling distribution

Sampling distributions

A sampling distribution is the distribution of a statistic across all possible samples of the same size drawn from a population.

A sampling distribution describes how a statistic, such as the sample mean, changes from one random sample to the next. For example, taking many samples of 40 students and recording each sample mean builds up the sampling distribution of xˉ\bar{x} (x-bar, the sample mean). For the sample mean its center is the population mean μ\mu (mu) and its spread, the standard error, is σn\frac{\sigma}{\sqrt{n}} (sigma over the square root of n). This spread shrinks as the sample size grows, so larger samples give more consistent estimates.

Full entry for sampling distribution

Where each one fits in the course