Independence condition

By Jude Wallis · Updated

The independence condition requires that one observation gives no information about another, argued from random selection plus the 10% condition.

Independence means one observation carries no information about another, and it is a claim about the design rather than something you can read off the data. Sampling with replacement makes it exact. Sampling without replacement makes it false, because removing one person changes the odds for the next, so the course substitutes the 10% condition, n0.10Nn \le 0.10N, as an argument that the dependence is small enough to ignore. In a randomized experiment, random assignment supplies it instead.

The reason it is load bearing is one algebraic step. Variances of independent quantities add, so the sum X1++XnX_1 + \cdots + X_n has variance nσ2n\sigma^2, and dividing that sum by nn divides its variance by n2n^2, leaving nσ2n2=σ2n\frac{n\sigma^2}{n^2} = \frac{\sigma^2}{n} as the variance of xˉ\bar{x} (x-bar, the sample mean). Take the square root and you have σxˉ=σn\sigma_{\bar{x}} = \frac{\sigma}{\sqrt{n}} (sigma over the square root of n). With σ=20\sigma = 20 and n=100n = 100, that is 20/10=220/10 = 2. The identical argument on a sum of independent successes produces p(1p)n\sqrt{\frac{p(1-p)}{n}} for a proportion. Take independence away and the variance of the sum picks up covariance terms, the addition step fails, and the 2 is just a wrong number.

The sentence to unlearn is "the sample was random, so the observations are independent." Those are two different claims. A simple random sample drawn without replacement is random and dependent at the same time. Randomness is what centers the statistic on the parameter; the 10% condition is what makes the spread formula usable. Mislabeling one as the other is the error the course specifically flags.

Two boundaries. When data come from a randomized experiment the course treats the 10% check as unnecessary in the two-sample and chi-square procedures, because assignment rather than selection is doing the work. And every two-sample procedure needs a second independence claim stacked on this one, that the two groups are independent of each other, which is exactly what a matched pairs design gives up on purpose so that it can pair the observations instead.

More sampling distributions terms, or browse the full statistics glossary.