Significance level

The significance level, written $\alpha$ (the Greek letter alpha), is the line you draw in advance for how much evidence counts as convincing. If the p-value is at or below $\alpha$ you reject the null hypothesis; if it is above, you fail to reject. For example, with $\alpha = 0.05$ you reject when the p-value is 0.05 or less. Because $\alpha$ is also the long-run rate of falsely rejecting a true null hypothesis, a smaller $\alpha$ such as 0.01 demands stronger evidence.