Decision rule
The decision rule is the standard you set before collecting data: reject the null hypothesis when the p-value is at or below alpha.
Fixing the rule in advance is what keeps a test honest, because (alpha, the significance level) is the probability of rejecting a true null hypothesis and must not be adjusted once you see the result. The AP version is a direct comparison: if the p-value is at or below alpha you reject and conclude there is convincing evidence for the alternative, and otherwise you fail to reject. For example, at a p-value of 0.032 leads you to reject, while a p-value of 0.080 does not. You never accept the null hypothesis, since failing to find evidence against a claim is not evidence that the claim is true.
Where this comes up
More hypothesis testing terms, or browse the full statistics glossary.