AP Statistics hypothesis tests cheat sheet
By Jude Wallis · Published
A significance test states hypotheses about a parameter, computes a test statistic, and finds a p-value assuming the null hypothesis is true. If the p-value is at most alpha, reject the null; otherwise fail to reject it. The conclusion is written in context in terms of the alternative.
Significance tests are developed in Unit 3 of the Fall 2026 AP Statistics course (topics 3.5 through 3.8 and 3.12 through 3.15) and applied to means in Unit 4 (topics 4.4, 4.5, 4.9, and 4.10). The course has no test for a regression slope and no chi-square goodness-of-fit test.
The steps of a test
| Step | What to write |
|---|---|
| Hypotheses | and in symbols, with the parameter defined in context |
| Procedure and conditions | The name of the test, and each condition checked with numbers |
| Test statistic and p-value | The value of , , or , the degrees of freedom if any, and the p-value |
| Decision | The p-value compared with , and "reject " or "fail to reject " |
| Conclusion | A sentence in context about the evidence for |
("H-naught") is the null hypothesis, is the alternative hypothesis, and ("alpha") is the significance level, chosen before looking at the data. The procedures and their conditions are in which statistical test to use and the conditions for inference checklist.
Stating hypotheses
| Test | is one of | |
|---|---|---|
| One proportion | , , | |
| Two proportions | , , | |
| One mean | , , | |
| Mean difference (paired) | , , | |
| Two means | , , | |
| Chi-square for homogeneity | The distributions of the variable are the same for all populations or treatments | The distributions are not all the same |
| Chi-square for independence | There is no association between the two variables | There is an association between the two variables |
Rules that apply to every row:
- Hypotheses are about population parameters such as and . They are never about sample statistics such as and .
- contains the equality. is the claim the study is looking for evidence of.
- The direction of comes from the question asked, before the data are examined.
- Define each parameter in words, including the population.
See null vs alternative hypothesis and one-tailed vs two-tailed tests.
Test statistic and p-value
For z and t tests, the test statistic measures how many standard errors the sample statistic is from the null value:
The p-value is the probability, computed assuming is true, of getting a test statistic as extreme as or more extreme than the one observed, in the direction of .
| P-value | |
|---|---|
| Parameter null value | Area to the right of the test statistic |
| Parameter null value | Area to the left of the test statistic |
| Parameter null value | Twice the area in the tail beyond the test statistic |
| Chi-square test | Area to the right of |
A small p-value means the observed result would be unusual if were true, which is evidence for . The p-value is not the probability that is true. See what a p-value means and the p-value calculator.
Decision and conclusion sentences
| Result | Decision | Conclusion sentence |
|---|---|---|
| p-value | Reject | "Because the p-value of [value] is less than or equal to [value], we reject . There is convincing evidence that [ in context]." |
| p-value | Fail to reject | "Because the p-value of [value] is greater than [value], we fail to reject . There is not convincing evidence that [ in context]." |
Both conclusions are written about . Only the word "not" changes.
| Wording to avoid | Use instead |
|---|---|
| "Accept " | "Fail to reject " |
| "This proves that..." | "There is convincing evidence that..." |
| " is true" | "There is not convincing evidence that []" |
| A conclusion with no context | Name the parameter and the population |
Failing to reject does not show that is true. It means the data are consistent with . For a randomized experiment, the conclusion may describe a cause-and-effect relationship. See how to write a hypothesis test conclusion.
Type I error, Type II error, and power
| Decision | is true | is false |
|---|---|---|
| Reject | Type I error | Correct decision |
| Fail to reject | Correct decision | Type II error |
| Quantity | Definition | Probability |
|---|---|---|
| Type I error | Rejecting when is true | |
| Type II error | Failing to reject when is false | |
| Power | Rejecting when is false |
| Change, with everything else held fixed | Power | Probability of a Type II error |
|---|---|---|
| Larger sample size | Increases | Decreases |
| Larger | Increases | Decreases |
| True parameter farther from the null value | Increases | Decreases |
| Smaller standard error | Increases | Decreases |
Raising increases power and also increases the probability of a Type I error. Describe each error in context: what was decided, what was actually true, and what the consequence would be. See type 1 vs type 2 errors and the power and errors interactive.
Tests and confidence intervals together
A two-sided test and a confidence interval answer related questions.
| Procedure | Relationship |
|---|---|
| One-sample t-test of , two-sided, level | Rejects when is outside the confidence interval for , and fails to reject when is inside it |
| Tests for proportions | Usually agree with the matching interval, but can differ near the boundary because the test and the interval use different standard errors |
A 95% confidence level matches for a two-sided test. A test gives the strength of evidence against one null value. An interval gives the full set of plausible values. See confidence interval vs hypothesis test and when a confidence interval and p-value disagree.
One-sample z-test for a proportion, with the errors in context
A company reports that 25% of its roughly 5,000 customers use its app. A manager believes the proportion is now higher. In a random sample of 160 customers, 52 use the app. Carry out a test at , and describe a Type I error in context.
Hypotheses: and , where is the proportion of all the company's customers who use the app.
Conditions: the sample is random. and . and are both at least 10.
Sample proportion: .
Standard error using : .
Test statistic: .
P-value: the area to the right of is .
Decision: , so reject .
Type I error in context: concluding that more than 25% of customers use the app when the proportion is actually 25%.
, p-value about 0.014. Because the p-value is less than 0.05, we reject . There is convincing evidence that more than 25% of the company's customers use the app.
Two-sided one-sample t-test that fails to reject
A machine is set to fill bags with 100 grams of coffee. A random sample of 20 bags from a day's production of several thousand has mean 103.5 grams and standard deviation 8.0 grams, and a dotplot shows no strong skewness and no outliers. Test at whether the mean fill differs from 100 grams.
Hypotheses: and , where is the mean fill, in grams, of all bags produced that day.
Conditions: the sample is random, 20 bags are less than 10% of several thousand, and with the dotplot shows no strong skewness and no outliers.
Standard error: .
Test statistic: with .
P-value: the area to the right of 1.957 with 19 degrees of freedom is about 0.0326, and the test is two-sided, so the p-value is .
Decision: , so fail to reject .
, , p-value about 0.065. Because the p-value is greater than 0.05, we fail to reject . There is not convincing evidence that the mean fill of all bags produced that day differs from 100 grams.
Frequently asked questions
What does a p-value mean?
It is the probability of getting a result at least as extreme as the one observed, in the direction of , if is true. It is computed assuming , so it cannot be the probability that is true.
Why do we say fail to reject instead of accept?
A large p-value means the data are consistent with . They are also consistent with many other parameter values close to the null value, so the test has not shown that is true.
How are the significance level and a Type I error related?
The significance level is the probability of a Type I error: rejecting when it is true. Choosing a smaller makes a Type I error less likely and, with everything else fixed, makes a Type II error more likely.