What Does a P-Value Mean? (Plain-English Guide)
By Jude Wallis · Published
A p-value is the probability of getting a result at least as extreme as the one you observed, assuming the null hypothesis is true. A small p-value means your data would be unlikely under the null hypothesis, so it gives evidence against it.
AP Statistics: Unit 3 (topics 3.6 p-Values, 3.7 Carrying Out a Test for a Population Proportion). This maps to AP Statistics Unit 3 (Inference for Categorical Data: Proportions) in the Fall 2026 course, where topic 3.6 p-Values introduces the p-value and topic 3.7 carries out the one-proportion z-test.
What does a p-value mean?
A p-value is the probability, assuming the null hypothesis is true, of getting a sample result at least as extreme as the one you observed.
Break that into three parts. First, it is a probability, so it lives between 0 and 1. Second, it is computed assuming the null hypothesis is true, which is the starting claim you are testing. Third, "at least as extreme" means your observed result plus every outcome even further from what the null hypothesis predicts.
A small p-value means your data would be surprising if the null hypothesis were true, so it counts as evidence against that hypothesis. A large p-value means your data sit comfortably with the null hypothesis, so you have no strong reason to doubt it.
The null hypothesis is usually written (read "H-naught") and the alternative hypothesis is written . For how to state these, see null vs alternative hypothesis.
How to interpret a p-value
To interpret a p-value, state it as a conditional probability in context. Suppose you test whether a coin is fair and get a p-value of 0.03. The correct reading is this: if the coin were truly fair, there would be a 3% chance of seeing a result at least as far from an even split as the one you got.
Notice what the p-value measures. It measures how well your data agree with the null hypothesis, not how likely the null hypothesis itself is. The hypothesis is treated as fixed, and the data are what vary from sample to sample.
You then compare the p-value to a significance level, written (the Greek letter alpha), that you pick before collecting data. If the p-value is less than or equal to , you reject . If it is greater than , you fail to reject . Failing to reject is not the same as proving true. It only means your data did not give enough evidence against it.
What a p-value is not
Three misreadings show up constantly. Each is wrong for the same reason: the p-value is a probability about the data, not about the hypotheses.
It is not the probability that the null hypothesis is true. The p-value already assumes is true and then asks about the data, so it cannot also be the probability that is true. That would reverse the conditional. What you actually computed is closer to , which is a different quantity from .
It is not the probability that your result happened by chance. Every sample result involves chance. A p-value of 0.03 does not mean there is a 3% chance your finding is a fluke and a 97% chance it is real. It only describes how often chance alone, under the null hypothesis, would produce data as extreme as yours.
It is not the probability that you are wrong. A p-value of 0.04 does not mean there is a 4% chance your conclusion is a mistake. The long-run rate of falsely rejecting a true null hypothesis is , which you set in advance, not the p-value you happen to observe. See type 1 vs type 2 errors for how those error rates work.
Is a p-value of 0.05 significant?
A p-value of 0.05 is treated as significant under the most common convention, because 0.05 is the significance level people use by default. But 0.05 is a convention, not a law of nature. Nothing physical changes between a p-value of 0.049 and one of 0.051. Only the reject-or-not label flips.
The threshold is a choice about how much risk of a false alarm you are willing to accept. A stricter level such as 0.01 makes you demand stronger evidence before rejecting , while a looser level such as 0.10 rejects more readily. You should pick before you see the data so the decision rule is not shaped by the result.
Because the exact number carries information, report the actual p-value rather than only writing "p < 0.05". A reader can then judge the strength of the evidence instead of seeing a single yes-or-no verdict.
What a p-value less than 0.05 means
A p-value less than 0.05 means that, if the null hypothesis were true, data at least as extreme as yours would occur less than 5% of the time. Under the 0.05 convention that is unusual enough to reject and call the result statistically significant.
Statistically significant is not the same as large or important. With a very big sample, a tiny and unimportant difference can still produce a p-value below 0.05. With a small sample, a real and sizable effect can produce a p-value above 0.05. The p-value reflects both the size of the effect and the amount of data, so read it alongside the actual estimate rather than on its own.
One-tailed vs two-tailed p-values
The tail you use depends on your alternative hypothesis. If says the parameter is simply different from the null value (for example ), the test is two-tailed, and the p-value adds the probability in both tails of the distribution.
If points in one direction (for example ), the test is one-tailed, and the p-value uses only the single tail in that direction. For a symmetric distribution such as the standard normal, the one-tailed p-value is half the two-tailed p-value when the observed result falls in the direction the alternative predicts. If the result comes out on the opposite side, the one-tailed p-value is instead larger than 0.5, so the halving rule does not apply.
Choose the direction from the question before you collect data, not after you see which way the result came out. Switching to a one-tailed test because it produces a smaller p-value is a misuse of the method.
How to compute a p-value with a one-proportion z-test
For a claim about a single population proportion, AP Statistics uses the one-proportion z-test (Unit 3, topics 3.6 and 3.7). The steps are:
- Write and an alternative, where is the hypothesized proportion and is the true population proportion.
- Check that the sample is random, that and , and that the sample is less than 10% of the population.
- Find the sample proportion (read "p-hat"), the fraction of successes in your sample.
- Compute the standardized test statistic $\hat{p}H_0$ is true.
- Turn into a p-value using the standard normal distribution and your alternative hypothesis, then compare it to .
The worked example below runs these steps with numbers. You can check your arithmetic with the p-value calculator or the proportion z-test calculator.
Computing a two-tailed p-value from a one-proportion z-test
A state official claims that 50% of registered voters support a ballot measure. A random sample of 100 voters finds 60 who support it. Using , test whether the true proportion of all registered voters who support the measure differs from 0.50.
State the hypotheses. Let be the true proportion of all registered voters who support the measure. and . The significance level is .
Check conditions. The sample is random. Using : and . The sample of 100 is less than 10% of all registered voters, so the observations are effectively independent, and the Large Counts check above makes the normal approximation reasonable.
Find the sample proportion. .
Find the standard deviation of the sampling distribution under . .
Compute the standardized test statistic. .
Find the p-value. The test is two-tailed, so the p-value is , where is a standard normal random variable. From the z-table, , so . The p-value is .
Compare and conclude. Because , reject . There is convincing statistical evidence that the proportion of voters who support the measure differs from 0.50.
Interpret the p-value. If exactly 50% of voters supported the measure, there would be about a 4.56% chance of getting a sample proportion at least as far from 0.50 as 0.60 is, in either direction.
and the two-tailed p-value is . Since , reject . (If the alternative had instead been , the one-tailed p-value would be .)
Frequently asked questions
Does a large p-value prove the null hypothesis is true?
No. A large p-value means your data are consistent with the null hypothesis, not that the null hypothesis is correct. You fail to reject , which only signals a lack of evidence against it. A different or larger sample could still turn up evidence later.
Is a smaller p-value always better?
Not by itself. A smaller p-value gives stronger evidence against the null hypothesis, but it says nothing about how big or important the effect is. A large sample can make a trivial difference produce a very small p-value, so always read the p-value next to the actual estimate.
Can a p-value be greater than 1?
No. A p-value is a probability, so it always falls between 0 and 1. If a calculation gives a value above 1, you have added tail areas incorrectly or used the wrong tail for your alternative hypothesis.