Test statistic vs p-value
By Jude Wallis · Published
A test statistic measures how far your sample result sits from what the null hypothesis claims, in standard errors for a z or t test. A p-value is the probability, if the null is true, of a test statistic at least that extreme. The statistic is a distance and the p-value is the tail area beyond it.
The p-value has its own topic, 3.6, in Unit 3 of the Fall 2026 AP Statistics course, and the test statistic is computed in the carrying-out topics: 3.7 for a proportion and 4.5 for a mean, with 3.13, 3.15, and 4.10 repeating the pattern for two proportions, chi-square, and two means.
Test statistic vs p-value: the short answer
A significance test produces two numbers in sequence. The test statistic comes first: it compresses the sample into one number that measures distance from the null hypothesis. The p-value comes second: it converts that distance into a probability by finding the area under a reference curve at and beyond the test statistic.
The conversion needs two things the test statistic does not contain: the reference curve, with its degrees of freedom, and the direction of the alternative hypothesis. For that reason one test statistic can correspond to several different p-values, and you cannot read the strength of evidence from the statistic alone.
The link runs in one direction. On a fixed curve with a fixed alternative, a test statistic farther out in the direction of always gives a smaller p-value.
What the test statistic measures
For proportions and means the test statistic has one form:
The result is a or a , and its unit is standard errors. A value of 1.50 says the sample statistic is 1.50 standard errors above the null value, and a value of says the same distance below. It can be any real number.
The chi-square statistic, written , is built differently. It adds up over the cells of a table, so it is never negative and carries no direction.
A test statistic is a property of the sample you drew. It is on the scale of the reference curve's horizontal axis, and on its own it is not a probability. The details of the and forms are in what is a standardized test statistic.
What the p-value measures
The p-value is the probability, computed assuming the null hypothesis is true, of getting a test statistic at least as extreme as the one observed, in the direction of the alternative hypothesis. It is an area under the reference curve, so it always lies between 0 and 1.
Which area depends on :
- Right-tailed alternative: the area to the right of the test statistic.
- Left-tailed alternative: the area to the left of it.
- Two-sided alternative: the area in both tails beyond the test statistic.
- Chi-square test: the area to the right, always.
A small p-value says a result like yours would be rare if were true, which counts as evidence against . It is the number you compare with the significance level (alpha) to make the decision. The careful wording is covered in what does a p-value mean.
One test statistic, several p-values
The table holds the test statistic at 2.50 and changes only the curve and the tail. The chi-square rows use 6.25, which is .
| Test statistic | Reference curve | Tail counted | p-value |
|---|---|---|---|
| Standard normal | Right | 0.0062 | |
| Standard normal | Both | 0.0124 | |
| , 29 df | Both | 0.0183 | |
| , 9 df | Both | 0.0339 | |
| , 5 df | Both | 0.0545 | |
| Chi-square, 1 df | Right | 0.0124 | |
| Chi-square, 2 df | Right | 0.0439 | |
| Chi-square, 4 df | Right | 0.1812 |
At the first four rows reject and the fifth does not, with the same 2.50 in every one. The chi-square rows show the same pattern: 6.25 is convincing with 1 or 2 degrees of freedom and unremarkable with 4. A test statistic becomes interpretable only once the curve and the tail are named. You can check any row with the p-value calculator.
The differences side by side
| Feature | Test statistic | p-value |
|---|---|---|
| What it is | A distance from the null claim | A probability computed assuming is true |
| Scale | Standard errors for and | 0 to 1 |
| Possible values | Any real number for and ; 0 or more for | Between 0 and 1 |
| Computed from | Sample data and the null value | The test statistic, the reference curve, and the direction of |
| Where it sits on the curve | A point on the horizontal axis | An area under the curve |
| Compared with | A critical value | The significance level |
| Stronger evidence against | Farther out in the direction of | Smaller |
When to use which. Report both. The test statistic shows the work and lets a reader check the calculation. The p-value carries the decision, because it is already on the same scale as .
The classic mix-up and how to avoid it
The frequent error is reading a test statistic as if it were a probability, or a p-value as if it were a distance. Statements such as ", so there is a 2.5% chance" or "the p-value is 0.03 standard errors" mix the two scales. A test statistic can be negative or larger than 1. A p-value cannot be either.
A second error is comparing the test statistic with . A of 1.50 is larger than 0.05, and that comparison means nothing. Compare the p-value with , or the test statistic with a critical value.
A third error is assuming the same statistic always means the same evidence. The table above shows 2.50 giving p-values from 0.0062 to 0.0545.
Neither number measures the size of an effect. A large sample shrinks the standard error, so a small difference can produce a large test statistic and a tiny p-value. Read the size of an effect from the estimate and its confidence interval, as statistical vs practical significance explains.
From a sample to a test statistic to a p-value
A report claims that 40% of a town's households own a pet. In a random sample of 150 households, 69 own a pet. Test against at . Give the test statistic and the p-value, and say what each one means.
Check the large counts condition with the null value: and , both at least 10. The sample is random, and 150 households is assumed to be under 10% of the town.
Compute the sample proportion: .
Compute the standard error under : .
Compute the test statistic: . The sample proportion is 1.50 standard errors above the claimed value.
Convert to a p-value. The alternative is two-sided, so count both tails of the standard normal curve: the area to the right of 1.50 is 0.0668, and doubling gives .
Decide: , so fail to reject .
See what the tail choice does. Had the alternative been , the same would give a p-value of 0.0668. Had it been , the p-value would be the area to the left of 1.50, which is 0.9332.
The test statistic is : the sample proportion of 0.46 sits 1.50 standard errors above 0.40. The two-sided p-value is 0.1336: if 40% of households really own a pet, a sample proportion at least this far from 0.40 in either direction would occur about 13% of the time. That is not rare, so the test fails to reject .
Equal test statistics, opposite decisions
Two studies each test against at , and both populations are stated to be approximately normal. Study A has , , . Study B has , , . Find each test statistic and p-value.
Study A standard error: .
Study A test statistic: , with degrees of freedom.
Study B standard error: .
Study B test statistic: , with degrees of freedom.
Convert each to a two-sided p-value on its own curve. With 29 degrees of freedom, gives 0.0183. With 5 degrees of freedom, gives 0.0545.
Decide. Study A: , reject . Study B: , fail to reject .
Both studies have . Study A's p-value is 0.0183 and it rejects ; Study B's p-value is 0.0545 and it fails to reject. The curve with 5 degrees of freedom has heavier tails than the curve with 29, so the same distance from the null leaves more area beyond it. The test statistic alone could not have told the two studies apart.
Frequently asked questions
Does a bigger test statistic always mean a smaller p-value?
On the same reference curve with the same alternative, yes: a test statistic farther out in the direction of leaves less area beyond it. Across different curves or tails, no. A of 2.50 has a two-sided p-value of 0.0183 with 29 degrees of freedom and 0.0545 with 5.
Can a p-value be negative or greater than 1?
No. A p-value is a probability, so it lies between 0 and 1. A test statistic has no such limit: a or can be negative or well above 1. If your p-value falls outside 0 to 1, you have probably written down the test statistic instead.
Which one do I compare with alpha?
The p-value. Both the p-value and are areas under the reference curve, so they can be compared directly: reject when the p-value is at or below . The test statistic is compared with a critical value, which is a point on the horizontal axis.