Type I and Type II Error worksheet with answer key
8 problems on type I and Type II Error, ready to print for class or homework. The answer key prints on its own page, so hand out everything before it.
Name: ______________________________ Date: ______________ Period: ______
Problem 1
A city water utility tests whether more than 10% of homes in a district have lead above the federal action level. Let be the true proportion of homes in that district above the action level. The utility tests against at . (a) Describe a Type I error in context and give its consequence. (b) Describe a Type II error in context and give its consequence. (c) Give the probability of a Type I error. (d) Which error is more serious here?
Problem 2
A nutrition lab tests whether a redesigned food label raises the proportion of shoppers who check calories before buying. It tests against at with shoppers. Against the specific alternative , the test has power . (a) Find for that alternative. (b) Interpret the power in context. (c) Taking one change at a time, state what happens to power and which error becomes more likely: (i) raising from 200 to 500, (ii) lowering from 0.05 to 0.01, (iii) the true proportion being 0.34 instead of 0.38.
Problem 3
A statistics class studies a test's performance by simulating 500 random samples from a population in which the null hypothesis is false, so a real effect exists. Their test rejects in 340 of the 500 simulated tests. (a) Estimate the power of the test. (b) Estimate . (c) If the class ran 75 more studies under these same conditions, about how many would end in a Type II error? (d) If they redid the simulation at instead of , would that count go up or down, and what is the cost?
Problem 4
A research group runs 40 independent hypothesis tests, each at , and suppose every one of the 40 null hypotheses is actually true. (a) How many Type I errors should the group expect? (b) Find the probability that at least one of the 40 tests produces a Type I error. (c) How many Type II errors should the group expect?
Problem 5
A delivery service advertises that 80% of its orders arrive within two days. A consumer group takes a random sample of 150 recent orders and finds that 108 arrived within two days. (a) Carry out a test at of whether the true proportion arriving within two days is less than 0.80. (b) Name the error this decision could be, describe it in context, and give its probability if is true.
Problem 6
A nurse at a high school with 4,000 students suspects that more than 25% of them skip breakfast. In a random sample of 80 students, 26 report skipping breakfast. (a) Carry out a test at . (b) Name the error this decision could be and describe it in context. (c) The nurse repeats the study with a random sample of 320 students and gets the same sample proportion, 104 of 320. Recompute the test statistic and p-value, then explain what the comparison shows about sample size and power.
Problem 7
A polling firm tests against using a random sample of voters, and its decision rule is to reject whenever . (a) If the true proportion is , find the power of this test and the probability of a Type II error. (b) Repeat for a true proportion of . (c) Explain what the comparison shows. In each part the sampling distribution of is approximately Normal.
Problem 8
A manufacturer's contract requires that no more than 2% of the pressure sensors in a production run be defective. An independent inspector draws a random sample of 500 sensors from a large run and finds 16 defective. (a) State the hypotheses and check the conditions. (b) Find the test statistic and p-value. (c) State a conclusion at , then name the error that decision could be and give its consequence. (d) The manufacturer argues the test should use . Give the conclusion at that level, name the error that decision could be, and say which party each significance level protects.
From statslearn.org/worksheets/type-i-type-ii-error-worksheet. Free to print and copy for classroom use.
Type I and Type II Error: answer key
(a) Type I: deciding more than 10% of homes exceed the action level when they do not, causing needless pipe replacement. (b) Type II: missing a real problem, leaving residents exposed to lead. (c) . (d) The Type II error, because continued lead exposure outweighs unnecessary construction.
(a) . (b) If the true proportion is 0.38, the test catches the increase about 78% of the time and misses it 22% of the time. (c)(i) power up, Type II less likely, still 0.05; (ii) power down, Type II more likely, Type I rate down to 0.01; (iii) power down, Type II more likely, unchanged.
(a) power . (b) . (c) About Type II errors. (d) Down, because a larger raises power, but the Type I error rate rises from 0.05 to 0.10.
(a) expected Type I errors. (b) . (c) Zero, because a Type II error requires a false null and all 40 nulls are true.
(a) , , p-value ; reject at , so there is convincing evidence fewer than 80% of orders arrive within two days. (b) A wrong rejection here is a Type I error, probability 0.05: falsely accusing a service that does meet its 80% claim.
(a) , , p-value ; fail to reject at . (b) A Type II error: missing a real skip rate above 25% and leaving a needed breakfast program unfunded. (c) With , and the p-value is , so reject. Quadrupling halves , doubles , and raises power with fixed.
(a) , so power and . (b) , so power and . (c) With and held fixed, a true proportion closer to the null gives lower power and a larger Type II error rate.
(a) against , conditions met with exactly at the boundary. (b) , , p-value . (c) Reject at ; a wrong rejection is a Type I error, scrapping a run that met the 2% limit. (d) Fail to reject at ; a wrong failure to reject is a Type II error, shipping defective sensors. The larger protects the buyer, the smaller protects the manufacturer.
Every step is worked at statslearn.org/practice/type-i-type-ii-error-practice. Free to print and copy for classroom use.
The key gives final answers only. The full worked solution for each problem is on the matching practice set, and every other sheet is on the worksheets page.
More worksheets from this unit
- Chi-square worksheet with answer key
- Chi-square two-way table worksheet with answer key
- Checking conditions for inference worksheet with answer key
- Interpreting confidence intervals: worksheet with answer key
- Justifying claims: confidence interval worksheet
- P-value interpretation worksheet with answer key
- Proportion z-test worksheet with answer key
- Margin of error and sample size worksheet with answer key
- Sampling distribution of p-hat worksheet with answer key
- Two-proportion z interval and z test worksheet with answers