Type I and Type II Error worksheet with answer key

8 problems on type I and Type II Error, ready to print for class or homework. The answer key prints on its own page, so hand out everything before it.

Problem 1

A city water utility tests whether more than 10% of homes in a district have lead above the federal action level. Let pp be the true proportion of homes in that district above the action level. The utility tests H0:p=0.10H_0: p = 0.10 against Ha:p>0.10H_a: p > 0.10 at α=0.05\alpha = 0.05. (a) Describe a Type I error in context and give its consequence. (b) Describe a Type II error in context and give its consequence. (c) Give the probability of a Type I error. (d) Which error is more serious here?

Problem 2

A nutrition lab tests whether a redesigned food label raises the proportion of shoppers who check calories before buying. It tests H0:p=0.30H_0: p = 0.30 against Ha:p>0.30H_a: p > 0.30 at α=0.05\alpha = 0.05 with n=200n = 200 shoppers. Against the specific alternative p=0.38p = 0.38, the test has power 0.780.78. (a) Find β\beta for that alternative. (b) Interpret the power in context. (c) Taking one change at a time, state what happens to power and which error becomes more likely: (i) raising nn from 200 to 500, (ii) lowering α\alpha from 0.05 to 0.01, (iii) the true proportion being 0.34 instead of 0.38.

Problem 3

A statistics class studies a test's performance by simulating 500 random samples from a population in which the null hypothesis is false, so a real effect exists. Their test rejects H0H_0 in 340 of the 500 simulated tests. (a) Estimate the power of the test. (b) Estimate β\beta. (c) If the class ran 75 more studies under these same conditions, about how many would end in a Type II error? (d) If they redid the simulation at α=0.10\alpha = 0.10 instead of α=0.05\alpha = 0.05, would that count go up or down, and what is the cost?

Problem 4

A research group runs 40 independent hypothesis tests, each at α=0.05\alpha = 0.05, and suppose every one of the 40 null hypotheses is actually true. (a) How many Type I errors should the group expect? (b) Find the probability that at least one of the 40 tests produces a Type I error. (c) How many Type II errors should the group expect?

Problem 5

A delivery service advertises that 80% of its orders arrive within two days. A consumer group takes a random sample of 150 recent orders and finds that 108 arrived within two days. (a) Carry out a test at α=0.05\alpha = 0.05 of whether the true proportion arriving within two days is less than 0.80. (b) Name the error this decision could be, describe it in context, and give its probability if H0H_0 is true.

Problem 6

A nurse at a high school with 4,000 students suspects that more than 25% of them skip breakfast. In a random sample of 80 students, 26 report skipping breakfast. (a) Carry out a test at α=0.05\alpha = 0.05. (b) Name the error this decision could be and describe it in context. (c) The nurse repeats the study with a random sample of 320 students and gets the same sample proportion, 104 of 320. Recompute the test statistic and p-value, then explain what the comparison shows about sample size and power.

Problem 7

A polling firm tests H0:p=0.50H_0: p = 0.50 against Ha:p>0.50H_a: p > 0.50 using a random sample of n=100n = 100 voters, and its decision rule is to reject H0H_0 whenever p^≥0.58\hat{p} \ge 0.58. (a) If the true proportion is p=0.65p = 0.65, find the power of this test and the probability of a Type II error. (b) Repeat for a true proportion of p=0.60p = 0.60. (c) Explain what the comparison shows. In each part the sampling distribution of p^\hat{p} is approximately Normal.

Problem 8

A manufacturer's contract requires that no more than 2% of the pressure sensors in a production run be defective. An independent inspector draws a random sample of 500 sensors from a large run and finds 16 defective. (a) State the hypotheses and check the conditions. (b) Find the test statistic and p-value. (c) State a conclusion at α=0.05\alpha = 0.05, then name the error that decision could be and give its consequence. (d) The manufacturer argues the test should use α=0.01\alpha = 0.01. Give the conclusion at that level, name the error that decision could be, and say which party each significance level protects.

Type I and Type II Error: answer key

  1. (a) Type I: deciding more than 10% of homes exceed the action level when they do not, causing needless pipe replacement. (b) Type II: missing a real problem, leaving residents exposed to lead. (c) P(Type I)=α=0.05P(\text{Type I}) = \alpha = 0.05. (d) The Type II error, because continued lead exposure outweighs unnecessary construction.

  2. (a) β=0.22\beta = 0.22. (b) If the true proportion is 0.38, the test catches the increase about 78% of the time and misses it 22% of the time. (c)(i) power up, Type II less likely, α\alpha still 0.05; (ii) power down, Type II more likely, Type I rate down to 0.01; (iii) power down, Type II more likely, α\alpha unchanged.

  3. (a) power ≈0.68\approx 0.68. (b) β≈0.32\beta \approx 0.32. (c) About 75×0.32=2475 \times 0.32 = 24 Type II errors. (d) Down, because a larger α\alpha raises power, but the Type I error rate rises from 0.05 to 0.10.

  4. (a) 40×0.05=240 \times 0.05 = 2 expected Type I errors. (b) 1−0.9540=1−0.1285=0.87151 - 0.95^{40} = 1 - 0.1285 = 0.8715. (c) Zero, because a Type II error requires a false null and all 40 nulls are true.

  5. (a) p^=0.72\hat{p} = 0.72, z=−2.45z = -2.45, p-value =0.0071= 0.0071; reject H0H_0 at α=0.05\alpha = 0.05, so there is convincing evidence fewer than 80% of orders arrive within two days. (b) A wrong rejection here is a Type I error, probability 0.05: falsely accusing a service that does meet its 80% claim.

  6. (a) p^=0.325\hat{p} = 0.325, z=1.55z = 1.55, p-value =0.0606= 0.0606; fail to reject at α=0.05\alpha = 0.05. (b) A Type II error: missing a real skip rate above 25% and leaving a needed breakfast program unfunded. (c) With n=320n = 320, z=3.10z = 3.10 and the p-value is 0.00100.0010, so reject. Quadrupling nn halves SESE, doubles zz, and raises power with α\alpha fixed.

  7. (a) z=0.58−0.650.0477=−1.47z = \frac{0.58 - 0.65}{0.0477} = -1.47, so power =1−0.0708=0.929= 1 - 0.0708 = 0.929 and β=0.071\beta = 0.071. (b) z=0.58−0.600.0490=−0.41z = \frac{0.58 - 0.60}{0.0490} = -0.41, so power =1−0.3409=0.659= 1 - 0.3409 = 0.659 and β=0.341\beta = 0.341. (c) With α\alpha and nn held fixed, a true proportion closer to the null gives lower power and a larger Type II error rate.

  8. (a) H0:p=0.02H_0: p = 0.02 against Ha:p>0.02H_a: p > 0.02, conditions met with np0=10np_0 = 10 exactly at the boundary. (b) p^=0.032\hat{p} = 0.032, z=1.92z = 1.92, p-value =0.0274= 0.0274. (c) Reject at α=0.05\alpha = 0.05; a wrong rejection is a Type I error, scrapping a run that met the 2% limit. (d) Fail to reject at α=0.01\alpha = 0.01; a wrong failure to reject is a Type II error, shipping defective sensors. The larger α\alpha protects the buyer, the smaller α\alpha protects the manufacturer.

The key gives final answers only. The full worked solution for each problem is on the matching practice set, and every other sheet is on the worksheets page.

More worksheets from this unit