Inference for means: 8 mixed t procedure problems

By Jude Wallis · Published

This set has 8 problems spanning Unit 4 topics 4.2 to 4.10. Nothing tells you which procedure to run, so every problem starts with the same decision: one-sample t interval, one-sample t test, two-sample t, or paired t. Several hinge entirely on reading the design rather than on arithmetic.

AP Statistics: Unit 4 (topics 4.2 Constructing a Confidence Interval for a Population Mean or Population Mean Difference, 4.4 Setting Up a Test for a Population Mean or Population Mean Difference, 4.5 Carrying Out a Test for a Population Mean or Population Mean Difference, 4.7 Constructing a Confidence Interval for the Difference Between Two Population Means, 4.9 Setting Up a Test for the Difference Between Two Population Means, 4.10 Carrying Out a Test for the Difference Between Two Population Means). This set spans Unit 4 topics 4.2 through 4.10 of the Fall 2026 AP Statistics course, the one-sample and two-sample means procedures together. Unit 4 is 10 to 20% of the multiple-choice section, and free-response questions on it routinely make the choice of procedure a scored component rather than a given.

What these problems build

Individual practice sets tell you the procedure in their title. The exam does not. It hands you a paragraph about how data were collected and expects you to name the procedure, justify it, check its conditions, run it, and interpret the result in context. Picking the wrong procedure loses every point downstream, no matter how clean the arithmetic is.

These 8 problems are deliberately unlabeled. Problem 1 is identification only and problem 7 works backwards from a printed interval; the other six name the procedure first and then carry it through to a conclusion. Two of them are built around a design that looks like something it is not.

Before starting, review the conditions each procedure needs in the conditions for inference checklist, and if a scenario is genuinely ambiguous, work it through the which test decision tool. For arithmetic checks, use the one-sample t test calculator or the two-sample t test calculator. More sets are on the practice page.

Three questions that settle the procedure

Ask them in this order, and the answer falls out.

1. How many groups of data are there? One group compared against a claimed number is a one-sample procedure. Two groups is either paired or two-sample, which question 2 settles.

2. If there are two columns, is each value in one tied to a specific value in the other? Same subject measured twice, same specimen tested twice, or two subjects matched and then split: paired, so build one column of differences and run a one-sample procedure with df=n1df = n - 1. Separate sets of individuals with no such link: two-sample, with df=min(n1,n2)1df = \min(n_1, n_2) - 1 by hand.

3. Is the question asking how big, or asking whether? 'Estimate', 'construct an interval', and 'with 95% confidence' call for an interval. 'Is there convincing evidence', 'test the claim', and a stated α\alpha call for a test.

DesignParameterStandard errordf by hand
One sample vs a claimμ\musn\frac{s}{\sqrt{n}}n1n - 1
Paired or matchedμd\mu_dsdn\frac{s_d}{\sqrt{n}}n1n - 1
Two independent samplesμ1μ2\mu_1 - \mu_2s12n1+s22n2\sqrt{\frac{s_1^2}{n_1} + \frac{s_2^2}{n_2}}min(n1,n2)1\min(n_1, n_2) - 1

Two traps recur. Equal sample sizes do not make a design paired: two groups of 15 different people are still two independent samples. And comparing one sample against a fixed published number is a one-sample procedure, not a two-sample one, because a number is not a sample. See which statistical test to use and paired vs two-sample t test.

Frequently asked questions

What is the fastest way to tell the three t procedures apart?

Count the groups first. One group measured against a claimed value is one-sample. Two columns of numbers where each value in one is tied to a specific value in the other, by the same subject, the same specimen, or a deliberate match, is paired: collapse to differences and run the one-sample procedure. Two columns from separate individuals with no such link is two-sample. Unequal sample sizes settle it immediately, since pairing requires equal counts.

Is comparing my sample to a published number a two-sample test?

No. A two-sample procedure needs two sets of data so that both contribute sampling variability to the standard error. A published guideline, a labeled weight, or an advertised claim is a single fixed number with no sample behind it, so it goes in as μ0\mu_0 in a one-sample tt test. Problem 6 works through exactly this mistake.

How do I know whether to build an interval or run a test?

Read the verb. 'Estimate', 'construct an interval', and any stated confidence level ask how big the parameter is, which is an interval. 'Is there convincing evidence', 'test the claim', and a stated significance level ask whether a specific value is plausible, which is a test. They are two views of the same information: a 100(1α)%100(1 - \alpha)\% interval and a two-sided test at level α\alpha always give the same decision about a value inside or outside the interval. See confidence interval vs hypothesis test.

Does picking the wrong procedure cost every point on an FRQ?

Close to it. The identification and justification usually carry their own scoring component, and the computation is scored against the procedure the design actually calls for, so correct arithmetic on the wrong procedure earns little. The cheapest insurance is one sentence naming the procedure and the design feature that forces it, written before any calculation: 'paired tt test, because each subject was measured under both conditions.'

Problem 1

Name the procedure each study calls for, and give the reason. Do not compute anything.

(a) A random sample of 40 used cars is tested, and the goal is to estimate the mean carbon dioxide output per kilometer with 95% confidence. The population standard deviation is unknown. (b) Twenty-five volunteers each taste two formulas of the same soda and rate both on a 100-point scale. (c) An independent random sample of 30 seniors and an independent random sample of 30 first-year students report nightly sleep, and the question is whether mean sleep differs. (d) A random sample of 18 batteries is tested against the manufacturer's claim that mean life is 500 hours.

Show the worked solution
  1. (a) One-sample tt interval for μ\mu. There is one group, no claimed value to test against, and the word 'estimate' with a confidence level. The interval is tt rather than zz because σ\sigma is unknown and ss stands in for it, with df=39df = 39.

  2. (b) Paired tt procedure on the differences. Each volunteer produces two ratings, so volunteer 12's two scores belong together. Collapse to 25 differences and run a one-sample procedure with df=24df = 24. Whether it is an interval or a test depends on what is asked next, but the pairing is fixed by the design.

  3. (c) Two-sample tt test for μ1μ2\mu_1 - \mu_2. Two separate groups of students with no link between any senior and any first-year, and the question asks whether means differ, which is a test rather than an interval. By hand, df=min(30,30)1=29df = \min(30, 30) - 1 = 29. Equal group sizes here are a coincidence, not pairing.

  4. (d) One-sample tt test for μ\mu. One group measured against a fixed claimed value, μ0=500\mu_0 = 500 hours, with df=17df = 17. The 500 is a number, not a second sample, so no two-sample procedure is involved.

  5. Notice the pattern. Nothing in the arithmetic decided any of these. The number of groups, the presence or absence of a link between the columns, and the verb in the question did all the work.

(a) One-sample tt interval, df=39df = 39. (b) Paired tt procedure on 25 differences, df=24df = 24. (c) Two-sample tt test, df=29df = 29 by hand. (d) One-sample tt test against μ0=500\mu_0 = 500, df=17df = 17.

Problem 2

A 3D printer's manufacturer advertises a mean print time of 45 minutes for one benchmark model. A maker space times a random sample of 20 prints of that model on its own machine and finds xˉ=47.6\bar{x} = 47.6 minutes with s=5.4s = 5.4 minutes; a dotplot of the 20 times is roughly symmetric with no outliers. At α=0.05\alpha = 0.05, is there convincing evidence that this machine's true mean print time differs from the advertised 45 minutes?

Show the worked solution
  1. Choose the procedure. One group of 20 prints compared against a fixed advertised value, and σ\sigma is unknown, so this is a one-sample tt test for a mean. There is no second sample to compare with.

  2. State. Let μ\mu be the true mean print time, in minutes, for this benchmark model on this machine. H0:μ=45H_0: \mu = 45 versus Ha:μ45H_a: \mu \ne 45, with α=0.05\alpha = 0.05. The alternative is two-sided because 'differs' names no direction.

  3. Plan. Random: the 20 prints are a random sample. 10%: 20 is less than 10% of all prints this machine could produce. Normal/large sample: n=20<30n = 20 < 30, so lean on the dotplot, which is roughly symmetric with no outliers.

  4. Compute the standard error and the test statistic. SE=sn=5.420=5.44.4721=1.2075SE = \frac{s}{\sqrt{n}} = \frac{5.4}{\sqrt{20}} = \frac{5.4}{4.4721} = 1.2075 minutes, so t=47.6451.2075=2.61.2075=2.15t = \frac{47.6 - 45}{1.2075} = \frac{2.6}{1.2075} = 2.15 with df=201=19df = 20 - 1 = 19.

  5. Find the p-value. Two-sided, so use t=2.15|t| = 2.15. In the df=19df = 19 row it falls between 2.0932.093 (tail 0.0250.025) and 2.5392.539 (tail 0.010.01), so one tail holds between 0.010.01 and 0.0250.025 and the two-sided p-value is between 0.020.02 and 0.050.05. Technology gives 0.04440.0444.

  6. Conclude. The p-value 0.04440.0444 is below 0.050.05, so reject H0H_0. There is convincing evidence that this machine's true mean print time differs from the advertised 45 minutes, running longer in this sample. The margin is thin: at α=0.01\alpha = 0.01 the same data would not have rejected, so the evidence is real but not overwhelming.

One-sample tt test. SE=1.2075SE = 1.2075, t=2.15t = 2.15, df=19df = 19, two-sided p-value 0.0444\approx 0.0444 (table bracket 0.020.02 to 0.050.05). Reject H0H_0 at α=0.05\alpha = 0.05; convincing evidence the true mean print time differs from 45 minutes, though the result would not reject at α=0.01\alpha = 0.01.

Problem 3

A biologist measures forewing length, in millimeters, on an independent random sample of 15 butterflies from Meadow Site and an independent random sample of 15 from Woodland Site. Meadow gives xˉ1=62.4\bar{x}_1 = 62.4 with s1=6.1s_1 = 6.1; Woodland gives xˉ2=68.1\bar{x}_2 = 68.1 with s2=7.3s_2 = 7.3. A student says that because both samples have 15 observations, the data can be paired. (a) Explain why that is wrong and name the correct procedure. (b) Carry it out at α=0.05\alpha = 0.05 using the conservative degrees of freedom. (c) State what the study design does and does not let the biologist claim.

Show the worked solution
  1. (a) Why pairing fails. Pairing requires a link between one specific observation in each group, created by measuring the same individual twice or by matching individuals deliberately. Here the two samples are different butterflies caught at different sites, chosen independently, so butterfly 7 at Meadow has no partner at Woodland. Equal sample sizes are a necessary consequence of pairing, never a cause of it. The correct procedure is a two-sample tt test for a difference of means.

  2. (b) State. Let μ1\mu_1 be the true mean forewing length at Meadow Site and μ2\mu_2 the true mean at Woodland Site, in millimeters. H0:μ1μ2=0H_0: \mu_1 - \mu_2 = 0 versus Ha:μ1μ20H_a: \mu_1 - \mu_2 \ne 0, with α=0.05\alpha = 0.05.

  3. (b) Plan. Two independent random samples, one from each site. 10%: 15 is less than 10% of the butterflies at each site. Normal/large sample: both samples are under 30, so assume forewing lengths at each site are roughly normal with no strong skew or outliers. Independence: the samples were drawn independently of each other.

  4. (b) Standard error. s12n1=37.2115=2.4807\frac{s_1^2}{n_1} = \frac{37.21}{15} = 2.4807 and s22n2=53.2915=3.5527\frac{s_2^2}{n_2} = \frac{53.29}{15} = 3.5527, so SE=2.4807+3.5527=6.0334=2.4563SE = \sqrt{2.4807 + 3.5527} = \sqrt{6.0334} = 2.4563 mm. Note that variances are added, never standard deviations.

  5. (b) Test statistic and p-value. t=62.468.12.4563=5.72.4563=2.32t = \frac{62.4 - 68.1}{2.4563} = \frac{-5.7}{2.4563} = -2.32, with conservative df=min(15,15)1=14df = \min(15, 15) - 1 = 14. Two-sided, so use t=2.32|t| = 2.32, which falls between 2.1452.145 (tail 0.0250.025) and 2.6242.624 (tail 0.010.01), putting the two-sided p-value between 0.020.02 and 0.050.05. Technology gives 0.03590.0359.

  6. (b) Conclude. The p-value is below 0.050.05, so reject H0H_0. There is convincing evidence that true mean forewing length differs between the two sites, with Woodland longer in these samples.

  7. (c) Scope. Both samples were randomly selected, so the conclusion generalizes to the butterflies at each of these two sites. Site was not assigned by the biologist, so this is observational: the difference cannot be attributed to the habitat itself, since anything that differs between the sites, food supply, predation, or which subspecies happens to live there, could produce the same gap.

(a) Different butterflies with no link between individuals, so the data are two independent samples; equal sizes do not create pairing. (b) SE=2.4563SE = 2.4563 mm, t=2.32t = -2.32, conservative df=14df = 14, two-sided p-value 0.0359\approx 0.0359 (table bracket 0.020.02 to 0.050.05). Reject H0H_0; convincing evidence the true mean forewing lengths differ. (c) Random selection generalizes to each site, but with no random assignment the difference cannot be attributed to habitat.

Problem 4

An environmental lab checks two chlorine test kits by running both kits on each of 12 randomly selected water samples. For the differences (Kit 1 reading minus Kit 2 reading), in parts per million, the lab reports dˉ=0.42\bar{d} = 0.42 and sd=0.58s_d = 0.58. (a) Name the procedure and say what feature of the design fixes it. (b) Construct a 95% confidence interval for the true mean difference. (c) Interpret the interval and say what it implies about whether the kits agree.

Show the worked solution
  1. (a) Identify the design. Each water sample is measured by both kits, so the two readings on sample 5 belong together and their difference is meaningful. That link makes this a matched-pairs design, and the correct procedure is a paired tt interval, which is a one-sample tt interval built on the 12 differences with df=11df = 11. There are 24 readings but only 12 pairs, and n=12n = 12.

  2. (b) Plan. Random: the 12 water samples are a random sample. 10%: 12 pairs is under 10% of the water samples the lab could test. Normal/large sample: n=12<30n = 12 < 30, so assume the differences are roughly normal with no strong skew or outliers. Conditions are checked on the differences, not on the two columns of readings.

  3. (b) Standard error. SE=sdn=0.5812=0.583.4641=0.16743SE = \frac{s_d}{\sqrt{n}} = \frac{0.58}{\sqrt{12}} = \frac{0.58}{3.4641} = 0.16743 ppm.

  4. (b) Critical value and margin of error. With df=11df = 11, the 95% column gives t=2.201t^* = 2.201, so ME=2.201×0.16743=0.3685ME = 2.201 \times 0.16743 = 0.3685 ppm.

  5. (b) Interval. 0.42±0.3685=(0.0515, 0.7885)0.42 \pm 0.3685 = (0.0515,\ 0.7885) ppm.

  6. (c) Interpret. We are 95% confident that the interval from 0.05150.0515 to 0.78850.7885 ppm captures the true mean difference in chlorine reading (Kit 1 minus Kit 2) on water samples like these.

  7. (c) Answer the agreement question. The interval lies entirely above 0, so a true mean difference of zero is not plausible: the kits do not agree on average, and Kit 1 reads higher. A matching two-sided test confirms it, with t=0.420.16743=2.51t = \frac{0.42}{0.16743} = 2.51 at df=11df = 11 giving a p-value of 0.02910.0291, below 0.050.05. Note the practical caveat: the lower bound is only 0.050.05 ppm, so the bias might be too small to matter for the lab's purposes even though it is statistically detectable.

(a) Paired tt interval, because both kits measure the same 12 water samples, so n=12n = 12 pairs and df=11df = 11. (b) SE=0.16743SE = 0.16743 ppm, t=2.201t^* = 2.201, ME=0.3685ME = 0.3685, interval (0.0515, 0.7885)(0.0515,\ 0.7885) ppm. (c) 95% confident it captures the true mean difference; it excludes 0, so Kit 1 reads higher on average, though the difference may be too small to matter in practice.

Problem 5

A poultry researcher compares two feed formulas. An independent random sample of 14 hens on Feed A lays a mean of 232 eggs per year with s1=18s_1 = 18; an independent random sample of 16 hens on Feed B lays a mean of 221 eggs with s2=22s_2 = 22. Construct a 90% confidence interval for the difference in true mean annual egg production using the conservative degrees of freedom, and interpret it.

Show the worked solution
  1. Choose the procedure. Two independent random samples of different hens, and the question asks for an interval at a stated confidence level, so this is a two-sample tt interval for μ1μ2\mu_1 - \mu_2. The unequal sizes 14 and 16 rule out any paired procedure on sight.

  2. State. Let μ1\mu_1 and μ2\mu_2 be the true mean annual egg production for hens on Feed A and Feed B. Estimate μ1μ2\mu_1 - \mu_2 with 90% confidence.

  3. Plan. Random: two independent random samples, one per feed. 10%: 14 and 16 are each less than 10% of the hens that could be raised on that feed. Normal/large sample: both samples are under 30, so assume egg counts under each feed are roughly normal with no strong skew or outliers.

  4. Point estimate and standard error. xˉ1xˉ2=232221=11\bar{x}_1 - \bar{x}_2 = 232 - 221 = 11 eggs. Then s12n1=32414=23.1429\frac{s_1^2}{n_1} = \frac{324}{14} = 23.1429 and s22n2=48416=30.25\frac{s_2^2}{n_2} = \frac{484}{16} = 30.25, so SE=23.1429+30.25=53.3929=7.307SE = \sqrt{23.1429 + 30.25} = \sqrt{53.3929} = 7.307 eggs.

  5. Critical value and margin of error. Conservative df=min(14,16)1=13df = \min(14, 16) - 1 = 13. A 90% interval leaves 0.050.05 in each tail, so the df=13df = 13 row gives t=1.771t^* = 1.771, and ME=1.771×7.307=12.94ME = 1.771 \times 7.307 = 12.94 eggs.

  6. Build the interval. 11±12.94=(1.94, 23.94)11 \pm 12.94 = (-1.94,\ 23.94) eggs per year.

  7. Interpret. We are 90% confident that the interval from 1.94-1.94 to 23.9423.94 eggs per year captures the true difference in mean annual egg production between hens on Feed A and hens on Feed B.

  8. Read the zero. The interval contains 0, so a true difference of zero is a plausible value and this study gives no convincing evidence that the two feeds differ in true mean production. The interval is nearly 26 eggs wide, so 'no convincing evidence' here means the study is too small to settle the question, not that the feeds are known to perform identically.

Two-sample tt interval. xˉ1xˉ2=11\bar{x}_1 - \bar{x}_2 = 11 eggs, SE=7.307SE = 7.307, conservative df=13df = 13, t=1.771t^* = 1.771, ME=12.94ME = 12.94. The 90% interval is (1.94, 23.94)(-1.94,\ 23.94) eggs per year. It contains 0, so there is no convincing evidence of a difference, and the interval is too wide to settle the question either way.

Problem 6

A public health guideline says a single frozen dinner should average no more than 600 calories. A researcher measures a random sample of 22 frozen dinners from one manufacturer and finds xˉ=638\bar{x} = 638 calories with s=82s = 82 calories, with a boxplot showing no outliers and little skew. A student proposes a two-sample tt test, treating the 22 dinners as one sample and the 600-calorie guideline as the other. (a) Explain what is wrong with that and name the correct procedure. (b) Carry it out at α=0.05\alpha = 0.05. (c) Interpret the p-value in context.

Show the worked solution
  1. (a) Why the two-sample idea fails. A two-sample procedure needs two sets of data, each with its own nn, mean, and standard deviation, so that the sampling variability of both can enter the standard error. The 600-calorie guideline is a fixed published number with no sample behind it, so it contributes no variability. The correct procedure is a one-sample tt test for a mean, with μ0=600\mu_0 = 600.

  2. (b) State. Let μ\mu be the true mean calorie content of this manufacturer's frozen dinners. Because the guideline is an upper limit and the concern is exceeding it, H0:μ=600H_0: \mu = 600 versus Ha:μ>600H_a: \mu > 600, with α=0.05\alpha = 0.05.

  3. (b) Plan. Random: the 22 dinners are a random sample. 10%: 22 is less than 10% of all dinners this manufacturer produces. Normal/large sample: n=22<30n = 22 < 30, so lean on the boxplot, which shows no outliers and little skew.

  4. (b) Compute. SE=sn=8222=824.6904=17.4825SE = \frac{s}{\sqrt{n}} = \frac{82}{\sqrt{22}} = \frac{82}{4.6904} = 17.4825 calories, so t=63860017.4825=3817.4825=2.17t = \frac{638 - 600}{17.4825} = \frac{38}{17.4825} = 2.17 with df=221=21df = 22 - 1 = 21.

  5. (b) p-value and decision. Right-tailed. In the df=21df = 21 row, 2.172.17 falls between 2.0802.080 (tail 0.0250.025) and 2.5182.518 (tail 0.010.01), so the p-value is between 0.010.01 and 0.0250.025. Technology gives 0.02070.0207. That is below 0.050.05, so reject H0H_0. There is convincing evidence that this manufacturer's dinners average more than 600 calories.

  6. (c) Interpret the p-value. If the true mean calorie content really were exactly 600, only about 2.07% of random samples of 22 dinners would produce a sample mean of 638 calories or higher by chance alone. A result that unlikely under the guideline is what makes the evidence against it convincing. Because H0H_0 was rejected, a wrong decision here would be a Type I error: reporting that the dinners exceed the guideline when in truth they average 600.

(a) A published guideline is a number, not a sample, so it carries no sampling variability; use a one-sample tt test with μ0=600\mu_0 = 600. (b) SE=17.4825SE = 17.4825, t=2.17t = 2.17, df=21df = 21, one-sided p-value 0.0207\approx 0.0207 (table bracket 0.010.01 to 0.0250.025). Reject H0H_0; convincing evidence the true mean exceeds 600 calories. (c) If the true mean were 600, only about 2.07% of samples of 22 would average 638 calories or more.

Problem 7

Two weather stations report weekly rainfall, in millimeters. From an independent random sample of 12 weeks at Station A and an independent random sample of 15 weeks at Station B, an analyst reports a 95% confidence interval for μAμB\mu_A - \mu_B of (1.2, 4.8)(-1.2,\ 4.8), built with the conservative degrees of freedom. (a) Name the procedure and give the degrees of freedom and tt^* used. (b) Recover the observed difference in sample means, the margin of error, and the standard error. (c) State what a two-sided test of H0:μAμB=0H_0: \mu_A - \mu_B = 0 at α=0.05\alpha = 0.05 would conclude, without computing a p-value. (d) A colleague writes that the study proves the two stations get the same mean weekly rainfall. Correct that.

Show the worked solution
  1. (a) Procedure and df. Two independent random samples of different weeks at different stations, with an interval requested, so this is a two-sample tt interval for a difference of means. Conservative df=min(12,15)1=11df = \min(12, 15) - 1 = 11, and the 95% column of the tt-table at df=11df = 11 gives t=2.201t^* = 2.201.

  2. (b) Center and margin. The observed difference sits at the midpoint: xˉAxˉB=1.2+4.82=3.62=1.8\bar{x}_A - \bar{x}_B = \frac{-1.2 + 4.8}{2} = \frac{3.6}{2} = 1.8 mm. The margin of error is half the width: ME=4.8(1.2)2=6.02=3.0ME = \frac{4.8 - (-1.2)}{2} = \frac{6.0}{2} = 3.0 mm. So the interval is 1.8±3.01.8 \pm 3.0.

  3. (b) Standard error. Since ME=t×SEME = t^* \times SE, invert it: SE=MEt=3.02.201=1.363SE = \frac{ME}{t^*} = \frac{3.0}{2.201} = 1.363 mm.

  4. (c) The test decision. The interval contains 0, so a true difference of zero is a plausible value at 95% confidence. A two-sided test at α=0.05\alpha = 0.05 and a 95% interval always agree, so the test fails to reject H0H_0: there is not convincing evidence that the two stations differ in true mean weekly rainfall. As a cross-check, t=1.81.363=1.32t = \frac{1.8}{1.363} = 1.32 at df=11df = 11 is nowhere near the 2.2012.201 needed to reject.

  5. (d) Correct the colleague. Failing to reject a null hypothesis is not proof that it is true. The interval runs from 1.2-1.2 to 4.84.8 mm, so a 4 mm advantage for Station A is still a plausible value for the true difference, and so is exactly zero. An interval marks the values the data cannot rule out, not values the data support equally: the estimate is 1.81.8 mm, which sits 1.81.363=1.32\frac{1.8}{1.363} = 1.32 standard errors from zero and 2.21.363=1.61\frac{2.2}{1.363} = 1.61 standard errors from 4 mm, and neither distance reaches the 2.2012.201 that would push a value outside the interval. The honest statement is that this study did not detect a difference, and with 12 and 15 weeks of data it lacked the precision to detect a modest one. A wider net of weeks would narrow the interval and settle the question.

(a) Two-sample tt interval, conservative df=11df = 11, t=2.201t^* = 2.201. (b) xˉAxˉB=1.8\bar{x}_A - \bar{x}_B = 1.8 mm, ME=3.0ME = 3.0 mm, SE=3.02.201=1.363SE = \frac{3.0}{2.201} = 1.363 mm. (c) The interval contains 0, so the matching two-sided test at α=0.05\alpha = 0.05 fails to reject H0H_0. (d) Failing to detect a difference is not proof of no difference; a gap as large as 4 mm is still a plausible value.

Problem 8

A teacher wants to know whether reading medium affects comprehension. Two designs are proposed.

Design A. Twenty students are randomly assigned, 10 to read a passage on paper and 10 to read a different but comparable passage on screen. Design B. Ten students each read two comparable passages, one on paper and one on screen, with the order and the passage assignment randomized for each student.

(a) Name the procedure each design calls for. (b) Design B is run, and the differences (paper score minus screen score) are 2,1,3,4,0,2,5,1,3,12, -1, 3, 4, 0, 2, 5, 1, 3, 1. Test at α=0.05\alpha = 0.05 whether reading medium affects mean comprehension. (c) Explain why Design B is more likely than Design A to detect a real difference of this size. (d) State the scope of inference.

Show the worked solution
  1. (a) Match design to procedure. Design A splits 20 different students into two groups with no link between any pair of them, so it calls for a two-sample tt test with conservative df=min(10,10)1=9df = \min(10, 10) - 1 = 9. Design B has each student read in both media, so the two scores for student 6 belong together: paired tt test on 10 differences, also with df=9df = 9. Same dfdf here by coincidence, but very different procedures.

  2. (b) State. Let μd\mu_d be the true mean difference in comprehension score (paper minus screen) for students like these. H0:μd=0H_0: \mu_d = 0 versus Ha:μd0H_a: \mu_d \ne 0, with α=0.05\alpha = 0.05. Two-sided, because 'affects' names no direction.

  3. (b) Plan. Paired tt test on the 10 differences. Random: medium order and passage were randomly assigned within each student, which is the form the random condition takes in this experiment. The 10% condition does not apply, since the 10 students are not a sample drawn from a population of pairs. Normal/large sample: n=10<30n = 10 < 30, so check the differences: sorted they run 1,0,1,1,2,2,3,3,4,5-1, 0, 1, 1, 2, 2, 3, 3, 4, 5, which is single-peaked with no strong skew, and with Q1=1Q_1 = 1 and Q3=3Q_3 = 3 the 1.5×IQR1.5 \times IQR fences at 2-2 and 66 flag no outliers.

  4. (b) Compute. dˉ=2+(1)+3+4+0+2+5+1+3+110=2010=2.0\bar{d} = \frac{2 + (-1) + 3 + 4 + 0 + 2 + 5 + 1 + 3 + 1}{10} = \frac{20}{10} = 2.0 points. The squared deviations from 2 are 0,9,1,4,4,0,9,1,1,10, 9, 1, 4, 4, 0, 9, 1, 1, 1, summing to 3030, so sd=309=3.3333=1.8257s_d = \sqrt{\frac{30}{9}} = \sqrt{3.3333} = 1.8257. Then SE=1.825710=1.82573.1623=0.5774SE = \frac{1.8257}{\sqrt{10}} = \frac{1.8257}{3.1623} = 0.5774 and t=2.00.5774=3.46t = \frac{2.0}{0.5774} = 3.46 with df=9df = 9.

  5. (b) p-value and conclusion. Two-sided with t=3.46|t| = 3.46. In the df=9df = 9 row that clears 3.2503.250, the critical value for a tail of 0.0050.005, so one tail is below 0.0050.005 and the two-sided p-value is below 0.010.01. Technology gives 0.00710.0071. Reject H0H_0: there is convincing evidence that reading medium affects mean comprehension, with paper scoring higher here. The matching 95% interval, 2.0±2.262×0.5774=(0.694, 3.306)2.0 \pm 2.262 \times 0.5774 = (0.694,\ 3.306) points, excludes 0 and agrees.

  6. (c) Why Design B is more sensitive. Students differ enormously from one another in reading ability, and Design A's standard error is built from all of that between-student variation. Design B measures each student against themselves, so ability cancels out of every difference and the standard error is built only from how a single student's score changes with the medium. Here sd=1.83s_d = 1.83 points, far smaller than the spread of comprehension scores across students would be, which is what makes a 2-point effect detectable with only 10 students.

  7. (d) Scope. Medium was randomly assigned within each student, so a cause-and-effect conclusion about reading medium is justified for these students. But the 10 students were not randomly selected from any larger population, so the finding does not generalize beyond them. Random assignment buys causation; random selection buys generalization, and only the first is present.

(a) Design A: two-sample tt test, conservative df=9df = 9. Design B: paired tt test on 10 differences, df=9df = 9. (b) dˉ=2.0\bar{d} = 2.0, sd=1.8257s_d = 1.8257, SE=0.5774SE = 0.5774, t=3.46t = 3.46, df=9df = 9, two-sided p-value 0.0071\approx 0.0071 (below 0.010.01 from the table); reject H0H_0, and the 95% interval (0.694, 3.306)(0.694,\ 3.306) agrees. (c) Pairing removes between-student ability differences from the standard error, so a 2-point effect stands out. (d) Causal for these students because of random assignment, but not generalizable, because they were not randomly selected.