Outlier vs influential point in regression
By Jude Wallis · Published
In regression, an outlier is a point with a large residual: it sits far above or below the line. An influential point is one whose removal noticeably changes the slope, intercept, or correlation. An outlier can leave the slope unchanged, and an influential point can have a small residual.
AP Statistics: Unit 5 (topics 5.1 Graphical Representations Between Two Quantitative Variables, 5.4 Residuals, 5.5 Least-Squares Regression). This page belongs to Unit 5, Regression Analysis, of the Fall 2026 AP Statistics course: unusual features of a scatterplot are part of topic 5.1, residuals are topic 5.4, and the least-squares line is topic 5.5. Influential point and high-leverage point are standard statistics vocabulary for these ideas.
Outlier vs influential point: the short answer
The two labels are assigned by different tests. An outlier in a regression setting is judged by its residual, the vertical distance from the point to the line. If that distance is large compared with the other residuals, the point is an outlier. An influential point is judged by refitting: remove the point, compute the least-squares line again, and compare. If the slope, the intercept, or the correlation changes noticeably, the point is influential.
Because the tests differ, the labels can come apart. A point with a large residual near the middle of the -values is an outlier that barely tilts the line. A point far to the right or left of the others can pull the line toward itself so strongly that it ends up with a small residual, which makes it influential without looking like an outlier. The two worked examples show both cases, using the same six starting points: an outlier that leaves the slope unchanged while shifting the intercept and lowering , and a point that changes the slope sharply yet ends up with a small residual.
What makes a point an outlier
A residual is the observed response minus the predicted response:
where ("y-hat") is the value the regression line predicts. An outlier is a point that does not follow the general pattern of the data, and in regression that shows up as a residual much larger in size than the rest. On a scatterplot it is a point well above or below the line. On a residual plot it is a point far from the horizontal line at zero.
This is a different test from the one used for a single quantitative variable, where an outlier is flagged by the rule or by lying more than 2 standard deviations from the mean. A point can have an ordinary -value and an ordinary -value and still be a regression outlier, because the combination falls far from the line.
What makes a point influential
An influential point is defined by its effect. Fit the line with the point and without it. If the two fits are close, the point has little influence. If they differ noticeably, the point is influential. State which quantity changed: a point can change the slope, shift the intercept, raise or lower , or any combination of these.
Points with -values far from ("x-bar"), the mean of the -values, have the most potential to be influential. Such points are called high-leverage points. The least-squares line always passes through , so a point far from acts like a weight at the end of a lever and can rotate the line. High leverage is only potential, though. If the far-out point lies along the same pattern as the rest, removing it changes the line very little. You can try this by dragging a point in the influential point interactive.
The differences side by side
| Feature | Outlier | Influential point |
|---|---|---|
| Defined by | A large residual | A noticeable change in the fit when the point is removed |
| How to check | Look at the residuals or the residual plot | Refit the line without the point and compare |
| Typical position | Far above or below the line, at any | Often at an extreme , far from |
| Size of its own residual | Large, by definition | Can be small, because the line is pulled toward it |
| Effect on the slope | Small when its is near | Can be large |
| Effect on | Usually weakens it | Can weaken it or strengthen it |
| Can be both | Yes | Yes |
A point far from the others in that also falls off the pattern is usually both. A point that is off the pattern but near is an outlier that changes the intercept and and leaves the slope alone. A point that is far out in but on the pattern is not an outlier and barely changes the line.
One line, three added points
Six points, , , , , , , have the least-squares line with . Add one more point in three different ways and refit.
| Added point | Residual from the original line | New line | New |
|---|---|---|---|
The first point is a clear outlier at , which is exactly . The slope does not change at all; the line shifts up by 2.5 and falls. The second point is far to the right and off the pattern, and the slope drops from 1.5 to about 0.4. The third point is just as far to the right but lies exactly on the original line, so the line is unchanged and rises slightly. The second and third points have the same -value and the same leverage. Only one of them changes the line.
The classic mix-up and how to avoid it
The first mistake is treating the two words as synonyms and writing "this outlier is influential" without checking. A large residual does not establish influence over the slope, as the point shows.
The second mistake is hunting for influential points on the residual plot alone. After is added and the line is refit, that point's residual is about , while the ordinary point has a residual of about . The point that did the damage has a smaller residual than a point that did nothing wrong, because the line moved toward it. Look at the scatterplot for points far from the rest in the direction, and refit without them.
The third mistake is deleting a point because it earned one of these labels. Neither label says the point is an error. Check how the value was recorded, and if it cannot be explained, report the fit with and without it. More cases to practice on are in the influential points practice set.
An outlier that leaves the slope alone
Six points, , , , , , , have least-squares line . A seventh point is added. Find its residual from the original line, then find the new least-squares line.
Confirm the original line. and . The deviations are , so .
The deviations are , so . The slope is and the intercept is .
Residual of the new point from the original line: the prediction at is , so the residual is . The six original residuals are , so 17.5 is far larger than any of them. The point is an outlier.
Refit with seven points. The new is , unchanged, so the new point's deviation is 0. It adds 0 to , which stays at 70, and 0 to , which stays at 105.
The new slope is , the same as before. The new is , so the new intercept is .
The correlation falls from about 0.988 to about 0.609, because the new point adds a large amount of scatter around the line.
The point has a residual of 17.5 from the original line, so it is an outlier. The refit line is : the slope is still 1.5, the intercept rises by 2.5, and drops to about 0.609. Because the point sits at , it has no leverage to tilt the line. It is influential for the intercept and the correlation, and it has no effect on the slope.
An influential point with a small residual
Start again from the same six points with line . This time the seventh point is . Find the new least-squares line and the new point's residual from it.
New means: and .
Use the shortcut sums. , so .
, so .
New slope: . New intercept: . The new line is .
Compare slopes: the original was 1.5 and the new one is about 0.4. One added point cut the slope to roughly a quarter of its value, so the point is influential. The correlation also falls, from about 0.988 to about 0.557.
Residual of the new point from the new line: the prediction at is , so the residual is .
Compare with another point. At the new line predicts , so the point has residual , larger in size than the residual of the point that was added.
With included, the line becomes and falls to about 0.557. The slope dropped from 1.5 to about 0.4, so the point is influential. Its own residual from the new line is only about , smaller in size than the 7.3 at . An influential point can hide on a residual plot because the line has been pulled toward it.
Frequently asked questions
Can a point be both an outlier and an influential point?
Yes. A point that is far from the other -values and also far off the pattern typically changes the line a great deal and can still have a sizable residual. The two labels describe different properties, so a point may have both, one, or neither.
Is every high-leverage point influential?
No. High leverage means the -value is far from the mean of , which gives the point the potential to move the line. If the point falls along the same pattern as the rest, removing it changes the line very little. On this page, adding leaves the line exactly as it was.
Should I remove an outlier or an influential point from the data?
Only with a documented reason, such as a recording error. Being unusual is not a reason. If the point cannot be explained, the standard practice is to report the regression both with and without it so a reader can see how much the conclusion depends on that one observation.