High-Leverage Point vs Outlier

Both terms below come up in the same part of the course, and students mix them up. Here is each one defined on its own, side by side, so you can see where they part company.

High-leverage point

Regression and correlation

A high-leverage point has an x-value far from the mean of x, which gives it unusual pull on the slope and intercept of the regression line.

Leverage is about the x-direction only: the further a point sits from xˉ\bar{x} (read x-bar, the mean of the explanatory variable), the more the line pivots to accommodate it. For the x-values 2, 3, 4, 5, and 20, the mean is 34/5=6.834/5 = 6.8, so the point at x=20x = 20 sits 13.2 units from the center while no other point is more than 4.8 units away. Keep three labels apart: an outlier in regression has a large residual, a high-leverage point has an extreme xx, and an influential point is one whose removal visibly changes the fit. A high-leverage point that happens to follow the pattern has a small residual and shifts the line very little, which is why leverage on its own is not a verdict.

Full entry for high-leverage point

Outlier

Describing data

An outlier is a data value that lies unusually far from the rest of the distribution.

An outlier is a point that stands apart from the overall pattern of the data. A common rule flags a value as an outlier when it falls below Q11.5×IQRQ_1 - 1.5 \times \text{IQR} or above Q3+1.5×IQRQ_3 + 1.5 \times \text{IQR}, using the first quartile Q1Q_1, the third quartile Q3Q_3, and the interquartile range. For example, with Q1=3Q_1 = 3, Q3=9Q_3 = 9, and IQR =6= 6, any value below 39=63 - 9 = -6 or above 9+9=189 + 9 = 18 is an outlier. Outliers can be genuine extreme cases or data-entry errors, so you investigate before removing them.

Full entry for outlier

Where each one fits in the course