NDA Maths · Statistics

Regression and Correlation

How two variables move together — correlation measures the strength of the link, regression draws the best-fit line.

Why this matters

27 PYQs across 2017–2026, with 6 HARD — the highest hard-rate of any Statistics subtopic. Almost every recent paper asks one of three shapes: properties of the correlation coefficient r under linear transformation, finding regression lines, identifying which equation is which, or computing the angle between them. Five tight concepts cover the entire surface.

Concept 1 of 5

Correlation Coefficient and Its Properties

Intuition

Correlation coefficient

r

is a single number between

-1

and

+1

that summarises how strongly two variables move together.

r = +1

is perfect positive (one rises, the other rises by the same proportion);

r = -1

is perfect negative;

r = 0

means no linear relationship. Crucially,

r

is unaffected by shifts (change of origin) and unaffected in magnitude by positive scale changes — but a negative scale flips its sign.

Definition

For paired observations, $r = \dfrac{\text{Cov}(X,Y)}{\sigma_X \sigma_Y}$ , bounded by $-1 \leq r \leq 1$ . If $U = aX + b$ and $V = cY + d$ , then $r_{UV} = \text{sign}(ac)\,r_{XY}$ — magnitude is preserved, sign flips when one of $a, c$ is negative.

Correlation Coefficient and Invariance Rule

r = \dfrac{\text{Cov}(X,Y)}{\sigma_X\,\sigma_Y} \qquad r_{(aX+b,\,cY+d)} = \text{sign}(ac)\,r_{XY}

$\text{Cov}(X,Y)$ covariance of X and Y
$\sigma_X,\sigma_Y$ standard deviations of X and Y
$\text{sign}(ac)$ $+1$ if $a, c$ have same sign, $-1$ otherwise

Visualization · slide r, watch the cloud tighten

r = 0.80

At r = ±1 the points fall exactly on a line; toward r = 0 the cloud loses any linear shape. Positive r slopes up, negative r slopes down. r is unitless and always lies in [−1, 1] — it captures tightness and direction, not how steep the line is.

Worked example

The correlation between

x

and

y

r = 0.6

. Find the correlation between

U = 2x + 5

and

V = -3y + 1

Identify $a = 2,\ c = -3$ . Shifts $b = 5,\ d = 1$ do not affect $r$ .
Compute $\text{sign}(ac) = \text{sign}(2 \times -3) = \text{sign}(-6) = -1$ .
Apply the rule: $r_{UV} = -1 \times 0.6$ .
Result: $r_{UV} = -0.6$ . Magnitude preserved, sign flipped.

Answer:

r_{UV} = -0.6

Practice this conceptself-check · 4 quick reps

Try it yourself

r

between

x

and

y

-0.4

, find

r

between

U = -x + 1

and

V = 2y - 5

Practice — Level 1 (4 reps)

Quick reps to lock in the method. Try each, then check.

1.
$r$ between $x, y$ is $0.7$ . $r$ between $2x$ and $3y$ ?
2.
$r$ is $0.5$ . $r$ between $x$ and $-y$ ?
3.
$r$ is $-0.8$ . $r$ between $x+5$ and $y-2$ ?
4.
A computation gives $r = 1.4$ . Possible?

From the bank · past-year question

Example 1StatisticsEASY

r

is the correlation coefficient between

x

and

y

, then what is the correlation coefficient between

(3x+4)

and

(-3y+3)

[Q111 · Sep · 2023]

$r$ is bounded by $-1$ and $+1$ — always

If a calculation gives

|r| > 1

, the arithmetic is wrong. Use this as a sanity check at the end of any correlation computation.

Shift does not change $r$ ; only scale-with-negative-sign flips it

Adding constants to either variable is invisible to

r

. Multiplying by a positive constant is also invisible. Only a negative multiplier flips the sign — and even then, the magnitude is preserved.

Drill 8 more on correlation coefficient and its properties

Concept 2 of 5

Lines of Regression

Intuition

For two variables there are TWO regression lines —

y

x

(used to predict

y

from

x

) and

x

y

(used to predict

x

from

y

). Both lines always pass through the mean point

(\bar{x}, \bar{y})

. If

r = \pm 1

the two lines coincide; otherwise they intersect at

(\bar{x}, \bar{y})

at a non-zero angle.

Definition

The regression line of $y$ on $x$ has slope $b_{yx} = r\,\dfrac{\sigma_y}{\sigma_x}$ and passes through $(\bar{x}, \bar{y})$ . The regression line of $x$ on $y$ has slope $b_{xy} = r\,\dfrac{\sigma_x}{\sigma_y}$ and also passes through $(\bar{x}, \bar{y})$ .

Lines of Regression (point-slope form)

y - \bar{y} = b_{yx}(x - \bar{x}) \qquad x - \bar{x} = b_{xy}(y - \bar{y})

$b_{yx}$ slope of $y$ on $x$ line $= r\,\sigma_y/\sigma_x$
$b_{xy}$ slope of $x$ on $y$ line $= r\,\sigma_x/\sigma_y$
$(\bar{x},\bar{y})$ the only point on BOTH regression lines

Visualization · drag the line, watch the error

Left endpoint y: 1.0Right endpoint y: 11.0

SSE = 2.97Best possible: 0.27

Red dashes are residuals (vertical distance from each point to the line). SSE is the sum of their squares. The least-squares regression line is the one that makes SSE as small as possible.

Worked example

Find the regression line of

y

x

passing through the only two data points

(1, 1)

and

(5, 9)

With only two points, the regression line is the line joining them — correlation is perfect ( $r = \pm 1$ ).
Compute slope: $b_{yx} = \dfrac{9 - 1}{5 - 1} = \dfrac{8}{4} = 2$ .
Use point-slope through $(1, 1)$ : $y - 1 = 2(x - 1)$ .
Simplify: $y = 2x - 1$ .

Answer:

y = 2x - 1

or equivalently

2x - y - 1 = 0

Practice this conceptself-check · 4 quick reps

Try it yourself

Find the regression line of

y

x

passing through

(0, 1)

and

(4, 3)

Practice — Level 1 (4 reps)

Quick reps to lock in the method. Try each, then check.

1.
Both regression lines always pass through which point?
2.
Regression lines are $x = 2$ and $y = 3$ . Find $(\bar{x}, \bar{y})$ .
3.
$b_{yx} = r\,\sigma_y/\sigma_x$ . If $r = 1$ and $\sigma_y = \sigma_x = 2$ , slope?
4.
Slope of the $y$ -on- $x$ line through $(1,2)$ and $(3,6)$ ?

From the bank · past-year question

Example 2StatisticsEASY

A bivariate data set contains only two points

(-1,1)

and

(3,2)

. What will be the line of regression of

y

x

[Q109 · Apr · 2023]

Both regression lines always pass through $(\bar{x}, \bar{y})$

If a PYQ gives you two regression lines and asks for the means, solve the two equations simultaneously — their intersection is exactly

(\bar{x}, \bar{y})

. No need to compute anything from raw data.

From raw bivariate data, compute $b_{yx}$ via the Pearson form

When given

n

raw paired points (e.g. four

(x_i, y_i)

values), use the computational formula

b_{yx} = \dfrac{n\sum x_i y_i - \sum x_i \sum y_i}{n\sum x_i^2 - (\sum x_i)^2}

with

\bar{x}, \bar{y}

read straight from the column sums. The regression line is then

y - \bar{y} = b_{yx}(x - \bar{x})

. Faster than the deviation-from-mean form because it works directly off the column totals.

Drill 6 more on lines of regression

Concept 3 of 5

Regression Coefficients and Their Link to r

Intuition

The two regression slopes

b_{yx}

and

b_{xy}

carry the same information as

r

— their product equals

r^2

, and they share the same sign as

r

. This means once you know any two of

\{r, b_{yx}, b_{xy}\}

, the third is forced.

Definition

$b_{yx} \cdot b_{xy} = r^2$ , with $0 \leq r^2 \leq 1$ . Therefore $b_{yx} \cdot b_{xy} \leq 1$ always. Also $\text{sign}(b_{yx}) = \text{sign}(b_{xy}) = \text{sign}(r)$ — the two slopes can never have opposite signs.

Product Identity

b_{yx} \cdot b_{xy} = r^2, \qquad r = \pm\sqrt{b_{yx}\,b_{xy}}

Sign of $r$ same as the common sign of $b_{yx}$ and $b_{xy}$

Worked example

Two lines of regression are

3x - 5y + 10 = 0

and

5x - 3y - 6 = 0

. Find the correlation coefficient

r

between

x

and

y

Pairing A — first line as $y$ on $x$ : $y = \dfrac{3x + 10}{5}$ , so $b_{yx} = \dfrac{3}{5}$ . Second line as $x$ on $y$ : $x = \dfrac{3y + 6}{5}$ , so $b_{xy} = \dfrac{3}{5}$ .
Check the product: $b_{yx} \cdot b_{xy} = \dfrac{9}{25} = 0.36 \leq 1$ — valid.
Pairing B (the swap) would give both slopes $\dfrac{5}{3}$ , product $\dfrac{25}{9} > 1$ — impossible, so pairing A is correct.
Hence $r^2 = 0.36$ . Both slopes are positive, so $r = +\sqrt{0.36} = 0.6$ .

Answer:

r = 0.6

Practice this conceptself-check · 4 quick reps

Try it yourself

Given

b_{yx} = -1.2

and

b_{xy} = -0.3

, find

r

Practice — Level 1 (4 reps)

Quick reps to lock in the method. Try each, then check.

1.
$b_{yx} = 0.4$ , $b_{xy} = 0.9$ . Find $r^2$ .
2.
$b_{yx} = 0.4$ , $b_{xy} = 0.9$ . Find $r$ .
3.
$b_{yx} = -2$ , $b_{xy} = -0.5$ . Find $r$ .
4.
Can $b_{yx} = 2$ and $b_{xy} = 0.8$ hold for one dataset?

From the bank · past-year question

Example 3StatisticsHARD

Let two lines of regression be

x+y+11=0

and

2x+3y+4=0

for some data. What is the value of correlation coefficient between x and y?

[Q111 · Apr · 2026]

$b_{yx} \cdot b_{xy} \leq 1$ is non-negotiable

If your computed product exceeds 1, you have assigned the wrong line to

y

x

. Swap the assignment and recompute — the inequality

b_{yx} b_{xy} = r^2 \leq 1

picks the correct pairing every time.

Both slopes share the sign of $r$

You cannot have

b_{yx} > 0

and

b_{xy} < 0

— if a problem seems to suggest this, the lines have been labelled wrong.

Drill 6 more on regression coefficients and their link to r

Concept 4 of 5

Identifying Which Regression Line is Which

Intuition

When NDA gives you two equations and doesn't label them, you must figure out which is

y

x

and which is

x

y

. Use the inequality

b_{yx}\,b_{xy} \leq 1

as a sieve: there are only two possible pairings; one will satisfy the inequality, the other won't.

Definition

Two regression lines $L_1$ and $L_2$ can be paired in two ways. The correct pairing is the one for which the product of the slopes (interpreted as $b_{yx} \cdot b_{xy}$ ) is at most 1. The wrong pairing always gives a product greater than 1 (provided the lines are distinct).

Sieve Inequality

\text{Correct pairing satisfies } b_{yx}\,b_{xy} \leq 1; \text{ wrong pairing gives } > 1.

Diagram · which regression line is which

Both lines pass through the mean point (x̄, ȳ). The y-on-x line is the flatter one (it minimises vertical gaps); x-on-y is steeper. Their slopes are b_yx and 1/b_xy, with b_yx·b_xy = r².

Worked example

Two lines of regression are

2x - 3y + 1 = 0

and

4x - 5y + 3 = 0

. Identify which is

y

x

and find

b_{yx}

and

b_{xy}

Pairing A: first as $y$ on $x$ gives $y = \dfrac{2x+1}{3}$ , so $b_{yx} = \dfrac{2}{3}$ . Second as $x$ on $y$ gives $x = \dfrac{5y - 3}{4}$ , so $b_{xy} = \dfrac{5}{4}$ . Product = $\dfrac{5}{6} \leq 1$ — valid.
Pairing B (swap): first as $x$ on $y$ gives $b_{xy} = \dfrac{3}{2}$ ; second as $y$ on $x$ gives $b_{yx} = \dfrac{4}{5}$ . Product = $\dfrac{6}{5} > 1$ — rejected.
Conclusion: the first line is $y$ on $x$ ( $b_{yx} = 2/3$ ); the second is $x$ on $y$ ( $b_{xy} = 5/4$ ).

Answer:

b_{yx} = \dfrac{2}{3},\ b_{xy} = \dfrac{5}{4}

Practice this conceptself-check · 4 quick reps

Try it yourself

Two lines of regression are

x + 4y - 7 = 0

and

2x + 5y - 9 = 0

. Identify which is

y

x

and report both slopes.

Practice — Level 1 (4 reps)

Quick reps to lock in the method. Try each, then check.

1.
A pairing gives slope product $1.5$ . Valid $b_{yx}\cdot b_{xy}$ ?
2.
Pairing A product $0.8$ , pairing B product $1.25$ . Which is correct?
3.
The product of the two regression slopes equals?
4.
Why can the wrong pairing exceed $1$ ?

From the bank · past-year question

Example 4StatisticsHARD

Let

x-3y+4=0

and

2x-7y+8=0

be two lines of regression computed from some bivariate data. If

b_{yx}

and

b_{xy}

are regression coefficients of lines of regression of

y

x

and

x

y

respectively, then what is the value of

b_{xy}+7b_{yx}

[Q101 · Sep · 2024]

Try the inequality before doing anything else

Always compute both candidate pairings of

b_{yx} \cdot b_{xy}

. The pairing that satisfies the

\leq 1

condition is the correct one. Don't try to reason geometrically from the slopes — the inequality is mechanical and unambiguous.

Drill 4 more on identifying which regression line is which

Concept 5 of 5

Angle Between the Two Regression Lines

Intuition

The two regression lines coincide when correlation is perfect and stand perpendicular when there is no correlation. In between, they make an acute angle whose tangent you can read straight off the line equations using the ordinary "angle between two lines" formula from coordinate geometry — no need to compute

r

\sigma_x

\sigma_y

first.

Definition

Treat the two regression lines as ordinary straight lines in the $(x,y)$ plane with slopes $m_1$ and $m_2$ (read directly from each equation after solving for $y$ ). The acute angle $\theta$ between them satisfies the standard formula below. When $r = \pm 1$ the slopes coincide and $\tan\theta = 0$ ; when $r = 0$ , $1 + m_1 m_2 = 0$ and the lines are perpendicular.

Angle between two lines (applied to regression)

\tan\theta = \left|\dfrac{m_1 - m_2}{1 + m_1\,m_2}\right|

$m_1, m_2$ slopes of the two regression lines in the $(x,y)$ plane
$\theta$ acute angle between the lines

Diagram · angle between the regression lines

The lines meet at (x̄, ȳ) at angle θ, where tan θ = |(m₂ − m₁) / (1 + m₁m₂)|. As correlation strengthens (r → ±1) the two lines rotate together and θ → 0 — they coincide at perfect correlation. As r → 0 they splay apart, signalling no linear relationship.

Worked example

Two lines of regression are

x + 3y + 2 = 0

and

2x + 5y + 1 = 0

. Find the tangent of the acute angle between them.

Solve each line for $y$ . Line 1: $y = -\tfrac{1}{3}x - \tfrac{2}{3}$ , so $m_1 = -\tfrac{1}{3}$ .
Line 2: $y = -\tfrac{2}{5}x - \tfrac{1}{5}$ , so $m_2 = -\tfrac{2}{5}$ .
Apply the formula: $\tan\theta = \left|\dfrac{-1/3 - (-2/5)}{1 + (-1/3)(-2/5)}\right| = \left|\dfrac{1/15}{17/15}\right|$ .
Simplify: $\tan\theta = \dfrac{1}{17}$ .

Answer:

\tan\theta = \dfrac{1}{17}

Practice this conceptself-check · 4 quick reps

Try it yourself

Two regression lines have slopes

m_1 = \dfrac{1}{2}

and

m_2 = 3

. Find

\tan\theta

of the acute angle between them.

Practice — Level 1 (4 reps)

Quick reps to lock in the method. Try each, then check.

1.
If $r = \pm 1$ , the angle between the two regression lines?
2.
If $r = 0$ , the angle between the regression lines?
3.
Slopes $m_1 = 2$ , $m_2 = 3$ . Find $\tan\theta$ .
4.
Slopes $m_1 = 1$ , $m_2 = -1$ . The lines are?

From the bank · past-year question

Example 5StatisticsHARD

Let

x+2y+1=0

and

2x+3y+4=0

be two lines of regression computed from some bivariate data. If

\theta

is the acute angle between them, then what is the value of

488\tan 3\theta

[Q104 · Apr · 2024]

Slope of the $x$ -on- $y$ line is NOT $b_{xy}$ in the $(x,y)$ plane

The slope of the

y

-on-

x

line in the

(x,y)

plane is

b_{yx}

. But the slope of the

x

-on-

y

line (written

x = a + b_{xy} y

) in the

(x,y)

plane is

1/b_{xy}

, NOT

b_{xy}

. When reading slopes off the line equation directly (solve for

y

, take the coefficient of

x

), you sidestep this trap.

Acute angle only — take absolute value

A negative tangent would correspond to the obtuse supplement. The formula's absolute value guarantees

\theta \leq 90^\circ

. PYQs always ask the acute angle.

Drill 1 more on angle between the two regression lines

Summary — formulas & gotchas at a glance

A revision cheat-sheet for the formulas and gotchas above. Click any concept name to jump back to its full explanation.

Formulas (5)

Correlation Coefficient and Its Properties
Correlation Coefficient and Invariance Rule
$r = \dfrac{\text{Cov}(X,Y)}{\sigma_X\,\sigma_Y} \qquad r_{(aX+b,\,cY+d)} = \text{sign}(ac)\,r_{XY}$
Lines of Regression
Lines of Regression (point-slope form)
$y - \bar{y} = b_{yx}(x - \bar{x}) \qquad x - \bar{x} = b_{xy}(y - \bar{y})$
Regression Coefficients and Their Link to r
Product Identity
$b_{yx} \cdot b_{xy} = r^2, \qquad r = \pm\sqrt{b_{yx}\,b_{xy}}$
Identifying Which Regression Line is Which
Sieve Inequality
$\text{Correct pairing satisfies } b_{yx}\,b_{xy} \leq 1; \text{ wrong pairing gives } > 1.$
Angle Between the Two Regression Lines
Angle between two lines (applied to regression)
$\tan\theta = \left|\dfrac{m_1 - m_2}{1 + m_1\,m_2}\right|$

Watch out for (9)

$r$ is bounded by $-1$ and $+1$ — always
→ Correlation Coefficient and Its Properties
Shift does not change $r$ ; only scale-with-negative-sign flips it
→ Correlation Coefficient and Its Properties
Both regression lines always pass through $(\bar{x}, \bar{y})$
→ Lines of Regression
From raw bivariate data, compute $b_{yx}$ via the Pearson form
→ Lines of Regression
$b_{yx} \cdot b_{xy} \leq 1$ is non-negotiable
→ Regression Coefficients and Their Link to r
Both slopes share the sign of $r$
→ Regression Coefficients and Their Link to r
Try the inequality before doing anything else
→ Identifying Which Regression Line is Which
Slope of the $x$ -on- $y$ line is NOT $b_{xy}$ in the $(x,y)$ plane
→ Angle Between the Two Regression Lines
Acute angle only — take absolute value
→ Angle Between the Two Regression Lines

Mastery check — 5 interleaved questions

Try each one before clicking. Questions are interleaved across the concepts above, not grouped — interleaving sharpens transfer.

Example 1StatisticsEASY

The coefficient of correlation between ages of husband and wife at the time of marriage for a given set of 100 couples was noted to be 0.7. Assume that all these couples survive to celebrate the silver jubilee of their marriage. The coefficient of correlation at that point of time will be

[Q114 · Sep · 2022]

Example 2StatisticsMODERATE

Let X and Y represent prices (in

\bar{\text{\phantom{x}}}

) of a commodity in Kolkata and Mumbai respectively. It is given that

\bar{X}=65

\bar{Y}=67

\sigma_X=2\cdot5

\sigma_Y=3\cdot5

and

r(X,Y)=0\cdot8

. What is the equation of regression of Y on X?

[Q117 · Apr · 2020]

Example 3StatisticsMODERATE

Direction: Consider the following for the items that follow. Two regression lines are given as 3x - 4y + 8 = 0 and 4x - 3y - 1 = 0.

Consider the following statements: 1. The regression line of

y

x

y=\frac{3}{4}x+2

. 2. The regression line of

x

y

x=\frac{3}{4}y+\frac{1}{4}

. Which of the above statements is/are correct?

[Q106 · Sep · 2021]

Example 4StatisticsHARD

Let

x+2y+1=0

and

2x+3y+4=0

be two lines of regression computed from some bivariate data. If

\theta

is the acute angle between them, then what is the value of

488\tan 3\theta

[Q104 · Apr · 2024]

Example 5StatisticsHARD

Consider statements: 1. r=0 => regression lines parallel 2. r=+1 => regression lines perpendicular Which is/are correct?

[Q106 · Apr · 2018]

Drill every past-year question on this subtopic

27 questions from the bank — paginated, with cart and Word-export support.

Drill the 27 questions

Drill every past-year question on this subtopic

Related notes