The Solutions to Ax = b

One, None, or Infinite?

In our last lesson, we celebrated the power of Gaussian Elimination. We saw it as a perfect machine that takes a complex system and hands us a single, unique solution. That was a wonderful, clean example—a world where every problem has one perfect answer.

Today, we step into the real world.

The true genius of Gaussian Elimination is not just that it finds answers, but that it is a powerful diagnostic tool. It tells us the nature of our system. It reveals whether our problem has that one perfect answer, or if it's a problem with no answer at all, or a problem with an entire family of answers.

There are only three possibilities for any system Ax=bAx=b. Let’s become detectives and learn to identify the clues for each one.

The Clues: Pivots and Contradictions

The entire story is told by the pivots—the first non-zero entry in each row after you've reached row echelon form. Everything hinges on two questions:

  1. Do we encounter a mathematical contradiction during elimination?
  2. After elimination, does every variable's column have a pivot, or are some "free"?
Case 1: No Solution — "The Contradiction"
This is the case where the equations are fundamentally at odds with each other. They describe a geometric situation that is impossible.
[112301110001]\left[\begin{array}{ccc|c} 1 & 1 & 2 & 3 \\ 0 & 1 & 1 & 1 \\ \mathbf{0} & \mathbf{0} & \mathbf{0} & \mathbf{-1} \end{array}\right]

Geometric Meaning: The three planes defined by the equations never meet at a single point. In the column picture, the target vector bb is not in the span of the columns of `A`.

Case 2: Infinite Solutions — "The Free Variable"
This happens when there are no contradictions, but some equations are redundant, giving us freedom.
[121401110000]\left[\begin{array}{ccc|c} \mathbf{1} & -2 & 1 & 4 \\ 0 & \mathbf{1} & 1 & -1 \\ 0 & 0 & 0 & 0 \end{array}\right]

The last row, `0=0`, is true but useless. The column for `z` does not have a pivot. This makes `z` a free variable.

The General Solution is a Line:

[xyz]=[210]+t[311]\begin{bmatrix} x \\ y \\ z \end{bmatrix} = \begin{bmatrix} 2 \\ -1 \\ 0 \end{bmatrix} + t \begin{bmatrix} -3 \\ -1 \\ 1 \end{bmatrix}

Geometric Meaning: The three planes intersect along a single line. In the column picture, the columns of `A` are linearly dependent, and there are infinite ways to combine them to create `b`.

Case 3: A Unique Solution
This is the clean case we saw in the last lesson.
[2115082120012]\left[\begin{array}{ccc|c} \mathbf{2} & 1 & 1 & 5 \\ 0 & \mathbf{-8} & -2 & -12 \\ 0 & 0 & \mathbf{1} & 2 \end{array}\right]

Geometric Meaning: The planes intersect at a single point. In the column picture, the columns of `A` are linearly independent and `b` is in their span.

Up Next: LU Decomposition