Training

Overfitting

Overfitting occurs when a model learns training-specific detail that does not generalize.

training stepslosstrainingvalidationstop here
Overfitting occurs when a model learns training-specific detail that does not generalize. Values shown in the worked visual are illustrative unless the labels state otherwise.

How it works

Training error can keep falling after validation error begins to rise. Regularization, more representative data, or earlier stopping can reduce the gap.

A concrete example

Illustrative: training loss falls from 0.30 to 0.08 while validation loss rises from 0.34 to 0.51.

Do not confuse it with Underfitting

overfitting has a large train-validation gap; underfitting performs poorly on both.

Study the full lesson