From percentages to extra surprise

KL divergence,
one step at a time.

Start with two forecasts. Build the arithmetic. Then see the same mismatch rise above a 3D landscape.

Basic arithmetic is enough. Logarithms and entropy are introduced along the way. Four focused chapters; one small probability table.

Go to the 3D demonstration · Glossary & sources · Print edition

← Learn Blogs library