Home / Visualizations / Entropy / KL Divergence

Entropy / KL Divergence

Interactive teaching demo for entropy, cross-entropy, and KL divergence with real-time parameter control.

Controls

Distribution Type Log Base

e 2

Sample Size

2000

Distribution Comparison

Entropy Heatmap

KL Divergence Surface

Current Metrics

H(P)-

H(Q)-

H(P,Q)-

D_KL(P||Q)-

D_KL(Q||P)-

Monte Carlo Estimation