← Catalogue
🔬 Science  🧠 Freddy

Jensen–Shannon Divergence

— A symmetric and finite method for measuring the similarity between two probability distributions.

Jensen–Shannon Divergence
Released
1991
Era
1991
Mathematical Basis
Information theory and probability
Key Properties
Symmetric and always finite
Relationship
Derived from the Kullback–Leibler divergence
Introduced
1991 (by Jianhua Lin)
Range of Values
Between 0 and 1 (when using log base 2)
Primary Applications
Machine learning, bioinformatics, natural language processing
About this item

The Jensen–Shannon divergence (JSD) is a method for quantifying the similarity between two or more probability distributions. Unlike the Kullback–Leibler (KL) divergence, upon which it is based, JSD possesses two crucial properties: it is symmetric, meaning the divergence from A to B is the same as from B to A, and it always yields a finite value. These characteristics make it a more robust and widely applicable measure in various computational fields. It finds extensive use in machine learning for comparing model outputs, in bioinformatics for analyzing genetic sequences, and in natural language processing for text analysis, providing a stable metric for assessing distributional differences.

information theoryprobabilitystatisticsmachine learningbioinformaticsdata sciencemathematics
Connected items
Explore further
🏪
Collector
Find this at a show or convention near you
💬
Opinions
See what people think — coming soon
📷
Scan with KronosVision
Point your camera at yours to verify it
★ This is a neutral encyclopaedia entry. No prices, no buy buttons, no affiliate links. Facts only.