Exploring Distance Measurement in Machine Learning

Introduction

Common Distance Metrics

Euclidean Distance

Manhattan Distance

Cosine Similarity

Kullback-Leibler (KL) Divergence

Jensen-Shannon (JSD) Divergence

Maximum Mean Discrepancy (MMD)

Geodesic Distance

Wasserstein Distance

Applications

Conclusion

References

Euclidean Distance

1. Euclid (c. 300 BCE). Elements. [Mathematical Foundation] The foundational work of Euclidean geometry that introduced the concept of distance in geometric space.