Information theory

• Entropy
• MDL
• Distances
  • Hamming
  • KL divergence
  • Jensen-Shannon Divergence
  • Earth Mover's distance