Bookmarks

these compression algorithms could halve our image file sizes (but we don't use them) #SoMEpi

An educational deep-dive into the source coding theorem, entropy, arithmetic coding, and asymmetric numeral systems, illustrating how these information-theoretic ideas can dramatically reduce image file sizes.

The Man Who Should Be As Famous As Einstein

The Key Equation Behind Probability

The Invention That Saved Science

Information Theory for Language Models: Jack Morris

The Most Useful Curve in Mathematics [Logarithms]

Entropy is not what you think!

Clarifies entropy as a measure of information—not disorder—linking thermodynamic and Shannon definitions via microstate counting.

A Short Introduction to Entropy, Cross-Entropy and KL-Divergence

Richard Hamming - Wikipedia

Information Theory: A Tutorial Introduction

Data Compression Explained

A Mathematical Theory of Communication

Anonymity and the internet

Human Knowledge Compression Contest

Re: [Fis] A PROPOSAL ABOUT THE DEFINITION OF INFORMATION

Information

Temperature as Joules per Bit

Landauer's principle

Bremermann's limit

Bekenstein bound

Temperature as Joules per Bit

ThermodynamicComputing

Probability and InformationTheory

Subcategories