3️⃣
Shannon’s Source Coding Theorem:
Entropy H(X) is the absolute lower bound for lossless compression.
No algorithm can compress a source, on average, below H(X) bits/symbol.
ZIP, PNG, Huffman, Arithmetic coding — all chase this limit.
#Compression
1
7








