... MMMee++2p… 1 2pq 1 1pqM 1 1+Me2 1 pqM2 1 +Me 21 MMe+…22 1 pqM +2 21 pqMM + 1 211 Mqqqp +++= 211 12 MMMqqp++++= 1 p 1 e 1 , ,, 21 Meee 1 1pq2e 1 Me… 211 , , 1 MMMee++2p… 1 2pq 1 1pqM 1 1+Me2 1 pqM2 1 +Me 21 MMe+…22 1 pqM ... Buks Thermodynamics and Statistical Physics 5 1. 1. Entropy in Information Theory 1 p 1 e 1 , ,, 21 Meee 1 1pq2e 1 Me… 211 , , 1 MMMee++2p… 1 2pq 1 1pqM 1 1+Me2 1 pqM2 1 +Me 21 MMe+…22 1 pqM ... − (1 − p)log (1 p) . (1. 3)Chapter 1. The Principle o f Largest Un certainty 1 p 1 1 p− 1 e32,ee 1 2 1 pp− 1 3 1 pp−2e3e 1 p 1 1 p− 1 e32,ee 1 2 1 pp− 1 3 1 pp−2e3eFig. 1. 1....