Power Law and Entropy.

Sachio Hirokawa,Eisuke Ito

Power Law and Entropy.

2015

Sachio Hirokawa
Eisuke Ito

Shannon(1951) and Yavuz(1974) estimated the entropy of real documents. This note drives an upper bound of entropy from the parameter of the power law.

Keywords:

Calculus
Rényi entropy
Entropy in thermodynamics and information theory
Min entropy
Joint quantum entropy
Mathematics
Entropy (arrow of time)
Maximum entropy thermodynamics
Entropy power inequality
Shannon's source coding theorem
Discrete mathematics
Statistical physics
Maximum entropy probability distribution

Correction
Source
Cite
Save
Machine Reading By IdeaReader

References

Citations