infinity

Shannon Entropy Estimation in infinite alphabets

Shannon entropy estimation in countably infinite alphabets is addressed by adopting convergence results of the entropy functional and concentration inequalities.

Universal Weak Variable-Length Source Coding on Countably Infinite Alphabets

This work introduces the notion of almost lossless source coding for infinite alphabets information sources.

Almost Lossless Universal Source Coding over Envelope Families

This talks covers the analysis of worse-case redundancies in universal source coding in infinite alphabets.