Entropy estimation and information theory form the bedrock of our understanding of uncertainty and complexity in both natural and engineered systems. At its core, entropy quantifies the ...

The identities or bounds that relate information measures (e.g., the entropy and mutual information) and estimation measures (e.g., the minimum means square error ...