Minimizing and Maximizing the Shannon Entropy for Fixed Marginals
accepted for publication
- The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distri- bution is the variable part under fixed marginals. We aim to minimize and maximize it to obtain the largest and smallest MI possible in this case, leading to a scaled MI ratio for better comparability. We present algorithmic approaches and optimal solutions for a set of problem instances based on data from molecular evolution. We show that this allows us to construct a sensible, systematic correction to raw MI values.
| Author: | Paula FrankeORCiD, Kay Hamacher, Paul Manns |
|---|---|
| Document Type: | In Proceedings |
| Parent Title (English): | Operations Research Proceedings 2025 |
| Year of first publication: | 2026 |

