Paperlane

no. 11 · Monday 9 November 2026

Orders between channels and implications for partial information decomposition

André F. C. Gomes and Mário A. T. Figueiredo

math.IT · v4 · 13 pp

Abstract

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique. Classical information theory alone does not provide a unique way to decompose information in this manner and additional assumptions have to be made. Recently, Kolchinsky proposed a new general axiomatic approach to obtain measures of redundant information, based on choosing a preorder relation between information sources (equivalently, a preorder between communication channels). In this paper, we exploit this approach to introduce three new measures of redundant information (and the resulting decompositions) based on well-known preorders between channels, thus contributing to the enrichment of the PID landscape. We relate the new decompositions to existing ones, study some of their properties, and provide examples illustrating their novelty. As a side result, we prove that any preorder that satisfies Kolchinsky's axioms yields a decomposition that meets the axioms originally introduced by Williams and Beer when they first propose the PID.

comments
Corrected version of the article published in Entropy 2023, 25, 975 (https://doi.org/10.3390/e25070975). The corrections are described in a correction notice in Entropy. 13 pages, 1 figure, 4 tables
journal
Entropy 2023, 25(7), 975
fields
Information Theory
pdf ↗ page arXiv:2305.06021 ↗