TREET: TRansfer Entropy Estimation via Transformer

1 code implementation • 10 Feb 2024 • Omer Luxembourg, Dor Tsur, Haim Permuter

Afterwards, we take advantage of the joint optimization scheme to optimize the capacity of communication channels with memory, which is a canonical optimization problem in information theory, and show the memory capabilities of our estimator.

LEMMA

Data-Driven Optimization of Directed Information over Discrete Alphabets

1 code implementation • 2 Jan 2023 • Dor Tsur, Ziv Aharoni, Ziv Goldfeld, Haim Permuter

Directed information (DI) is a fundamental measure for the study and analysis of sequential stochastic models.

Capacity of Continuous Channels with Memory via Directed Information Neural Estimator

1 code implementation • 9 Mar 2020 • Ziv Aharoni, Dor Tsur, Ziv Goldfeld, Haim Henry Permuter

When no analytic solution is present or the channel model is unknown, there is no unified framework for calculating or even approximating capacity.

Capacity Estimation