Search Results for author: Honghua Zhang

Found 7 papers, 4 papers with code

Polynomial Semantics of Tractable Probabilistic Circuits

no code implementations14 Feb 2024 Oliver Broadrick, Honghua Zhang, Guy Van Den Broeck

Probabilistic circuits compute multilinear polynomials that represent multivariate probability distributions.

Tractable Control for Autoregressive Language Generation

1 code implementation15 Apr 2023 Honghua Zhang, Meihua Dang, Nanyun Peng, Guy Van Den Broeck

To overcome this challenge, we propose to use tractable probabilistic models (TPMs) to impose lexical constraints in autoregressive text generation models, which we refer to as GeLaTo (Generating Language with Tractable Constraints).

Text Generation

Mixtures of All Trees

1 code implementation27 Feb 2023 Nikil Roashan Selvam, Honghua Zhang, Guy Van Den Broeck

We show that it is possible to parameterize this Mixture of All Trees (MoAT) model compactly (using a polynomial-size representation) in a way that allows for tractable likelihood computation and optimization via stochastic gradient descent.

Density Estimation

Scaling Up Probabilistic Circuits by Latent Variable Distillation

no code implementations10 Oct 2022 Anji Liu, Honghua Zhang, Guy Van Den Broeck

We propose to overcome such bottleneck by latent variable distillation: we leverage the less tractable but more expressive deep generative models to provide extra supervision over the latent variables of PCs.

Language Modelling

Probabilistic Generating Circuits

1 code implementation19 Feb 2021 Honghua Zhang, Brendan Juba, Guy Van Den Broeck

Generating functions, which are widely used in combinatorics and probability theory, encode function values into the coefficients of a polynomial.

Density Estimation Point Processes

On the Relationship Between Probabilistic Circuits and Determinantal Point Processes

no code implementations26 Jun 2020 Honghua Zhang, Steven Holtzen, Guy Van Den Broeck

Central to this effort is the development of tractable probabilistic models (TPMs): models whose structure guarantees efficient probabilistic inference algorithms.

Point Processes

Cannot find the paper you are looking for? You can Submit a new open access paper.