Search Results for author: David A. Knowles

Found 17 papers, 7 papers with code

The VampPrior Mixture Model

1 code implementation6 Feb 2024 Andrew Stirn, David A. Knowles

Current clustering priors for deep latent variable models (DLVMs) require defining the number of clusters a-priori and are susceptible to poor initializations.

Clustering Image Clustering +2

System Identification for Continuous-time Linear Dynamical Systems

no code implementations23 Aug 2023 Peter Halmos, Jonathan Pillow, David A. Knowles

This paper addresses system identification for the continuous-discrete filter, with the aim of generalizing learning for the Kalman filter by relying on a solution to a continuous-time It\^o stochastic differential equation (SDE) for the latent state and covariance dynamics.

Vector Embeddings by Sequence Similarity and Context for Improved Compression, Similarity Search, Clustering, Organization, and Manipulation of cDNA Libraries

no code implementations8 Aug 2023 Daniel H. Um, David A. Knowles, Gail E. Kaiser

This paper demonstrates the utility of organized numerical representations of genes in research involving flat string gene formats (i. e., FASTA/FASTQ5).

Clustering

Faithful Heteroscedastic Regression with Neural Networks

1 code implementation18 Dec 2022 Andrew Stirn, Hans-Hermann Wessels, Megan Schertzer, Laura Pereira, Neville E. Sanjana, David A. Knowles

For a wide variety of network and task complexities, we find that mean estimates from existing heteroscedastic solutions can be significantly less accurate than those from an equivalently expressive mean-only model.

regression

Variational Variance: Simple, Reliable, Calibrated Heteroscedastic Noise Variance Parameterization

2 code implementations8 Jun 2020 Andrew Stirn, David A. Knowles

Brittle optimization has been observed to adversely impact model likelihoods for regression and VAEs when simultaneously fitting neural network mappings from a (random) variable onto the mean and variance of a dependent Gaussian variable.

regression

A New Distribution on the Simplex with Auto-Encoding Applications

1 code implementation NeurIPS 2019 Andrew Stirn, Tony Jebara, David A. Knowles

We construct a new distribution for the simplex using the Kumaraswamy distribution and an ordered stick-breaking process.

Stochastic gradient variational Bayes for gamma approximating distributions

1 code implementation4 Sep 2015 David A. Knowles

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations.

Variational Inference

An Empirical Study of Stochastic Variational Algorithms for the Beta Bernoulli Process

no code implementations26 Jun 2015 Amar Shah, David A. Knowles, Zoubin Ghahramani

Stochastic variational inference (SVI) is emerging as the most promising candidate for scaling inference in Bayesian probabilistic models to large datasets.

Topic Models Variational Inference

Beta diffusion trees and hierarchical feature allocations

no code implementations14 Aug 2014 Creighton Heaukulani, David A. Knowles, Zoubin Ghahramani

We define the beta diffusion tree, a random tree structure with a set of leaves that defines a collection of overlapping subsets of objects, known as a feature allocation.

The Supervised IBP: Neighbourhood Preserving Infinite Latent Feature Models

no code implementations26 Sep 2013 Novi Quadrianto, Viktoriia Sharmanska, David A. Knowles, Zoubin Ghahramani

We propose a probabilistic model to infer supervised latent variables in the Hamming space from observed data.

Retrieval

A nonparametric variable clustering model

no code implementations NeurIPS 2012 Konstantina Palla, Zoubin Ghahramani, David A. Knowles

Factor analysis models effectively summarise the covariance structure of high dimensional data, but the solutions are typically hard to interpret.

Clustering

Fixed-Form Variational Posterior Approximation through Stochastic Linear Regression

2 code implementations28 Jun 2012 Tim Salimans, David A. Knowles

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions.

regression

Non-conjugate Variational Message Passing for Multinomial and Binary Regression

no code implementations NeurIPS 2011 David A. Knowles, Tom Minka

Variational Message Passing (VMP) is an algorithmic implementation of the Variational Bayes (VB) method which applies only in the special case of conjugate exponential family models.

regression

Gaussian Process Regression Networks

1 code implementation19 Oct 2011 Andrew Gordon Wilson, David A. Knowles, Zoubin Ghahramani

We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes.

Gaussian Processes regression

Cannot find the paper you are looking for? You can Submit a new open access paper.