Search Results for author: Deniz Oktay

Found 8 papers, 1 papers with code

Neuromechanical Autoencoders: Learning to Couple Elastic and Neural Network Nonlinearity

no code implementations31 Jan 2023 Deniz Oktay, Mehran Mirramezani, Eder Medina, Ryan P. Adams

In this work, we seek to develop machine learning analogs of this process, in which we jointly learn the morphology of complex nonlinear elastic solids along with a deep neural network to control it.

Meta-PDE: Learning to Solve PDEs Quickly Without a Mesh

no code implementations3 Nov 2022 Tian Qin, Alex Beatson, Deniz Oktay, Nick McGreivy, Ryan P. Adams

Partial differential equations (PDEs) are often computationally challenging to solve, and in many settings many related PDEs must be be solved either at every timestep or for a variety of candidate boundary conditions, parameters, or geometric domains.

Meta-Learning

Randomized Automatic Differentiation

1 code implementation ICLR 2021 Deniz Oktay, Nick McGreivy, Joshua Aduol, Alex Beatson, Ryan P. Adams

The successes of deep learning, variational inference, and many other fields have been aided by specialized implementations of reverse-mode automatic differentiation (AD) to compute gradients of mega-dimensional objectives.

Stochastic Optimization Variational Inference

On Predictive Information in RNNs

no code implementations21 Oct 2019 Zhe Dong, Deniz Oktay, Ben Poole, Alexander A. Alemi

Certain biological neurons demonstrate a remarkable capability to optimally compress the history of sensory inputs while being maximally informative about the future.

Information Plane

On Predictive Information Sub-optimality of RNNs

no code implementations25 Sep 2019 Zhe Dong, Deniz Oktay, Ben Poole, Alexander A. Alemi

Certain biological neurons demonstrate a remarkable capability to optimally compress the history of sensory inputs while being maximally informative about the future.

Information Plane

Scalable Model Compression by Entropy Penalized Reparameterization

no code implementations ICLR 2020 Deniz Oktay, Johannes Ballé, Saurabh Singh, Abhinav Shrivastava

We describe a simple and general neural network weight compression approach, in which the network parameters (weights and biases) are represented in a "latent" space, amounting to a reparameterization.

General Classification Model Compression

Counterfactual Image Networks

no code implementations ICLR 2018 Deniz Oktay, Carl Vondrick, Antonio Torralba

However, when a layer is removed, the model learns to produce a different image that still looks natural to an adversary, which is possible by removing objects.

counterfactual Object +2

Predicting Motivations of Actions by Leveraging Text

no code implementations CVPR 2016 Carl Vondrick, Deniz Oktay, Hamed Pirsiavash, Antonio Torralba

In this paper, we introduce the problem of predicting why a person has performed an action in images.

Cannot find the paper you are looking for? You can Submit a new open access paper.