Search Results for author: Tycho F. A. van der Ouderaa

Found 7 papers, 4 papers with code

The LLM Surgeon

1 code implementation28 Dec 2023 Tycho F. A. van der Ouderaa, Markus Nagel, Mart van Baalen, Yuki M. Asano, Tijmen Blankevoort

Experimentally, our method can prune rows and columns from a range of OPT models and Llamav2-7B by 20%-30%, with a negligible loss in performance, and achieve state-of-the-art results in unstructured and semi-structured pruning of large language models.

Stochastic Marginal Likelihood Gradients using Neural Tangent Kernels

1 code implementation6 Jun 2023 Alexander Immer, Tycho F. A. van der Ouderaa, Mark van der Wilk, Gunnar Rätsch, Bernhard Schölkopf

Recent works show that Bayesian model selection with Laplace approximations can allow to optimize such hyperparameters just like standard neural network parameters using gradients and on the training data.

Hyperparameter Optimization Model Selection

Relaxing Equivariance Constraints with Non-stationary Continuous Filters

no code implementations14 Apr 2022 Tycho F. A. van der Ouderaa, David W. Romero, Mark van der Wilk

Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example.

Image Classification

Learning Invariant Weights in Neural Networks

no code implementations25 Feb 2022 Tycho F. A. van der Ouderaa, Mark van der Wilk

Assumptions about invariances or symmetries in data can significantly increase the predictive power of statistical models.

Gaussian Processes Translation

Invariance Learning in Deep Neural Networks with Differentiable Laplace Approximations

1 code implementation22 Feb 2022 Alexander Immer, Tycho F. A. van der Ouderaa, Gunnar Rätsch, Vincent Fortuin, Mark van der Wilk

We develop a convenient gradient-based method for selecting the data augmentation without validation data during training of a deep neural network.

Data Augmentation Gaussian Processes +1

Reversible GANs for Memory-efficient Image-to-Image Translation

3 code implementations CVPR 2019 Tycho F. A. van der Ouderaa, Daniel E. Worrall

The Pix2pix and CycleGAN losses have vastly improved the qualitative and quantitative visual quality of results in image-to-image translation tasks.

Image-to-Image Translation Translation

Cannot find the paper you are looking for? You can Submit a new open access paper.