Search Results for author: Yermek Kapushev

Found 4 papers, 2 papers with code

Scaling Transformer to 1M tokens and beyond with RMT

3 code implementations19 Apr 2023 Aydar Bulatov, Yuri Kuratov, Yermek Kapushev, Mikhail S. Burtsev

A major limitation for the broader scope of problems solvable by transformers is the quadratic scaling of computational complexity with input size.

Language Modelling Natural Language Understanding +1

Denoising Score Matching with Random Fourier Features

no code implementations13 Jan 2021 Tsimboy Olga, Yermek Kapushev, Evgeny Burnaev, Ivan Oseledets

In this work we derive analytical expression for the Denoising Score matching using the Kernel Exponential Family as a model distribution.

Denoising Density Estimation

Tensor Completion via Gaussian Process Based Initialization

no code implementations11 Dec 2019 Yermek Kapushev, Ivan Oseledets, Evgeny Burnaev

In this paper, we consider the tensor completion problem representing the solution in the tensor train (TT) format.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.