Search Results for author: Adway Girish

Found 2 papers, 1 papers with code

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains

1 code implementation6 Feb 2024 Ashok Vardhan Makkuva, Marco Bondaschi, Adway Girish, Alliot Nagle, Martin Jaggi, Hyeji Kim, Michael Gastpar

Inspired by the Markovianity of natural languages, we model the data as a Markovian source and utilize this framework to systematically study the interplay between the data-distributional properties, the transformer architecture, the learnt distribution, and the final model performance.

ICQ: A Quantization Scheme for Best-Arm Identification Over Bit-Constrained Channels

no code implementations30 Apr 2023 Fathima Zarin Faizal, Adway Girish, Manjesh Kumar Hanawal, Nikhil Karamchandani

We study the problem of best-arm identification in a distributed variant of the multi-armed bandit setting, with a central learner and multiple agents.

Quantization

Cannot find the paper you are looking for? You can Submit a new open access paper.