Search Results for author: Riddhiman Bhattacharya

Found 2 papers, 1 papers with code

Gradient-based Discrete Sampling with Automatic Cyclical Scheduling

1 code implementation27 Feb 2024 Patrick Pynadath, Riddhiman Bhattacharya, Arun Hariharan, Ruqi Zhang

Discrete distributions, particularly in high-dimensional deep models, are often highly multimodal due to inherent discontinuities.

Scheduling

Non-Asymptotic Analysis of Online Multiplicative Stochastic Gradient Descent

no code implementations14 Dec 2021 Riddhiman Bhattacharya, Tiefeng Jiang

Past research has indicated that the covariance of the Stochastic Gradient Descent (SGD) error done via minibatching plays a critical role in determining its regularization and escape from low potential points.

Cannot find the paper you are looking for? You can Submit a new open access paper.