Stochastic Optimization

GeneralOptimization • 62 methods

Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.

Subcategories

Method Year Papers
2014 16425
1951 1712
2018 552
2013 421
2019 174
2011 162
1999 141
2017 138
2016 134
2021 124
2020 86
2014 86
2017 66
2018 58
2019 47
2019 47
2016 41
2020 36
2018 35
2017 30
2021 27
1983 27
2019 23
2020 18
2019 16
2012 15
2000 13
2019 11
2000 10
2016 10
2019 10
2022 9
2021 8
2014 8
2017 6
2019 5
2021 4
2015 4
2018 3
2019 3
2021 2
2018 2
1991 2
2020 2
2022 2
2019 1
2019 1
2023 1
2022 1
2019 1
2019 1
2022 1
2021 1
2017 1
2019 1
2017 1
2018 1
2021 1
2021 1
2018 1
2000 0