1 code implementation • 7 Aug 2023 • Sophia J. Abraham, Kehelwala D. G. Maduranga, Jeffery Kinnison, Zachariah Carmichael, Jonathan D. Hauenstein, Walter J. Scheirer
Traditional methods, like grid search and Bayesian optimization, often struggle to quickly adapt and efficiently search the loss landscape.
1 code implementation • 9 Nov 2018 • Kehelwala D. G. Maduranga, Kyle E. Helfrich, Qiang Ye
Recently, there have been several different RNN architectures that try to mitigate this issue by maintaining an orthogonal or unitary recurrent weight matrix.