Search Results for author:
Found 3 papers, 0 papers with code
Geometric Dynamics of Signal Propagation Predict Trainability of Transformers
Our update equations show that without MLP layers, this system will collapse to a line, consistent with prior work on rank collapse in transformers.
Flatter, faster: scaling momentum for optimal speedup of SGD
Commonly used optimization algorithms often show a trade-off between good generalization and fast training times.
Breast Cancer Diagnosis by Higher-Order Probabilistic Perceptrons
The present machine-learning approach to diagnosis (known as HOPP, for higher-order probabilistic perceptron) is tested on the much-studied, open-access Breast Cancer Wisconsin (Diagnosis) Data Set of Wolberg et al.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
