Critical Hyper-Parameters: No Random, No Cry
The selection of hyper-parameters is critical in Deep Learning. Because of the long training time of complex models and the availability of compute resources in the cloud, "one-shot" optimization schemes - where the sets of hyper-parameters are selected in advance (e.g. on a grid or in a random manner) and the training is executed in parallel - are commonly used... (read more)
PDFTasks
Datasets
Penn Treebank
Results from the Paper
Submit
results from this paper
to get state-of-the-art GitHub badges and help the
community compare results to other papers.
Random Search
Sigmoid Activation
Tanh Activation
LSTM