Search Results for author: Dezhou Shen

Found 3 papers, 0 papers with code

FoundationLayerNorm: Scaling BERT and GPT to 1,000 Layers

no code implementations9 Apr 2022 Dezhou Shen

The mainstream BERT/GPT model contains only 10 to 20 layers, and there is little literature to discuss the training of deep BERT/GPT.

FPM: A Collection of Large-scale Foundation Pre-trained Language Models

no code implementations9 Nov 2021 Dezhou Shen

Large-scale Transformer models have significantly promoted the recent development of natural language processing applications.

Decoder Language Modelling

Movie Box office Prediction via Joint Actor Representations and Social Media Sentiment

no code implementations24 Jun 2020 Dezhou Shen

In recent years, driven by the Asian film industry, such as China and India, the global box office has maintained a steady growth trend.

Binary Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.