Adaptive Inputs + LayerDrop
Facebook AI ResearchLORIALanguage modeling/generationTranslationQuestion answeringText summarizationLanguage modelingOpen weights
The Adaptive Inputs + LayerDrop model is an open-weights language modeling/generation model from Facebook AI Research,LORIA with 423000000.00000006 parameters.
About Adaptive Inputs + LayerDrop
Overparameterized transformer networks have obtained state of the art results in various natural language processing tasks, such as machine translation, language modeling, and question answering. These models contain hundreds of millions of parameter
Details
- Provider
- Facebook AI Research,LORIA
- Task
- Language modeling/generation,Translation,Question answering,Text summarization,Language modeling
- Parameters
- 423000000.00000006
- Released
- 2019-09-25
- Open weights
- Yes