Mogrifier RLSTM (WT2)
DeepMindLanguage modeling
Developed by DeepMind in 2022, Mogrifier RLSTM (WT2) is a language modeling model with 35000000.0 parameters.
About Mogrifier RLSTM (WT2)
Just because some purely recurrent models suffer from being hard to optimize and inefficient on today's hardware, they are not necessarily bad models of language. We demonstrate this by the extent to which these models can still be improved by a comb
Details
- Provider
- DeepMind
- Task
- Language modeling
- Parameters
- 35000000.0
- Released
- 2022-11-03
- Open weights
- No