German ELECTRA Large
deepsetBayerische Staatsbibliothek MuenchenDocument classificationNamed entity recognition (NER)Text classificationOpen weights
Developed by deepset,Bayerische Staatsbibliothek Muenchen in 2020, German ELECTRA Large is a document classification model with 335000000.0 parameters with openly available weights.
About German ELECTRA Large
In this work we present the experiments which lead to the creation of our BERT and ELECTRA based German language models, GBERT and GELECTRA. By varying the input training data, model size, and the presence of Whole Word Masking (WWM) we were able to
Details
- Provider
- deepset,Bayerische Staatsbibliothek Muenchen
- Task
- Document classification,Named entity recognition (NER),Text classification
- Parameters
- 335000000.0
- Released
- 2020-10-21
- Open weights
- Yes