allenai/OLMoE-mix-0924
Text GenerationENodc-by
Allenai/OLMoE-mix-0924 is a text generation dataset in EN from allenai in Parquet format. It is distributed under the odc-by license and falls in the 1B<n<10B size category, and has been downloaded 2.3K times.
About allenai/OLMoE-mix-0924
OLMoE Mix (September 2024)
The following data mix was used to train OLMoE-1B-7B, a Mixture-of-Experts LLM with 1B active and 7B total parameters released in September 2024.
The base version of OLMoE-1B-7B can be found at this page, the SFT o...
Details
- Task
- Text Generation
- Language
- EN
- Format
- Parquet
- Rows / instances
- N/A
- Size
- 1B<n<10B
- Creator
- allenai
- Year
- 2024
- License
- odc-by
- Downloads
- 2265
- Likes
- 55