FineWeb
ProductLarge, deduplicated, filtered English web dataset assembled for language-model pretraining.
- May 30, 2024
- —
- —
- Yes
- —
- 1
Releases
May 2024FineWeb dataset releasedProduct launch
Hugging Face released FineWeb, a 15-trillion-token filtered and deduplicated English web dataset for language-model pretraining.