HuggingFaceFW/ablation-exp-textext-warc_trafilatura-28BT
Text Generation
β’
2B
β’
Updated
β’
1
β’
1
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line-350BT
Text Generation
β’
2B
β’
Updated
HuggingFaceFW/ablation-exp-dedup-ind_mh-global_3line-350BT
Text Generation
β’
2B
β’
Updated
HuggingFaceFW/ablation-exp-fw-base_filt-ind_mh-c4_filters-350BT
Text Generation
β’
2B
β’
Updated
β’
1
HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line_minwords-350BT
Text Generation
β’
2B
β’
Updated
β’
1
HuggingFaceFW/ablation-exp-dedup-independent_minhash-350BT
Text Generation
β’
2B
β’
Updated
HuggingFaceFW/ablation-exp-fw-base_filtering-350BT
Text Generation
β’
2B
β’
Updated
β’
1
HuggingFaceFW/ablation-exp-dedup-global_minhash-350BT
Text Generation
β’
2B
β’
Updated
β’
1
HuggingFaceFW/ablation-model-redpajama2
Text Generation
β’
2B
β’
Updated
β’
4
HuggingFaceFW/ablation-model-the-pile
Text Generation
β’
2B
β’
Updated
β’
441
β’
1
HuggingFaceFW/ablation-model-slimpajama
Text Generation
β’
2B
β’
Updated
β’
2
HuggingFaceFW/ablation-model-dolma-v1_6
Text Generation
β’
2B
β’
Updated
β’
4
β’
2
HuggingFaceFW/ablation-model-c4
Text Generation
β’
2B
β’
Updated
β’
2
β’
4
HuggingFaceFW/ablation-model-refinedweb
Text Generation
β’
2B
β’
Updated
β’
4
β’
3
HuggingFaceFW/ablation-model-fineweb-v1
Text Generation
β’
2B
β’
Updated
β’
44
β’
14