Pretraining Data
updated
opencsg/Fineweb-Edu-Chinese-V2.1
Viewer
• Updated • 958M • 26.8k
• 67
Preview
• Updated • 87.8k
• 33
Viewer
• Updated • 3.8B • 9.2k
• 112
allenai/dolma3_dolmino_pool
Updated • 6.96k
• 8
allenai/dolma3_longmino_pool
Updated • 2.96k
• 12
Viewer
• Updated • 476M • 38.6k
• 827
Viewer
• Updated • 4.48B • 52.4k
• 771
Viewer
• Updated • 61.6M • 9.12k
• 288
Viewer
• Updated • 819M • 3.51k
• 12
tokyotech-llm/swallow-code-v2
Viewer
• Updated • 147M • 7.44k
• 35
ByteDance-Seed/Code-Contests-Plus
Viewer
• Updated • 49.2k • 5.65k
• 60
Viewer
• Updated • 7.09M • 4.68k
• 174
nvidia/Nemotron-Pretraining-Code-v2
Viewer
• Updated • 836M • 8.11k
• 115
nvidia/Nemotron-Pretraining-Specialized-v1
Viewer
• Updated • 60.7M • 9.93k
• 75
nvidia/Nemotron-CC-Math-v1
Viewer
• Updated • 190M • 9.91k
• 74
nvidia/Nemotron-Pretraining-SFT-v1
Viewer
• Updated • 299M • 1.97k
• 63
Viewer
• Updated • 1.86M • 5.42k
• 234
EssentialAI/essential-web-v1.0
Preview
• Updated • 46.9k
• 219
EssentialAI/eai-taxonomy-stem-w-dclm
Preview
• Updated • 9.87k
• 6
EssentialAI/eai-taxonomy-med-w-dclm
Viewer
• Updated • 81.2M • 258
• 8
EssentialAI/eai-taxonomy-code-w-dclm
Viewer
• Updated • 274M • 232
• 9
EssentialAI/eai-taxonomy-math-w-fm
Viewer
• Updated • 21.6M • 5.97k
• 5
Viewer
• Updated • 27.9B • 76
• 3
DataMuncher-Labs/UltiMath
Viewer
• Updated • 32.9B • 3.91k
• 44
HuggingFaceFW/finetranslations
Viewer
• Updated • 3.33B • 35.3k
• 277
Viewer
• Updated • 69.9k • 176k
• 387
JetBrains-Research/commit-chronicle
Viewer
• Updated • 10.9M • 967
• 11
ASSERT-KTH/repairllama-datasets
Viewer
• Updated • 460k • 103
• 2
Updated • 17.8k
• 79
Viewer
• Updated • 778k • 30
Viewer
• Updated • 3.5M • 265
nick007x/github-code-2025
Viewer
• Updated • 147M • 4.18k
• 116
tokyotech-llm/swallow-code
Viewer
• Updated • 129M • 1.27k
• 63
loubnabnl/github-code-duplicate
Viewer
• Updated • 115M • 370
• 1
macrocosm-os/code-parrot-github-code
Viewer
• Updated • 115M • 954
• 13
nyuuzyou/google-code-archive
Viewer
• Updated • 65.8M • 1.22k
• 73
ad6398/Deepmind-CodeContest-Unrolled
Viewer
• Updated • 13.2M • 85
• 2
datablations/python-megatron
Updated • 9.13k
• 1
nomic-ai/cornstack-python-v1
Viewer
• Updated • 23.6M • 2.63k
• 21
Viewer
• Updated • 22.6M • 805
Viewer
• Updated • 552k • 184
utter-project/github-code-2025-above-2-stars
Viewer
• Updated • 103M • 372
• 3
tokyotech-llm/swallow-math-v2
Viewer
• Updated • 17.4M • 5.18k
• 29
Viewer
• Updated • 181M • 43.5k
• 265
Viewer
• Updated • 513k • 75
• 6
Updated • 132k
Preview
• Updated • 279k
• 90
CodedotAI/code_clippy_github
Viewer
• Updated • 2.4M • 12k
• 20
Lichess/standard-chess-games
Viewer
• Updated • 7.14B • 174k
• 66
jablonkagroup/chempile-mlift
Viewer
• Updated • 51.5M • 1.78k
• 14
Viewer
• Updated • 49.8M • 37
jablonkagroup/chempile-code
Viewer
• Updated • 2.27M • 303
• 5
jablonkagroup/chempile-paper
Viewer
• Updated • 11.7M • 305
• 6
jablonkagroup/chempile-education
Viewer
• Updated • 66.9k • 253
• 6
Viewer
• Updated • 164k • 17
• 2
institutional/institutional-books-1.0
Viewer
• Updated • 983k • 5.29k
• 270
Viewer
• Updated • 34.5k • 33
common-pile/youtube_filtered
Viewer
• Updated • 986k • 68
• 5
common-pile/ubuntu_irc_filtered
Viewer
• Updated • 216k • 27
• 1
common-pile/pubmed_filtered
Viewer
• Updated • 4.77M • 402
• 3
common-pile/github_archive_filtered
Viewer
• Updated • 23.3M • 273
• 1
common-pile/biodiversity_heritage_library_filtered
Viewer
• Updated • 16.5M • 193
• 1
common-pile/uspto_filtered
Viewer
• Updated • 14.4M • 746
• 3
common-pile/usgpo_filtered
Viewer
• Updated • 2.34M • 80
• 1
soda-research/emilia-mm-pretrain-fix
Viewer
• Updated • 12.6M • 4.68k
fineinstructions/fineinstructions_nemotron
Viewer
• Updated • 1.23B • 4.69k
• 5