open-sci-ref-0.01 c4 - a open-sci Collection

open-sci 's Collections

open-sci-ref-0.01 HPLT-2.0

open-sci-ref-0.01 CommonCorpus

open-sci-ref-0.01 FineWeb-Edu-1.4T

open-sci-ref-0.01 Pile

open-sci-ref-0.01 SlimPajama

open-sci-ref-0.01 c4

open-sci-ref-0.01 dclm

open-sci-ref-0.01 nemotron-hq

open-sci-ref-0.01

open-sci-ref releases

OpenThoughts and OpenThinker

open-sci-ref-0.01 c4

updated Jul 23, 2025

open-sci/open-sci-ref-v0.01-0.13b-c4-300B-4096-warmup25000-lr0.006-2

0.1B • Updated Sep 26, 2025 • 79
open-sci/open-sci-ref-v0.01-0.4b-c4-300B-4096-warmup25000

0.4B • Updated Sep 26, 2025 • 54
open-sci/open-sci-ref-v0.01-0.4b-c4-300B-4096-warmup25000-lr0.004-2

0.4B • Updated Sep 26, 2025 • 74
open-sci/open-sci-ref-v0.01-0.13b-c4-300B-4096-warmup25000

0.1B • Updated Sep 26, 2025 • 11
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-2048-warmup25000

1B • Updated Sep 26, 2025 • 58
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-2048-warmup30000

1B • Updated Sep 26, 2025 • 37
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-2048-warmup30000-lr0.005-2

1B • Updated Sep 26, 2025 • 36
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-4096-warmup10000

1B • Updated Sep 26, 2025 • 42
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-4096-warmup20000

1B • Updated Sep 26, 2025 • 70
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-4096-warmup25000

2B • Updated Sep 26, 2025 • 11
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1000

1B • Updated Sep 26, 2025 • 22
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup10000

1B • Updated Sep 26, 2025 • 23
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup10000-lr0.003-2

1B • Updated Sep 26, 2025 • 22
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup10000-lr0.004-3

1B • Updated Sep 26, 2025 • 17
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1000-lr0.004-2

1B • Updated Sep 26, 2025 • 21
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1000-lr0.004-3

1B • Updated Sep 26, 2025 • 26
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1000-lr0.004-4

1B • Updated Sep 26, 2025 • 25
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1000-lr0.004-5

1B • Updated Sep 26, 2025 • 34
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1000-lr0.004-6

1B • Updated Sep 26, 2025 • 21
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1500

1B • Updated Sep 26, 2025 • 17
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup1500-lr0.005-2

1B • Updated Sep 26, 2025 • 22
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup2000

1B • Updated Sep 26, 2025 • 29
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-2048-warmup2000-lr0.006-2

1B • Updated Sep 26, 2025 • 18
open-sci/open-sci-ref-v0.01-1.3b-c4-50B-4096-warmup1000

Updated Sep 26, 2025 • 31
open-sci/open-sci-ref-v0.01-1.7b-c4-300B-4096-warmup25000

2B • Updated Sep 26, 2025 • 43
open-sci/open-sci-ref-v0.01-1.3b-c4-300B-2048-warmup20000

1B • Updated Sep 26, 2025 • 38