Several trained models to compare the differences between each method. Each model has a complete description of hyperparams with wandb reports.
G
G-reen
AI & ML interests
Currently working on https://github.com/Green0-0/propagate (ES Trainer for LLMs). Also interested in TPU training, and building better synthetic datasets.
Recent Activity
updated
a model about 1 month ago
G-reen/gemma-2-2b-it-fft-simpo-tpu published
a model about 1 month ago
G-reen/gemma-2-2b-simpo-orbax published
a model about 2 months ago
G-reen/gemma-2-2b-it-fft-simpo-tpu Organizations
None yet
models 22
G-reen/gemma-2-2b-it-fft-simpo-tpu
Updated
• 1
G-reen/gemma-2-2b-simpo-orbax
Updated
G-reen/gemma-2-2b-it-fft-3epoch-simpo-adj-cpo100
Text Generation • 3B • Updated
• 6
G-reen/gemma-2-2b-it-fft-3epoch-simpo-adj
Text Generation • 3B • Updated
• 7
G-reen/gemma-2-2b-it-fft-3epoch-simpo
Text Generation • 3B • Updated
• 6
G-reen/gemma-2-2b-it-fft-3epoch
Text Generation • 3B • Updated
• 5
G-reen/gemma-2-2b-fft-orbax
Updated
G-reen/gemma-2-2b-it-fft-lowlr
Text Generation • 3B • Updated
• 2
G-reen/gemma-2-2b-it-fft-simpo-adj
Text Generation • 3B • Updated
• 3
G-reen/gemma-2-2b-it-fft-simpo-unsloth
Text Generation • 3B • Updated
• 1
datasets 27
G-reen/instruct-set-longer-fixed
Viewer
• Updated
• 110k • 254
G-reen/instruct-set-longer
Viewer
• Updated
• 140k • 153
G-reen/instruct-set
Viewer
• Updated
• 139k • 224
G-reen/instruct-set-half
Viewer
• Updated
• 95.1k • 362
G-reen/visualizertest
Viewer
• Updated
• 1k • 2
G-reen/medium_set
Viewer
• Updated
• 138k • 111
G-reen/sumthink_broken_format
Viewer
• Updated
• 24.7k • 6
G-reen/sumthink_responses_summarized
Viewer
• Updated
• 24.7k • 9
G-reen/sumthink_responses_raw
Viewer
• Updated
• 27k • 6
G-reen/sumthink_fixed_cleaned
Viewer
• Updated
• 24.7k • 6