Books from the Survivor Library (mostly ~1920s & earlier) OCR'd with recent VLMs
BEEspoke Data
community
AI & ML interests
'an LLM is only as good as the dataset it was trained on' - Sun Tzu
Recent Activity
View all activity
smol_llama 220M fine-tunes we did
-
BEE-spoke-data/smol_llama-220M-openhermes
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 119 ā¢ 5 -
BEE-spoke-data/smol_llama-220M-open_instruct
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 27 ā¢ 2 -
BEE-spoke-data/beecoder-220M-python
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 42 ā¢ 3 -
BEE-spoke-data/zephyr-220m-sft-full
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 123 ā¢ 1
models fine-tuned to be knowledgeable about apiary practice
-
BEE-spoke-data/TinyLlama-3T-1.1bee
Text Generation ā¢ 1B ā¢ Updated ā¢ 9 ā¢ 2 -
BEE-spoke-data/TinyLlama-1.1bee
Text Generation ā¢ 1B ā¢ Updated ā¢ 15 ā¢ ā¢ 1 -
BEE-spoke-data/Meta-Llama-3-8Bee
Text Generation ā¢ 8B ā¢ Updated ā¢ 24 ā¢ -
BEE-spoke-data/phi-1bee5
Text Generation ā¢ 1B ā¢ Updated ā¢ 6 ā¢ 1
trained and adapted tokenizers - various
š§"raw" pretrained smol_llama checkpoints - WIP š§
-
BEE-spoke-data/smol_llama-101M-GQA
Text Generation ā¢ 0.1B ā¢ Updated ā¢ 1.03k ā¢ 33 -
BEE-spoke-data/smol_llama-81M-tied
Text Generation ā¢ 81.3M ā¢ Updated ā¢ 103 ā¢ 10 -
BEE-spoke-data/smol_llama-220M-GQA
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 552 ā¢ 13 -
BEE-spoke-data/verysmol_llama-v11-KIx2
Text Generation ā¢ 58.1M ā¢ Updated ā¢ 122 ā¢ 4
Pretrained encoder (fill-mask) models we made
text classification models for book genres
-
BEE-spoke-data/albert-xxlarge-v2-description2genre
Text Classification ā¢ 0.2B ā¢ Updated ā¢ 3 ā¢ 2 -
BEE-spoke-data/mobilebert-uncased-title2genre
Text Classification ā¢ 24.6M ā¢ Updated ā¢ 7 ā¢ 1 -
BEE-spoke-data/roberta-large-title2genre
Text Classification ā¢ 0.4B ā¢ Updated ā¢ 5 ā¢ 1 -
BEE-spoke-data/roberta-base-description2genre
Text Classification ā¢ 0.1B ā¢ Updated ā¢ 3
concept datasets extracted from fineweb
Books from the Survivor Library (mostly ~1920s & earlier) OCR'd with recent VLMs
š§"raw" pretrained smol_llama checkpoints - WIP š§
-
BEE-spoke-data/smol_llama-101M-GQA
Text Generation ā¢ 0.1B ā¢ Updated ā¢ 1.03k ā¢ 33 -
BEE-spoke-data/smol_llama-81M-tied
Text Generation ā¢ 81.3M ā¢ Updated ā¢ 103 ā¢ 10 -
BEE-spoke-data/smol_llama-220M-GQA
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 552 ā¢ 13 -
BEE-spoke-data/verysmol_llama-v11-KIx2
Text Generation ā¢ 58.1M ā¢ Updated ā¢ 122 ā¢ 4
smol_llama 220M fine-tunes we did
-
BEE-spoke-data/smol_llama-220M-openhermes
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 119 ā¢ 5 -
BEE-spoke-data/smol_llama-220M-open_instruct
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 27 ā¢ 2 -
BEE-spoke-data/beecoder-220M-python
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 42 ā¢ 3 -
BEE-spoke-data/zephyr-220m-sft-full
Text Generation ā¢ 0.2B ā¢ Updated ā¢ 123 ā¢ 1
Pretrained encoder (fill-mask) models we made
models fine-tuned to be knowledgeable about apiary practice
-
BEE-spoke-data/TinyLlama-3T-1.1bee
Text Generation ā¢ 1B ā¢ Updated ā¢ 9 ā¢ 2 -
BEE-spoke-data/TinyLlama-1.1bee
Text Generation ā¢ 1B ā¢ Updated ā¢ 15 ā¢ ā¢ 1 -
BEE-spoke-data/Meta-Llama-3-8Bee
Text Generation ā¢ 8B ā¢ Updated ā¢ 24 ā¢ -
BEE-spoke-data/phi-1bee5
Text Generation ā¢ 1B ā¢ Updated ā¢ 6 ā¢ 1
text classification models for book genres
-
BEE-spoke-data/albert-xxlarge-v2-description2genre
Text Classification ā¢ 0.2B ā¢ Updated ā¢ 3 ā¢ 2 -
BEE-spoke-data/mobilebert-uncased-title2genre
Text Classification ā¢ 24.6M ā¢ Updated ā¢ 7 ā¢ 1 -
BEE-spoke-data/roberta-large-title2genre
Text Classification ā¢ 0.4B ā¢ Updated ā¢ 5 ā¢ 1 -
BEE-spoke-data/roberta-base-description2genre
Text Classification ā¢ 0.1B ā¢ Updated ā¢ 3
trained and adapted tokenizers - various
concept datasets extracted from fineweb