fusedyi-8bit / added_tokens.json
pharaouk's picture
Upload tokenizer
655903d verified
raw
history blame contribute delete
57 Bytes
{
"<|endoftext|>": 64001,
"<|startoftext|>": 64000
}