tokenizer: regenerate token_bytes.pt with upstream 2ce972a raw-bytes fix (191/32768 ids corrected)
47b3fec verified Download tokenizer/token_bytes.pt from ChrisMcCormick/decoderstack-d24: direct link, hf CLI and curl.
- Browser
- Download file 133 kB
-
https://huggingface.co/ChrisMcCormick/decoderstack-d24/resolve/main/tokenizer/token_bytes.pt
- Command line
-
hf download hf://ChrisMcCormick/decoderstack-d24/tokenizer/token_bytes.pt
-
curl -L -o token_bytes.pt https://huggingface.co/ChrisMcCormick/decoderstack-d24/resolve/main/tokenizer/token_bytes.pt
133 kB
- Xet hash:
- f7d2a11ff69b358a1e3c075cf5a51eac896375231843f747f0de21c27eb920f4
- Size of remote file:
- 133 kB
- SHA256:
- f419a4f1f454570158fc2678e2b5ef24a1a8e48710f76c3bb88ccbff27413d9e
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.