|
Download README.md from bigscience/tokenizer: direct link, hf CLI and curl.
- Browser
- Download file 306 Bytes
-
https://huggingface.co/bigscience/tokenizer/resolve/main/README.md
- Command line
-
hf download hf://bigscience/tokenizer/README.md
-
curl -L -o README.md https://huggingface.co/bigscience/tokenizer/resolve/main/README.md
306 Bytes
metadata
license: bigscience-bloom-rail-1.0
Tokenizer used for all BLOOM models
Tokenizer information are provided at https://huggingface.co/bigscience/bloom#preprocessing
TODO: point to paper once it comes out with extra details on the tokenizer