Hugging Face's logo

ThingAI
/
QuarkTokenizer

English
Italian
tokenizer
bpe
bilingual
italian
english
quark
Model card Files
xet
 Community
QuarkTokenizer / tokenizer.json

Commit History

  1. Quark BPE tokenizer EN+IT 65536 vocab v1

    ThingsAI
    Verified signature
    9fb41e6