Download python/nedotokenizer/__init__.py from Ethosoft/NedoTokenizer: direct link, hf CLI and curl.
- Browser
- Download file 256 Bytes
-
https://huggingface.co/Ethosoft/NedoTokenizer/resolve/main/python/nedotokenizer/__init__.py
- Command line
-
hf download hf://Ethosoft/NedoTokenizer/python/nedotokenizer/__init__.py
-
curl -L -o __init__.py https://huggingface.co/Ethosoft/NedoTokenizer/resolve/main/python/nedotokenizer/__init__.py
256 Bytes
| """Python API for the native NedoTokenizer engine.""" | |
| from ._native import NedoFormerTokenizer, SurfaceTokenizer, Tokenizer, asset_info | |
| __all__ = ["NedoFormerTokenizer", "SurfaceTokenizer", "Tokenizer", "asset_info", "__version__"] | |
| __version__ = "0.2.0" | |