YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Inkling2 tiny checkpoint (integration tests)
- decoder: 12 layers = attn-res blocks 0 and 7 of the original 48 (layers 0-5, 42-47), full attention at layers [5, 11]; experts nvfp4 on layers 0-5, mxfp8 on layers 6-11
- text: hidden 256, heads 4/2 (head_dim 128), 16 experts top-4, expert intermediate 256, sliding window 128, relative extent 256
- vision: hidden 128, 2 layers, 2 heads, projector 256
- vocab, tokenizer and image processor unchanged; MTP draft dropped
- 148.2M parameters, 251 MB
- Downloads last month
- 63
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support