YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Inkling2 tiny checkpoint (integration tests)

  • decoder: 12 layers = attn-res blocks 0 and 7 of the original 48 (layers 0-5, 42-47), full attention at layers [5, 11]; experts nvfp4 on layers 0-5, mxfp8 on layers 6-11
  • text: hidden 256, heads 4/2 (head_dim 128), 16 experts top-4, expert intermediate 256, sliding window 128, relative extent 256
  • vision: hidden 128, 2 layers, 2 heads, projector 256
  • vocab, tokenizer and image processor unchanged; MTP draft dropped
  • 148.2M parameters, 251 MB
Downloads last month
63
Safetensors
Model size
0.1B params
Tensor type
F32
路
BF16
路
F8_E4M3
路
U8
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support