exea-labs
/

ExeaLM

research-preview

Model card Files Files and versions

2.54 GB

Ctrl+K

Ctrl+K

1 contributor

History: 11 commits

AvnehBhatia's picture

Model card: load a checkpoint in one line with exealm.from_pretrained; terminal demo

b494981 verified about 14 hours ago

checkpoints
Overnight runs of 2026-11-12: the 18M model with gated attention and QK-norm (1.393 against 1.419), with the circuit search (1.431), the 0.1B model at step 3,000, the 8,000-step wide fine-tune, and their result files 2 days ago
results
Overnight runs of 2026-11-12: the 18M model with gated attention and QK-norm (1.393 against 1.419), with the circuit search (1.431), the 0.1B model at step 3,000, the 8,000-step wide fine-tune, and their result files 2 days ago
tokenizer
Model card: 0.1B hybrid design and small-scale results; add the 32k tokenizer 4 days ago
.gitattributes

1.52 kB
initial commit 5 days ago
README.md

8.65 kB
Model card: load a checkpoint in one line with exealm.from_pretrained; terminal demo about 14 hours ago