deqing/vanilla-llama-3.2-1B-fineweb-sample-100BT-v4
Updated • 42
Deqing Fu PRO
deqing
AI & ML interests
None yet
Recent Activity
updated a model about 7 hours ago
deqing/fone-llama-3.2-1B-fineweb-sample-100BT-fone3d-hybrid-tile-v4 updated a model about 7 hours ago
deqing/vanilla-llama-3.2-1B-fineweb-sample-100BT-v4 updated a collection about 15 hours ago
Convergent Evolution (Architecture and Optimizer)Organizations
deqing/vanilla-llama-3.2-1B-fineweb-sample-100BT-v4-old
Updated • 8
deqing/fone-llama-3.2-1B-fineweb-sample-100BT-fone3d-hybrid-tile-v4
Updated • 1.44k • 1
deqing/convergent-llama-300M-muon-isolate-8
Text Generation • 0.3B • Updated • 2.18k • 1
deqing/convergent-llama-300M-muon-isolate-2
Text Generation • 0.3B • Updated • 1.23k
deqing/convergent-llama-300M-muon-window-2
Text Generation • 0.3B • Updated • 7.53k
deqing/convergent-llama-300M-muon-window-64
Text Generation • 0.3B • Updated • 1.21k • 1
deqing/convergent-llama-300M-muon-isolate-1
Text Generation • 0.3B • Updated • 7.26k
deqing/convergent-llama-300M-muon-window-8
Text Generation • 0.3B • Updated • 3.76k
deqing/convergent-llama-300M-muon-window-4
Text Generation • 0.3B • Updated • 8.52k
deqing/convergent-llama-300M-adamw-addition_3digit_seed123
Text Generation • 0.3B • Updated • 705
deqing/convergent-llama-300M-muon-addition_3digit_seed123
0.3B • Updated • 328
deqing/llama-150M-unigram-perturbation-window_8
Updated
deqing/llama-150M-unigram-perturbation-isolate
Updated
deqing/llama-300M-v5-swap_numbers
Text Generation • 0.3B • Updated • 7.05k
deqing/llama-300M-v5-unigram
Text Generation • 0.3B • Updated • 3.55k
deqing/convergent-llama-300M-adamw-addition_3digit
Text Generation • 0.3B • Updated • 877
deqing/convergent-llama-300M-adamw-addition
Text Generation • 0.3B • Updated • 865
deqing/convergent-llama-300M-muon-addition_3digit
Text Generation • 0.3B • Updated • 1.04k
deqing/convergent-llama-300M-muon-addition
Text Generation • 0.3B • Updated • 2.01k
deqing/convergent-llama-300M-adamw-original
Text Generation • 0.3B • Updated • 536
deqing/convergent-llama-300M-muon-original
Text Generation • 0.3B • Updated • 789
deqing/gdn-300M-v5-gdn
Text Generation • 0.3B • Updated • 4.06k
deqing/convergent-gdn-300M-adamw-original
Text Generation • 0.3B • Updated • 385
deqing/convergent-lstm-4layer-muon-original
Text Generation • 0.2B • Updated • 430
deqing/convergent-lstm-12layer-muon-original
Text Generation • 0.2B • Updated • 383
deqing/convergent-gdn-300M-muon-original
Text Generation • 0.3B • Updated • 375
deqing/convergent-mamba2-300M-adamw-original
Text Generation • 0.3B • Updated • 488
deqing/convergent-llama-300M-adamw-window_8
Text Generation • 0.3B • Updated • 356
deqing/convergent-llama-300M-adamw-window_4
Text Generation • 0.3B • Updated • 336