i come in peace
akirathegreatest
·
AI & ML interests
None yet
Recent Activity
reacted to danielhanchen's post with ❤️ 12 days ago
You can now train your own Decision model like Jev locally!
We increased Qwen3.5 0.8B’s aggregate accuracy from 20.7% to 74.3% across 3 decision benchmarks - on just 4GB VRAM.
Turn any LLM like Qwen3.8, Gemma 4 into decision models with our open-source Unsloth repo.
GitHub: https://github.com/unslothai/unsloth
Guide: https://unsloth.ai/docs/basics/train-your-own-decision-model-with-unsloth reacted to raincandy-u's post with 🔥 15 days ago
20K parameters can tell a story. 🚀
🤗 We trained a ~20k-parameter Transformer that can actually write stories!
https://huggingface.co/raincandy-u/MacroStories
→ ~50× smaller than the 1M-parameter TinyStories model
→ ~3,000× smaller than AlexNet
→ 81 KB in FP32
yayyy the whole model. ૮ ˶ᵔ ᵕ ᵔ˶ ა
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block — recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100–300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU — no GPU required. The entire model is tiny enough to load almost instantly! ☺️ reacted to SeaWolf-AI's post with 👍 19 days ago
💻 Data-center AI, now on a laptop: POCKET-Darwin-180B
We're releasing a 4-bit GGUF build of Darwin-180B-RSI, #1 on seven official Hugging Face leaderboards (self-reported), that runs without a GPU.
📦 360 GB → 111 GB (4-bit GGUF, 4 files)
🖥️ No GPU: one server CPU (16 threads) at 18.4–21.0 tokens/s
💻 RTX 5060 laptop (8 GB VRAM) + 32 GB RAM: 4.17 tokens/s
🧊 128 GB mini PC: whole model in memory, no GPU needed
🎯 MMLU-Pro, 2,000 questions, paired: original 87.65% = 4-bit 87.65%
How?
· Only ~3B of 180B parameters are active per token (10 of 512 experts)
· llama.cpp streams just the needed experts from SSD, so 32 GB RAM is enough
· Graft quantization: we took the proven Unsloth UD-Q4_K_XL base build and swapped in only the 300 tensors our RSI training changed (300/300 verified)
Under the hood is Model-level Recursive Self-Improvement. The model solves verifiable problems, keeps only its own solutions that check out as correct, and trains on them. No human-written solutions or reasoning traces.
Built for teams that can't send data to an external cloud (defense, finance, public sector) to run a top-tier model fully offline.
📝 Article: https://huggingface.co/blog/FINAL-Bench/data-center-ai-now-on-a-laptop-pocket-darwin-180b
🤗 Model: https://huggingface.co/FINAL-Bench/POCKET-Darwin-180B-GGUF
🧬 Original: https://huggingface.co/FINAL-Bench/Darwin-180B-RSI
#Darwin #RSI #GGUF #llamacpp #OnDevice #MoEOrganizations
None yet