If
Labif
·
AI & ML interests
None yet
Recent Activity
reacted to SeaWolf-AI's post with 🔥 about 3 hours ago
No GPU. No cloud. Just your phone.
Most “small” models still beg for a datacenter. Ours fit in your pocket.
VIDRAFT POCKET is a family of GGUF models that run on an iPhone and on a GPU-free PC, straight out of the box with llama.cpp, Ollama, LM Studio, and PocketPal. Seven weeks after launch they crossed 1 million downloads. Today the family is past 2.81 million and still climbing, every day.
Three models, one pocket:
🟢 POCKET-35B — a 35B mixture-of-experts that runs on an iPhone and on a PC with no GPU. Balanced power.
→ https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF
🔵 POCKET-26B — a Gemma-4 based 26B MoE, tuned for on-device Korean. Lightweight and fast.
→ https://huggingface.co/FINAL-Bench/POCKET-26B-GGUF
🟣 POCKET-Darwin-180B — a 180B flagship running on a laptop in 4-bit GGUF. The datacenter, on your desk.
→ https://huggingface.co/FINAL-Bench/POCKET-Darwin-180B-GGUF
The whole family lives here: https://huggingface.co/FINAL-Bench
Try our models live in the browser: https://huggingface.co/spaces/FINAL-Bench/POCKET-Image-Studio
Private by default. Offline by design. Yours to run.
#OnDeviceAI #LocalLLM #llamacpp #GGUF #VIDRAFT #POCKET reacted to tardellirs's post with 🔥 about 3 hours ago
I really like the LocalLLaMA/typed-decisions benchmark, so I built a small Space to make its leaderboard easier to explore: https://huggingface.co/spaces/tardellirs/typed-decisions-explorer
It reads the dataset card on every visit, so new submissions show up as soon as they are merged. It has a sortable ranking and two Pareto charts: accuracy × size and accuracy × latency.
A few things it makes easy to see in the zero-shot table today:
- Only three models are within noise of the top: Quyet-1.0-Large (0.791), meraGPT Decider 1 and Baseten Mammoth 1 (0.768).
- The smallest model above Jev 1.13 (0.727) is d3-mini, at 4B.
- The fastest local run above Jev is FastBrain-9B: 50 ms on an RTX PRO 6000.
- 15 of 41 models score above the teacher's self-agreement (0.735), so the top of the table measures agreement with the teacher more than correctness.
Congrats to @codelion and @sandeep85, the maintainers, for a great benchmark. Feedback welcome! liked a model about 3 hours ago
perplexity-ai/pplx-embed-v2-context-0.6bOrganizations
None yet