localLLMrig

localllmrig's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in AtomicChat/Ripple-65B-Preview-GGUF 9 days ago

Memory needed per quant at 32K (file sizes + KV estimate)

👍 1

#2 opened 9 days ago by

localllmrig

New activity in Jackrong/Qwopus3.8-27B-Coder-Flash-GGUF 9 days ago

Memory needed per quant at 32K (file sizes + KV estimate)

#3 opened 9 days ago by

localllmrig

New activity in unsloth/Qwen3.8-27B-GGUF 10 days ago

Extendable to 1000000, it says on the card.

4

#138 opened 11 days ago by

BigDeeper

New activity in moonshotai/Kimi-K3.1-Pro 10 days ago

Great release! Please make also small ones. like 27B/A3B or 9B or something like that

➕ 17

8

#4 opened 11 days ago by

ZeroWw

New activity in MiniMaxAI/MiniMax-M2.5 10 days ago

Can someone bitnet this

1

#69 opened 12 days ago by

Swiftpaw

New activity in Hansda/Mage-VL-Cowork-GGUF 10 days ago

Memory needed per quant (file sizes + KV cache estimate)

#2 opened 10 days ago by

localllmrig

New activity in Diffuspace/Clover-35B-A3B-Preview-GGUF 11 days ago

Memory needed per quant (file sizes + KV cache estimate)

#2 opened 11 days ago by

localllmrig

New activity in AtomicChat/SenseNova-Loop-9B-Preview-GGUF 11 days ago

Memory needed per quant (file sizes + looped KV cache estimate)

#2 opened 11 days ago by

localllmrig

New activity in unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF 12 days ago

Memory needed per quant at 8K context (file sizes + KV estimate)

👍👀 3

5

#2 opened 22 days ago by

localllmrig

New activity in unsloth/MiniMax-M3.1-Flash-GGUF 12 days ago

Memory needed vs common local setups (UD-Q4_K_XL 249.4 GB)

4

#2 opened 23 days ago by

localllmrig

New activity in LiquidAI/LFM3-Omni-2B-GGUF 12 days ago

Memory fit per quant (GGUF + mmproj + KV at 32K/128K)

👍 1

1

#4 opened 12 days ago by

localllmrig

New activity in ccore/Qwen3.5-4B-3D-Coder 17 days ago

Fit table: Q4_K_M vs Q8_0 at the recommended ~72K context

❤️ 3

#8 opened 17 days ago by

localllmrig

New activity in kaitchup/Qwen3.8-27B-SLQ-GGUF 18 days ago

Memory needed per file on 24/32 GB cards (file sizes + KV estimate)

#3 opened 18 days ago by

localllmrig

New activity in LiquidAI/LFM3-1.7B-GGUF 18 days ago

Memory needed per quant at 32K and 256K context (file sizes + KV estimate)

#3 opened 18 days ago by

localllmrig

New activity in XHToken/Spark-X2.6-4B-GGUF 18 days ago

Memory needed per quant (file sizes + KV cache at 32K / 128K / 1M)

👍 3

#6 opened 18 days ago by

localllmrig

New activity in KRAFTON/Raon-1-mini-preview-gguf 19 days ago

Memory needed per quant (file sizes + KV cache estimate)

❤️ 2

#2 opened 19 days ago by

localllmrig

New activity in unsloth/Ornith-1.5-122B-GGUF 19 days ago

Quantization request: ~66 GB coding/tool-use recipe for 3x RTX 3090

2

#8 opened 19 days ago by

groxaxo

New activity in bartowski/Nanbeige_Nanbeige4.3-33B-GGUF 19 days ago

VRAM / Mac fit table by quant (8K context)

#1 opened 19 days ago by

localllmrig

New activity in basecompute/Qwen3.8-27B-BaseQuant-V1 21 days ago

Memory needed for Small / Medium / Large at 8K context

🔥 1

2

#1 opened 22 days ago by

localllmrig

New activity in RecursiveSI/flint 21 days ago

Memory needed per quant (file sizes + KV cache estimate)

4

#8 opened 24 days ago by

localllmrig