MoE models for local inference on two 5060ti 16gb cards + 64 gb ram workstation
-
unsloth/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 35B • Updated • 1.47M • 1.77k -
huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated-MTP-GGUF
Image-Text-to-Text • 36B • Updated • 3.42M • 73 -
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF
Image-Text-to-Text • 177B • Updated • 7.12M • 1.17k -
openbmb/MiniCPM-V-4.7-35B-A3B-gguf
Image-Text-to-Text • 35B • Updated • 372k • 459