allenai
/

OLMoE-1B-7B-0125-Instruct-GGUF

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0125-Instruct

Downloads last month: 912

GGUF

Model size

7B params

Architecture

olmoe

Hardware compatibility

Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for allenai/OLMoE-1B-7B-0125-Instruct-GGUF

Quantizations

Collection including allenai/OLMoE-1B-7B-0125-Instruct-GGUF

OLMoE (January 2025)

Improved OLMoE for iOS app. Read more: https://allenai.org/blog/olmoe-app • 10 items • Updated Dec 23, 2025 • 16