QuantGap Packs

community
Activity Feed

AI & ML interests

None defined yet.

Recent Activity

Organization Card
quantgap-packs

Reference packs for measuring quantization drift.

GitHub Leaderboard

This organization hosts the reference packs used by quantgap to measure how far a quantized model has drifted from its original weights.

A pack contains the original model's responses and top next-token probabilities for a fixed probe set. It lets anyone score a quantized model without downloading or running the original model themselves.

Pack contents

  • Fixed probe texts
  • Reference tokenization metadata
  • Top-k probability data
  • Greedy-generation reference data
  • Pack manifests, hashes, and reproducibility information

Using a pack

Install quantgap and score a compatible quantized model:

pip install "quantgap[llamacpp]" \
  --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cpu

quantgap score hf://<publisher>/<model>-GGUF/<file>.gguf

models 0

None public yet