Hugging Face's logo
Kris Bailey's picture

Kris Bailey PRO

krisbailey
1
dipankarsarkar's profile picture dennisjack279's profile picture webxos's profile picture
·
https://www.krisbailey.com

AI & ML interests

quantization, optimization, novel model architectures, model architecture research and development, dataset construction, apple silicon optimizations

Recent Activity

posted an update 2 days ago
Created a docker image for optimized serving of Qwen3.8-Flash-Next on a single DGX Spark. Find it here: https://hub.docker.com/r/krisbailey/qwen3.8-flash-next-nvfp4-dgx-spark The fastest I got it was 114 tok/s using 8 concurrent calls at the same time, and a little over 30 tok/s for single stream generation. It uses my "shortlist mtp" modification that only allows mtp to use 16,000 tokens instead of the full dictionary, but that speeds things up even though it causes slightly lower draft acceptance percentages.
posted an update 4 days ago
Published an update to https://GrumpyDev.ai today. Lots of simplification to remove some cruft, and some site updates to make the wording more clear. If you do a lot of AI coding, you should check it out.
posted an update 20 days ago
Just posted an article about my adventures with Qwen3.8-Next-Flash running on a DGX Spark. Got up to 114 tok/s across 8 concurrent streams. https://huggingface.co/blog/krisbailey/shortlist-mtp-mostly-worked-around-a-bad-kernel-ch
View all activity

Organizations

None yet