Konstantin PRO

apsys

whitecircle

·

AI & ML interests

Interpretable ML, classical ML, LLM & inference opts

Recent Activity

reacted to medmekk's post with 🚀 5 days ago

🚀 Introducing Halo 1.0 Today, we are open-sourcing Halo, the training framework we use to train every model at White Circle. It comes with: 🧠 Full post-training stack: SFT, DPO/KTO/SMPO, reward modeling, GRPO, distillation 🤖 Async multi-turn RL with vLLM/SGLang rollouts and sandboxed tool use ⚡ ~2.8× TRL throughput on 8× B300 (EP+FSDPv2, FA4, fp8/fp4) 🤗 Dense HF models + 15 MoE families (Qwen, GLM, Mistral, DeepSeek-V4…) 🛠️ One halo command, prebuilt Docker images, and docs for humans and agents 💻 https://github.com/whitecircle/halo Try it and tell us what you're training

liked a model 10 days ago

whitecircle/GLM-4.7-Flash-Coder

posted an update 17 days ago

43% less answer time in a looped transformer by changing answer supervision check out https://x.com/advprop/status/2098087083470373010?s=20 + full writeup linked there

View all activity

Organizations

apsys 's datasets 3

apsys/hop_dat

Viewer • Updated Aug 12, 2023 • 74.4k • 17

apsys/vc-pitches

Viewer • Updated Jul 2, 2023 • 94 • 24 • 2

apsys/WCS

Viewer • Updated May 15, 2023 • 91 • 8