Instructions to use dwidlee/systemone-lite-0.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use dwidlee/systemone-lite-0.5b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="dwidlee/systemone-lite-0.5b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("dwidlee/systemone-lite-0.5b")
model = AutoModelForCausalLM.from_pretrained("dwidlee/systemone-lite-0.5b", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use dwidlee/systemone-lite-0.5b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "dwidlee/systemone-lite-0.5b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dwidlee/systemone-lite-0.5b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/dwidlee/systemone-lite-0.5b

SGLang

How to use dwidlee/systemone-lite-0.5b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "dwidlee/systemone-lite-0.5b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dwidlee/systemone-lite-0.5b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "dwidlee/systemone-lite-0.5b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dwidlee/systemone-lite-0.5b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use dwidlee/systemone-lite-0.5b with Docker Model Runner:
```
docker model run hf.co/dwidlee/systemone-lite-0.5b
```

systemone-lite-0.5b

Current published weights for systemone-lite: a local System One–compatible decision model on Qwen/Qwen2.5-0.5B-Instruct.

Not affiliated with TypeSafe AI or Jev.


Base	`Qwen/Qwen2.5-0.5B-Instruct`
Train data	`dwidlee/systemone-lite-phase2` (240 800 / 4 700; 0% train∩test)
Serving	option-restricted next-token scoring (closed criteria / yes–no / score)

This repo is the stable name. New training runs overwrite these weights — do not expect a new Hub repo per experiment.

Use

pip install -e ".[dev]"   # from the systemone-lite repo
systemone-lite --model dwidlee/systemone-lite-0.5b --port 8000

from systemone_lite import SystemOneClient, choice, noul, score

client = SystemOneClient(model="dwidlee/systemone-lite-0.5b")
response = client.system_one(
    state="My card was charged twice.",
    questions={
        "needs_review": noul("Does this need a human agent?"),
        "route": choice(
            "Route to a team",
            {"billing": "charges", "technical": "bugs", "other": None},
        ),
        "urgency": score("Urgency", ["low", "medium", "high"]),
    },
)
print(response.answers["route"].choice)

Performance (local)


JevBench-style public set (231 tasks, T=1.0)	49.8% acc · ECE 0.307 · p50 12.6 ms
Short payloads	~10–30 ms typical (RTX 3060, in-process)

Not an official JevBench leaderboard submission. Random baseline on this set is ~32% (many 4–5-way items), not 50%.

Reports in the GitHub repo: benchmarks/jevbench_spatial_v2_s1.json, benchmarks/latency_vs_ar.json.

Limits

0.5B — demos / local experiments, not a production decision service.
Calibration is mediocre — do not trust probabilities as calibrated confidence.
Not Jev — different weights, scoring path, and confidence formula.
Closed-option scoring — ranks given symbols (usually one vocab id each); JSON option keys are mapped after scoring.
Use dataset test for held-out eval — never score on train.

Model tree for dwidlee/systemone-lite-0.5b

Base model

Qwen/Qwen2.5-0.5B

Finetuned

Qwen/Qwen2.5-0.5B-Instruct

Finetuned

(1049)

this model

dwidlee
/

systemone-lite-0.5b

systemone-lite-0.5b

Use

Performance (local)

Limits

Links

Model tree for dwidlee/systemone-lite-0.5b

Datasets used to train dwidlee/systemone-lite-0.5b