Meta-Task-14B

Qwen3-14B fine-tuned on 3,221 trajectories synthesized by the Meta-Task framework, for solving terminal tasks.

This model accompanies the paper "Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training" (arXiv:2607.27929). Official code: https://github.com/goodmanpzh/meta-task

Results

Terminal-Bench 2.0, Terminus-2 scaffold, non-thinking mode: 22.5 % Avg Pass@1 (base Qwen3-14B: 5.2 %).

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "saulpzh/Meta-Task-14B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="bfloat16", device_map="auto")

Training

LoRA SFT with the SWIFT framework (rank/alpha 64/128, dropout 0.05, lr 1e-4, cosine schedule, 5 epochs, sequence length 40,960, BF16, 8ร—A100 80GB with DeepSpeed ZeRO-3). Training data: saulpzh/Meta-Task-Data.

Links

License

Apache-2.0.

Downloads last month
422
Safetensors
Model size
15B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for saulpzh/Meta-Task-14B

Finetuned
Qwen/Qwen3-14B
Finetuned
(385)
this model

Paper for saulpzh/Meta-Task-14B