Image-to-Video
Diffusers
MLX
i2v
character-animation
video-generation
cross-identity-replacement
pose-driven
diffusion
apple-silicon
Instructions to use SceneWorks/scail2-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SceneWorks/scail2-mlx with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SceneWorks/scail2-mlx", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - MLX
How to use SceneWorks/scail2-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download SceneWorks/scail2-mlx --local-dir scail2-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Add q4/q8/bf16 quant-matrix tier subdirs (sc-9944, epic 8506)
Verified signaturece88cfd
-
sc-5445: ship lean pre-quantized Q4 snapshot (Q4 DiT 32.8->8.9GB + quantization manifest; prune redundant raw pickles; refresh card)
Verified signature35d6df7
-
sc-5445: converted umt5-xxl encoder (bf16) for Umt5Encoder
Verified signatureee74975 -
sc-5445: converted open-CLIP ViT-H/14 visual tower (f32) for ScailClip
Verified signature0a971f0 -
sc-5445: converted Wan2.1 z16 VAE (f32) for WanVae
Verified signatureb51406b -
sc-5445: root umt5 tokenizer.json for Umt5Encoder
Verified signature1256566 -
sc-5445: turnkey MLX model card (converted vae/t5/clip safetensors)
Verified signaturee19a025 -
Add umt5-xxl/special_tokens_map.json
Verified signaturef147ef2 -
Add umt5-xxl/tokenizer_config.json
Verified signature3758715 -
Add umt5-xxl/tokenizer.json
Verified signature7fa6878 -
Add umt5-xxl/spiece.model
Verified signaturef0dc131 -
Add umt5-xxl/models_t5_umt5-xxl-enc-bf16.pth
Verified signature314d360 -
Add bias-aware-dpo-lora.pt
Verified signature3f737c9 -
Add models_clip_open-clip-xlm-roberta-large-vit-huge-14-onlyvisual.pth
Verified signature54c624e -
Add Wan2.1_VAE.pth
Verified signatureafb7dc7 -
Add dit.safetensors
Verified signature92316ef -
Add config
Verified signature225e5fb -
Add model card
Verified signature1930fbd -
initial commit
Verified signature1897f4b