Text-to-Image
MiniMax H3
Diffusers
Safetensors
English
image-to-image
image-editing
image-generation
Instructions to use MiniMaxAI/MiniMax-H3-Image with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MiniMaxAI/MiniMax-H3-Image with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3-Image", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update vllm-omni deployment guide
#1
by Isotr0py - opened
README.md
CHANGED
|
@@ -13,6 +13,8 @@ tags:
|
|
| 13 |
- image-generation
|
| 14 |
- minimax-h3
|
| 15 |
- diffusers
|
|
|
|
|
|
|
| 16 |
---
|
| 17 |
|
| 18 |
<div align="center">
|
|
@@ -152,9 +154,29 @@ hf download MiniMaxAI/MiniMax-H3-Image-PE
|
|
| 152 |
We recommend the following inference frameworks to serve the model:
|
| 153 |
|
| 154 |
- [SGLang](https://docs.sglang.io/) - see [cookbook](https://docs.sglang.io/cookbook/diffusion/MiniMax/MiniMax-H3-image)
|
| 155 |
-
- [vLLM](https://github.com/vllm-project/vllm) - see [vllm
|
| 156 |
-
- [diffusers](https://github.com/huggingface/diffusers) - see [diffusers docs]()
|
| 157 |
-
- [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - see [Comfy tutorial](); use [T2I template]() / [Edit template]()
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 158 |
|
| 159 |
#### SGLang Deployment
|
| 160 |
|
|
@@ -343,4 +365,4 @@ Text-to-image and image editing results, shown downscaled.
|
|
| 343 |
|
| 344 |
## Contact Us
|
| 345 |
|
| 346 |
-
Contact us at [model@minimax.io](mailto:model@minimax.io).
|
|
|
|
| 13 |
- image-generation
|
| 14 |
- minimax-h3
|
| 15 |
- diffusers
|
| 16 |
+
base_model:
|
| 17 |
+
- MiniMaxAI/MiniMax-H3
|
| 18 |
---
|
| 19 |
|
| 20 |
<div align="center">
|
|
|
|
| 154 |
We recommend the following inference frameworks to serve the model:
|
| 155 |
|
| 156 |
- [SGLang](https://docs.sglang.io/) - see [cookbook](https://docs.sglang.io/cookbook/diffusion/MiniMax/MiniMax-H3-image)
|
| 157 |
+
- [vLLM-Omni](https://github.com/vllm-project/vllm-omni) - see [vllm-omni recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image)
|
| 158 |
+
- [diffusers](https://github.com/huggingface/diffusers) - see [diffusers docs](https://huggingface.co/docs/diffusers/main/en/api/pipelines/minimax_h3_image)
|
| 159 |
+
- [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - see [Comfy tutorial](https://docs.comfy.org/tutorials/image/minimax/minimax-h3-image); use [T2I template]() / [Edit template]()
|
| 160 |
+
|
| 161 |
+
#### vLLM-Omni Deployment
|
| 162 |
+
|
| 163 |
+
See the [vLLM-Omni recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image) for
|
| 164 |
+
per-hardware deployment configurations and measured latency. Both NVIDIA and AMD accelerators are
|
| 165 |
+
supported, including NVIDIA H200, RTX PRO 6000 Blackwell, AMD Instinct MI350X and more.
|
| 166 |
+
|
| 167 |
+
Start the server on one GPU:
|
| 168 |
+
|
| 169 |
+
```bash
|
| 170 |
+
vllm serve MiniMaxAI/MiniMax-H3-Image --omni --host 0.0.0.0 --port 8000
|
| 171 |
+
```
|
| 172 |
+
|
| 173 |
+
For lower latency, split each request over several GPUs with sequence parallelism
|
| 174 |
+
(Ulysses), for example on 4 GPUs:
|
| 175 |
+
|
| 176 |
+
```bash
|
| 177 |
+
vllm serve MiniMaxAI/MiniMax-H3-Image --omni --host 0.0.0.0 --port 8000 \
|
| 178 |
+
--num-gpus 4 --usp 4 --text-encoder-tp-size 4
|
| 179 |
+
```
|
| 180 |
|
| 181 |
#### SGLang Deployment
|
| 182 |
|
|
|
|
| 365 |
|
| 366 |
## Contact Us
|
| 367 |
|
| 368 |
+
Contact us at [model@minimax.io](mailto:model@minimax.io).
|