Update readme for LightX2V infer.

#14
by lightx2v - opened
Files changed (1) hide show
  1. README.md +34 -0
README.md CHANGED
@@ -155,6 +155,7 @@ We recommend the following inference frameworks to serve the model:
155
 
156
  - [SGLang](https://docs.sglang.io/) - see [cookbook](https://docs.sglang.io/cookbook/diffusion/MiniMax/MiniMax-H3-Image)
157
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni) - see [vllm-omni recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image)
 
158
  - [diffusers](https://github.com/huggingface/diffusers) - see [diffusers docs](https://huggingface.co/docs/diffusers/main/en/api/pipelines/minimax_h3_image)
159
  - [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - see [Comfy tutorial](https://docs.comfy.org/tutorials/image/minimax/minimax-h3-image); use [T2I template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/image_minimax_h3_image_t2i.json) / [Edit template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/image_minimax_h3_image_edit.json)
160
 
@@ -200,6 +201,39 @@ sglang serve --model-path MiniMaxAI/MiniMax-H3-Image --host 0.0.0.0 --port 30000
200
  --num-gpus 4 --ulysses-degree 4
201
  ```
202
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
203
  #### Request parameters
204
 
205
  Text-to-image requests are JSON sent to `/v1/images/generations`. Image editing requests send
 
155
 
156
  - [SGLang](https://docs.sglang.io/) - see [cookbook](https://docs.sglang.io/cookbook/diffusion/MiniMax/MiniMax-H3-Image)
157
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni) - see [vllm-omni recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image)
158
+ - [LightX2V](https://github.com/ModelTC/LightX2V) - see [Usage guide](https://github.com/ModelTC/LightX2V/tree/main/scripts/minimax_h3_image)
159
  - [diffusers](https://github.com/huggingface/diffusers) - see [diffusers docs](https://huggingface.co/docs/diffusers/main/en/api/pipelines/minimax_h3_image)
160
  - [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - see [Comfy tutorial](https://docs.comfy.org/tutorials/image/minimax/minimax-h3-image); use [T2I template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/image_minimax_h3_image_t2i.json) / [Edit template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/image_minimax_h3_image_edit.json)
161
 
 
201
  --num-gpus 4 --ulysses-degree 4
202
  ```
203
 
204
+ #### LightX2V Deployment
205
+
206
+ See the [LightX2V MiniMax-H3-Image guide](https://github.com/ModelTC/LightX2V/tree/main/scripts/minimax_h3_image) for complete usage instructions.
207
+
208
+ Update lightx2v_path, model_path, and GPU settings in the cache-generation and server startup scripts. Run the following commands from the LightX2V repository root.
209
+
210
+ First, generate the AdaLN cache:
211
+
212
+ ```bash
213
+ bash tools/cache_minimax_h3_adaln/run_cache_minimax_h3_image_adaln.sh
214
+ ```
215
+
216
+ Skip this step if a matching cache already exists. The same cache can be reused for single-GPU and multi-GPU serving.
217
+
218
+ Start the server on one GPU:
219
+
220
+ ```bash
221
+ bash scripts/minimax_h3_image/server/start_server.sh
222
+ ```
223
+
224
+ For lower latency, start the server on four GPUs with sequence parallelism:
225
+
226
+ ```bash
227
+ bash scripts/minimax_h3_image/server/start_server_sp4.sh
228
+ ```
229
+
230
+ After model loading, send a request from another terminal:
231
+
232
+ ```bash
233
+ python scripts/minimax_h3_image/server/post_t2i.py
234
+ python scripts/minimax_h3_image/server/post_i2i.py
235
+ ```
236
+
237
  #### Request parameters
238
 
239
  Text-to-image requests are JSON sent to `/v1/images/generations`. Image editing requests send