Before starting fine-tuning, please ensure your machine meets the minimum hardware requirements listed in the tables below. The tables show the minimum VRAM (GPU memory) requirements for different models under various configurations.
CogVideo Series
| Model | Training Type | Distribution Strategy | Mixed Precision | Training Resolution (FxHxW) | Hardware Requirements |
|---|
| cogvideox-t2v-2b | lora (rank128) | DDP | fp16 | 49x480x720 | 16GB VRAM |
| sft | DDP | fp16 | 49x480x720 | 36GB VRAM |
| 1-GPU zero-2 + opt offload | fp16 | 49x480x720 | 17GB VRAM |
| 8-GPU zero-2 | fp16 | 49x480x720 | 17GB VRAM |
| 8-GPU zero-3 | fp16 | 49x480x720 | 19GB VRAM |
| 8-GPU zero-3 + opt and param offload | bf16 | 49x480x720 | 14GB VRAM |
| cogvideox-{t2v,i2v}-5b | lora (rank128) | DDP | bf16 | 49x480x720 | 24GB VRAM |
| sft | 1-GPU zero-2 + opt offload | bf16 | 49x480x720 | 42GB VRAM |
| 8-GPU zero-2 | bf16 | 49x480x720 | 42GB VRAM |
| 8-GPU zero-3 | bf16 | 49x480x720 | 43GB VRAM |
| 8-GPU zero-3 + opt and param offload | bf16 | 49x480x720 | 28GB VRAM |
| cogvideox1.5-{t2v,i2v}-5b | lora (rank128) | DDP | bf16 | 81x768x1360 | 35GB VRAM |
| sft | 1-GPU zero-2 + opt offload | bf16 | 81x768x1360 | 56GB VRAM |
| 8-GPU zero-2 | bf16 | 81x768x1360 | 55GB VRAM |
| 8-GPU zero-3 | bf16 | 81x768x1360 | 55GB VRAM |
| 8-GPU zero-3 + opt and param offload | bf16 | 81x768x1360 | 40GB VRAM |
CogView Series
| Model | Training Type | Distribution Strategy | Mixed Precision | Training Resolution (HxW) | Hardware Requirements |
|---|
| CogView4-6B | lora (rank128) | DDP | bf16 | 1024x1024 | 30GB VRAM |
| sft | 1-GPU zero-2 + opt offload | bf16 | 1024x1024 | 42GB VRAM |
| 8-GPU zero-2 | bf16 | 1024x1024 | 50GB VRAM |
| 8-GPU zero-3 | bf16 | 1024x1024 | 47GB VRAM |
| 8-GPU zero-3 + opt and param offload | bf16 | 1024x1024 | 28GB VRAM |