Prerequisites

Before starting fine-tuning, please ensure your machine meets the minimum hardware requirements listed in the tables below. The tables show the minimum VRAM requirements for different models under various configurations (test on 8xA100).

CogVideo Series

Model	Type	Strategy	Resolution (FxHxW)	Requirement
cogvideox-t2v-2b	lora	DDP	49x480x720	1 GPU with 12GB VRAM
	sft	DDP	49x480x720	1 GPU with 25GB VRAM
cogvideox-{t2v,i2v}-5b	lora	DDP	49x480x720	1 GPU with 24GB VRAM
	sft	FSDP fullshard	49x480x720	8 GPU with 20GB VRAM
		FSDP fullshard + offload	49x480x720	1 GPU with 16GB VRAM
cogvideox1.5-{t2v,i2v}-5b	lora	DDP	81x768x1360	1 GPU with 32GB VRAM
	sft	FSDP fullshard	81x768x1360	8 GPUs with 31GB VRAM
		FSDP fullshard + offload	81x768x1360	8 GPUs with 27GB VRAM

CogView Series

Model	Type	Strategy	Resolution (HxW)	Requirement
CogView4-6B	qlora + offload (enable --low_vram)	DDP	1024x1024	1 GPU with 9GB VRAM
	lora	DDP	1024x1024	1 GPU with 20GB VRAM
	sft	FSDP fullshard	1024x1024	8 GPUs with 28GB VRAM
		FSDP fullshard + offload	1024x1024	8 GPUs with 22GB VRAM