DepthCrafter Nodes

Create consistent depth maps for your videos using DepthCrafter in ComfyUI.

Original DepthCrafter repo: https://github.com/Tencent/DepthCrafter

DepthCrafter model download available here (Model license is limited to non-commercial academic use only)

Recommended minimum VRAM: 8GB

Updates:

(11/27/2024): Updated to support DepthCrafter v1.0.1 inference configuration.

(10/25/2024): Added enable_model_cpu_offload and enable_sequential_cpu_offload options to model loader. Only enable one at a time!

• enable_model_cpu_offload: Can save +25% of VRAM with little impact to speed by offloading models to cpu when no longer needed for inference.
• enable_sequential_cpu_offload: Can save +37% of VRAM at the expense of slower inference speed by moving all models to CPU.

🖥️ Custom Environment

I created a custom ComfyUI environment for testing out DepthCrafter nodes:

akatzai/comfy-env-depthcrafter:latest

Create a new environment and copy and paste the link above into the "Custom Image" field in my Environment Manager tool: https://github.com/akatz-ai/ComfyUI-Environment-Manager

Make sure to select the Basic environment type to access the included workflow!

⭐ Example Workflow:

📦 Included Nodes:

• DownloadAndLoadDepthCrafterModel: Will fetch the model files need to run DepthCrafter and save them under models/depthcrafter.
• DepthCrafter: Renders out depthmap videos given the following inputs:
  • depthcrafter_model: (input from the first node)
  • images: (single or batch),
  • max_res: the maximum resolution of the input images, supports increments of 64 pixels. (Larger resolutions require more VRAM)
  • max_inference_steps: more steps may result in less artifacts in the output, but will take longer to render.
  • guidance_scale: (1 - 1.2 recommended)
  • window_size: the length of the context window for DepthCrafter. You can lower this to save on VRAM at the expense of taking longer to render (75-110 recommended)
  • overlap: how much to overlap each context window to render longer videos > 110 frames. (25 recommended)

🔧 Installation and Usage

1. ComfyUI Manager:

• This node pack is available to install via the ComfyUI Manager. You can find it in the Custom Nodes section by searching for "DepthCrafter" and clicking on the entry called "DepthCrafter Nodes".

2. Clone the repository:

• Navigate to ComfyUI/custom_nodes folder in terminal or command prompt.
• Clone the repo using the following command:

git clone https://github.com/akatz-ai/ComfyUI-DepthCrafter-Nodes.git

• Restart ComfyUI