Available ComfyUI Nodes

• Input: RGB frame (3, H, W)
• Output: Depth map (1, H, W)
• Performance Requirements:
  • Inference time: < 20ms
  • VRAM usage: 2GB
  • Batch size: 1
• Best Practices:
  • Place early in workflow
  • Cache results for static scenes
  • Use lowest viable resolution

Useful for tracking an object given positive and negative prompt coordinates. It can be combined with Florence2 and other object detection nodes.

• Input: RGB frame (3, H, W)
• Output: Segmentation mask (1, H, W)
• Performance Requirements:
  • Inference time: < 30ms
  • VRAM usage: 3GB
  • Batch size: 1
• Best Practices:
  • Cache static masks
  • Use mask erosion for stability
  • Implement confidence thresholding

• Input: RGB frame (3, H, W)
• Output: Feature vector (1, 512)
• Performance Requirements:
  • Inference time: < 15ms
  • VRAM usage: 1GB
  • Batch size: 1
• Best Practices:
  • Cache embeddings for known references
  • Use cosine similarity for matching
  • Implement feature vector normalization

A suite of nodes for real-time video processing and control. Some examples of nodes included are:

• Value: FloatControl, IntControl and StringControl
• Sequence: FloatSequence, IntSequence and StringSequence
• Motion: MotionController, IntegerMotionController, ROINode
• Utility: FPSMonitor, QuickShapeMask, DTypeConverter, FastWebcamCapture
• VAE: TAESDVaeEncodem, TAESDVaeDecode

Refer to the README.MD for more details

This node is useful for styling videos with a diffusion effect. It can be combined with other nodes to create masked effects.

• Input: RGB frame (3, H, W)
• Output: Feature vector (1, 512)

The NVIDIA TensorRT plugin optimizes stable diffusion performance by generating a static TensorRT engine based on static StableDiffusion parameters.

• Input:
  • Source image (3, H, W)
  • Driving frame (3, H, W)
• Output: Animated frame (3, H, W)
• Performance Requirements:
  • Inference time: < 50ms
  • VRAM usage: 4GB
  • Batch size: 1
• Best Practices:
  • Pre-process source images
  • Implement motion smoothing
  • Cache facial landmarks