Skip to content

Gourieff/comfyui-reactor-node

BranchesTags

Repository files navigation

logo

Version

Support Me on Boosty
Support This Project

Commit activity Last commit Opened issues Closed issues License

English | Русский

ReActor Node for ComfyUI

The Fast and Simple Face Swap Extension Node for ComfyUI, based on ReActor SD-WebUI Face Swap Extension

This Node goes without NSFW filter (uncensored, use it on your own responsibility)

demo

What's new in the latest update

0.5.2 ALPHA1

  • New node "Unload ReActor Models" - is useful for complex WFs when you need to free some VRAM utilized by ReActor
  • Support of ORT CoreML and ROCM EPs, just install onnxruntime version you need
  • Install script improvements to install latest versions of ORT-GPU
Previous versions

0.5.1

0.5.1-whatsnew-01

Full size demo preview

  • Sorting facemodels alphabetically
  • A lot of fixes and improvements

0.5.0 BETA4

  • Spandrel lib support for GFPGAN

0.5.0 BETA3

  • Fixes: "RAM issue", "No detection" for MaskingHelper

0.5.0 BETA2

  • You can now build a blended face model from a batch of face models you already have, just add the "Make Face Model Batch" node to your workflow and connect several models via "Load Face Model"
  • Huge performance boost of the image analyzer's module! 10x speed up! Working with videos is now a pleasure!
0.5.0-whatsnew-05

0.5.0 BETA1

  • SWAPPED_FACE output for the Masking Helper Node
  • FIX: Empty A-channel for Masking Helper IMAGE output (causing errors with some nodes) was removed

0.5.0 ALPHA1

  • ReActorBuildFaceModel Node got "face_model" output to provide a blended face model directly to the main Node:

Basic workflow 💾

  • Face Masking feature is available now, just add the "ReActorMaskHelper" Node to the workflow and connect it as shown below:
0.5.0-whatsnew-01

If you don't have the "face_yolov8m.pt" Ultralytics model - you can download it from the Assets and put it into the "ComfyUI\models\ultralytics\bbox" directory
As well as "sam_vit_b_01ec64.pth" model - download (if you don't have it) and put it into the "ComfyUI\models\sams" directory;

Use this Node to gain the best results of the face swapping process:

0.5.0-whatsnew-02
  • ReActorImageDublicator Node - rather useful for those who create videos, it helps to duplicate one image to several frames to use them with VAE Encoder (e.g. live avatars):
0.5.0-whatsnew-03
  • ReActorFaceSwapOpt (a simplified version of the Main Node) + ReActorOptions Nodes to set some additional options such as (new) "input/source faces separate order". Yes! You can now set the order of faces in the index in the way you want ("large to small" goes by default)!
0.5.0-whatsnew-04
  • Little speed boost when analyzing target images (unfortunately it is still quite slow in compare to swapping and restoring...)

0.4.2

  • GPEN-BFR-512 and RestoreFormer_Plus_Plus face restoration models support

You can download models here: https://huggingface.co/datasets/Gourieff/ReActor/tree/main/models/facerestore_models
Put them into the ComfyUI\models\facerestore_models folder

0.4.2-whatsnew-04
  • Due to popular demand - you can now blend several images with persons into one face model file and use it with "Load Face Model" Node or in SD WebUI as well;

Experiment and create new faces or blend faces of one person to gain better accuracy and likeness!

Just add the ImpactPack's "Make Image Batch" Node as the input to the ReActor's one and load images you want to blend into one model:

0.4.2-whatsnew-01

Result example (the new face was created from 4 faces of different actresses):

0.4.2-whatsnew-02

Basic workflow 💾

0.4.1

  • CUDA 12 Support - don't forget to run (Windows) install.bat or (Linux/MacOS) install.py for ComfyUI's Python enclosure or try to install ORT-GPU for CU12 manually (https://onnxruntime.ai/docs/install/#install-onnx-runtime-gpu-cuda-12x)

  • Issue #173 fix

  • Separate Node for the Face Restoration postprocessing (FR #191), can be found inside ReActor's menu (RestoreFace Node)

  • (Windows) Installation can be done for Python from the System's PATH

  • Different fixes and improvements

  • Face Restore Visibility and CodeFormer Weight (Fidelity) options are now available! Don't forget to reload the Node in your existing workflow

0.4.1-whatsnew-01

0.4.0

  • Input "input_image" goes first now, it gives a correct bypass and also it is right to have the main input first;
  • You can now save face models as "safetensors" files (ComfyUI\models\reactor\faces) and load them into ReActor implementing different scenarios and keeping super lightweight face models of the faces you use:
0.4.0-whatsnew-01 0.4.0-whatsnew-02
  • Ability to build and save face models directly from an image:
0.4.0-whatsnew-03
  • Both the inputs are optional, just connect one of them according to your workflow; if both is connected - image has a priority.
  • Different fixes making this extension better.

Thanks to everyone who finds bugs, suggests new features and supports this project!

Installation

SD WebUI: AUTOMATIC1111 or SD.Next
  1. Close (stop) your SD-WebUI/Comfy Server if it's running
  2. (For Windows Users):
  3. Go to the extensions\sd-webui-comfyui\ComfyUI\custom_nodes
  4. Open Console or Terminal and run git clone https://github.com/Gourieff/comfyui-reactor-node
  5. Go to the SD WebUI root folder, open Console or Terminal and run (Windows users).\venv\Scripts\activate or (Linux/MacOS)venv/bin/activate
  6. python -m pip install -U pip
  7. cd extensions\sd-webui-comfyui\ComfyUI\custom_nodes\comfyui-reactor-node
  8. python install.py
  9. Please, wait until the installation process will be finished
  10. (From the version 0.3.0) Download additional facerestorers models from the link below and put them into the extensions\sd-webui-comfyui\ComfyUI\models\facerestore_models directory:
    https://huggingface.co/datasets/Gourieff/ReActor/tree/main/models/facerestore_models
  11. Run SD WebUI and check console for the message that ReActor Node is running:
console_status_running
  1. Go to the ComfyUI tab and find there ReActor Node inside the menu ReActor or by using a search:
webui-demo webui-demo
Standalone (Portable) ComfyUI for Windows
  1. Do the following:
  2. Choose between two options:
    • (ComfyUI Manager) Open ComfyUI Manager, click "Install Custom Nodes", type "ReActor" in the "Search" field and then click "Install". After ComfyUI will complete the process - please restart the Server.
    • (Manually) Go to ComfyUI\custom_nodes, open Console and run git clone https://github.com/Gourieff/comfyui-reactor-node
  3. Go to ComfyUI\custom_nodes\comfyui-reactor-node and run install.bat
  4. If you don't have the "face_yolov8m.pt" Ultralytics model - you can download it from the Assets and put it into the "ComfyUI\models\ultralytics\bbox" directory

As well as one or both of "Sams" models from [here](https://huggingface.co/datasets/Gourieff/ReActor/tree/main/models/sams) - download (if you don't have them) and put into the "ComfyUI\models\sams" directory 5. Run ComfyUI and find there ReActor Nodes inside the menu `ReActor` or by using a search

Usage

You can find ReActor Nodes inside the menu ReActor or by using a search (just type "ReActor" in the search field)

List of Nodes:

  • ••• Main Nodes •••
    • ReActorFaceSwap (Main Node)
    • ReActorFaceSwapOpt (Main Node with the additional Options input)
    • ReActorOptions (Options for ReActorFaceSwapOpt)
    • ReActorFaceBoost (Face Booster Node)
    • ReActorMaskHelper (Masking Helper)
  • ••• Operations with Face Models •••
    • ReActorSaveFaceModel (Save Face Model)
    • ReActorLoadFaceModel (Load Face Model)
    • ReActorBuildFaceModel (Build Blended Face Model)
    • ReActorMakeFaceModelBatch (Make Face Model Batch)
  • ••• Additional Nodes •••
    • ReActorRestoreFace (Face Restoration)
    • ReActorImageDublicator (Dublicate one Image to Images List)
    • ImageRGBA2RGB (Convert RGBA to RGB)

Connect all required slots and run the query.

Main Node Inputs

  • input_image - is an image to be processed (target image, analog of "target image" in the SD WebUI extension);
    • Supported Nodes: "Load Image", "Load Video" or any other nodes providing images as an output;
  • source_image - is an image with a face or faces to swap in the input_image (source image, analog of "source image" in the SD WebUI extension);
    • Supported Nodes: "Load Image" or any other nodes providing images as an output;
  • face_model - is the input for the "Load Face Model" Node or another ReActor node to provide a face model file (face embedding) you created earlier via the "Save Face Model" Node;
    • Supported Nodes: "Load Face Model", "Build Blended Face Model";

Main Node Outputs

  • IMAGE - is an output with the resulted image;
    • Supported Nodes: any nodes which have images as an input;
  • FACE_MODEL - is an output providing a source face's model being built during the swapping process;
    • Supported Nodes: "Save Face Model", "ReActor", "Make Face Model Batch";

Face Restoration

Since version 0.3.0 ReActor Node has a buil-in face restoration.
Just download the models you want (see Installation instruction) and select one of them to restore the resulting face(s) during the faceswap. It will enhance face details and make your result more accurate.

Face Indexes

By default ReActor detects faces in images from "large" to "small".
You can change this option by adding ReActorFaceSwapOpt node with ReActorOptions.

And if you need to specify faces, you can set indexes for source and input images.

Index of the first detected face is 0.

You can set indexes in the order you need.
E.g.: 0,1,2 (for Source); 1,0,2 (for Input).
This means: the second Input face (index = 1) will be swapped by the first Source face (index = 0) and so on.

Genders

You can specify the gender to detect in images.
ReActor will swap a face only if it meets the given condition.

Face Models

Since version 0.4.0 you can save face models as "safetensors" files (stored in ComfyUI\models\reactor\faces) and load them into ReActor implementing different scenarios and keeping super lightweight face models of the faces you use.

To make new models appear in the list of the "Load Face Model" Node - just refresh the page of your ComfyUI web application.
(I recommend you to use ComfyUI Manager - otherwise you workflow can be lost after you refresh the page if you didn't save it before that).

Troubleshooting

I. (For Windows users) If you still cannot build Insightface for some reasons or just don't want to install Visual Studio or VS C++ Build Tools - do the following:

  1. (ComfyUI Portable) From the root folder check the version of Python:
    run CMD and type python_embeded\python.exe -V
  2. Download prebuilt Insightface package for Python 3.10 or for Python 3.11 (if in the previous step you see 3.11) or for Python 3.12 (if in the previous step you see 3.12) and put into the stable-diffusion-webui (A1111 or SD.Next) root folder (where you have "webui-user.bat" file) or into ComfyUI root folder if you use ComfyUI Portable
  3. From the root folder run:
    • (SD WebUI) CMD and .\venv\Scripts\activate
    • (ComfyUI Portable) run CMD
  4. Then update your PIP:
    • (SD WebUI) python -m pip install -U pip
    • (ComfyUI Portable) python_embeded\python.exe -m pip install -U pip
  5. Then install Insightface:
    • (SD WebUI) pip install insightface-0.7.3-cp310-cp310-win_amd64.whl (for 3.10) or pip install insightface-0.7.3-cp311-cp311-win_amd64.whl (for 3.11) or pip install insightface-0.7.3-cp312-cp312-win_amd64.whl (for 3.12)
    • (ComfyUI Portable) python_embeded\python.exe -m pip install insightface-0.7.3-cp310-cp310-win_amd64.whl (for 3.10) or python_embeded\python.exe -m pip install insightface-0.7.3-cp311-cp311-win_amd64.whl (for 3.11) or python_embeded\python.exe -m pip install insightface-0.7.3-cp312-cp312-win_amd64.whl (for 3.12)
  6. Enjoy!

II. "AttributeError: 'NoneType' object has no attribute 'get'"

This error may occur if there's smth wrong with the model file inswapper_128.onnx

Try to download it manually from here and put it to the ComfyUI\models\insightface replacing existing one

III. "reactor.execute() got an unexpected keyword argument 'reference_image'"

This means that input points have been changed with the latest update
Remove the current ReActor Node from your workflow and add it again

IV. ControlNet Aux Node IMPORT failed error when using with ReActor Node

  1. Close ComfyUI if it runs
  2. Go to the ComfyUI root folder, open CMD there and run:
    • python_embeded\python.exe -m pip uninstall -y opencv-python opencv-contrib-python opencv-python-headless
    • python_embeded\python.exe -m pip install opencv-python==4.7.0.72
  3. That's it!

reactor+controlnet

V. "ModuleNotFoundError: No module named 'basicsr'" or "subprocess-exited-with-error" during future-0.18.3 installation

VI. "fatal: fetch-pack: invalid index-pack output" when you try to git clone the repository"

Try to clone with --depth=1 (last commit only):

 git clone --depth=1 https://github.com/Gourieff/comfyui-reactor-node

Then retrieve the rest (if you need):

 git fetch --unshallow

Updating

Just put .bat or .sh script from this Repo to the ComfyUI\custom_nodes directory and run it when you need to check for updates

Disclaimer

This software is meant to be a productive contribution to the rapidly growing AI-generated media industry. It will help artists with tasks such as animating a custom character or using the character as a model for clothing etc.

The developers of this software are aware of its possible unethical applications and are committed to take preventative measures against them. We will continue to develop this project in the positive direction while adhering to law and ethics.

Users of this software are expected to use this software responsibly while abiding the local law. If face of a real person is being used, users are suggested to get consent from the concerned person and clearly mention that it is a deepfake when posting content online. Developers and Contributors of this software are not responsible for actions of end-users.

By using this extension you are agree not to create any content that:

  • violates any laws;
  • causes any harm to a person or persons;
  • propagates (spreads) any information (both public or personal) or images (both public or personal) which could be meant for harm;
  • spreads misinformation;
  • targets vulnerable groups of people.

This software utilizes the pre-trained models buffalo_l and inswapper_128.onnx, which are provided by InsightFace. These models are included under the following conditions:

From insighface license: The InsightFace’s pre-trained models are available for non-commercial research purposes only. This includes both auto-downloading models and manually downloaded models.

Users of this software must strictly adhere to these conditions of use. The developers and maintainers of this software are not responsible for any misuse of InsightFace’s pre-trained models.

Please note that if you intend to use this software for any commercial purposes, you will need to train your own models or find models that can be used commercially.

Models Hashsum

Safe-to-use models have the following hash:

inswapper_128.onnx

MD5:a3a155b90354160350efd66fed6b3d80
SHA256:e4a3f08c753cb72d04e10aa0f7dbe3deebbf39567d4ead6dce08e98aa49e16af

1k3d68.onnx

MD5:6fb94fcdb0055e3638bf9158e6a108f4
SHA256:df5c06b8a0c12e422b2ed8947b8869faa4105387f199c477af038aa01f9a45cc

2d106det.onnx

MD5:a3613ef9eb3662b4ef88eb90db1fcf26
SHA256:f001b856447c413801ef5c42091ed0cd516fcd21f2d6b79635b1e733a7109dbf

det_10g.onnx

MD5:4c10eef5c9e168357a16fdd580fa8371
SHA256:5838f7fe053675b1c7a08b633df49e7af5495cee0493c7dcf6697200b85b5b91

genderage.onnx

MD5:81c77ba87ab38163b0dec6b26f8e2af2
SHA256:4fde69b1c810857b88c64a335084f1c3fe8f01246c9a191b48c7bb756d6652fb

w600k_r50.onnx

MD5:80248d427976241cbd1343889ed132b3
SHA256:4c06341c33c2ca1f86781dab0e829f88ad5b64be9fba56e56bc9ebdefc619e43

Please check hashsums if you download these models from unverified (or untrusted) sources

Thanks and Credits

Click to expand
file source license
buffalo_l.zip DeepInsight license
codeformer-v0.1.0.pth sczhou license
GFPGANv1.3.pth TencentARC license
GFPGANv1.4.pth TencentARC license
inswapper_128.onnx DeepInsight license
inswapper_128_fp16.onnx Hillobar license

BasicSR - @XPixelGroup
facexlib - @xinntao

@s0md3v, @henryruhs - the original Roop App
@ssitu - the first version of ComfyUI_roop extension

Note!

If you encounter any errors when you use ReActor Node - don't rush to open an issue, first try to remove current ReActor node in your workflow and add it again

ReActor Node gets updates from time to time, new functions appear and old node can work with errors or not work at all

About

Fast and Simple Face Swap Extension Node for ComfyUI

Topics

face-swapping stable-diffusion stable-diffusion-webui comfyui

Resources

Readme

License

GPL-3.0 license
Activity

Stars

1.6k stars

Watchers

15 watching

Forks

163 forks
Report repository

Releases 8

0.5.1 Latest
Nov 21, 2024
+ 7 releases

Packages

No packages published

Contributors 14

Languages