Rope implements the insightface inswapper_128 model with a helpful GUI.
- Incredible features and fast workflow
- High performance
- Real-time video player
- Helpful functions
Note: Please check the wiki for installation and link to the new models file
- Images! In addition to videos, use Rope to swap images. Seamlessly integrated into the current interface.
- Timeline markers. Add markers to the timeline that capture the current settings at a specific frame. When playing back or recording, markers control the options when the frame is reached. Add as many markers as you need!
- Iterations. Apply the swapper model multiple times to a face. It seems to increase likeliness if used carefully.
- Orientation. Sometimes faces are at a bad orientation, like laying down or upside-down. The face detector has problems with this, so Rope now has an option to tell the detector which way the face is oriented. It is also markerable, so you can set markers for it per frame!
- Tool tips on (almost) everything. Tips are in the bottom pane.
- Bug fixes and refactoring
- (fixed) saving the same image multiple times in a row overwrites it. the time is appended when the image is loaded, not saved, so the time is always the same
- (fixed) cf is returning weird colors, similar to when the rgm bgr stuff was messed up. try swapping rgp before netering cf
- (fixed) GFPGAN fp16 might be causing too much harm (going back to original)
- (fixed) the orientation feature might not be unorienting
- (fixed) bug (I hope :D) : When clicking on a registered face name (the one of the left) to swap, on the previous version, clicking back to the same face name would delete the choice and unswap the face. Now it's just blocked and I can't "unswap" (unselect) the face. I'm force to select a face or just close and restart the soft.
- (fixed) update text for all the parser features
- (fixed) "Switch from one timeline marker to another doesn't properly show the correct features configured. Switch to the next frame (and back the previous one is working too) will fix it and show the correct configuration actually configured on the frame."
- (fixed) update mask tooltip
- (fixed) Btw accidentially scrolling Strength below 100% crashed Rope now the third time when CF is enabled. Haven't seen this with GFPGAN yet. I can screenshot the console error if that helps...
- (new) Added Mask view button, moved mask blur to button above mask view
- (new) MouthParser scrolls in negative direction to a)only mask the inside of the mouth, and b) grow the inside mouth mask as the amount increases
- (fixed) GFPGAN and Codeformer will give better results now, especially with details around the eyes and mouth.
- (fixed) in some cases, pixel values will be > 255
- (new) added undock button to image view
- (new) 'Strength' now has an on/off state
- (fixed) intermittent play bug
- (new) Click the mouse on the playback screen to control play/pause
- (new) Keyboard control with wasd and space
- (new) Stop Marker. Sets a frame that will stop the video playing/recording
-
(new) Added performance testing button. Turn on to report some stats in the console. Stats during threaded Play will be jumbled.
-
(fixed) Tooltip fixes
-
(fixed) Fixed bad Rope behavior when losing focus and returning
-
(fixed) Fixed crashing when using WASD on images
-
(fixed) GFPGAN and Codeformer are now working correctly. This required adding another detection model to these enhancers, so performance is slightly worse now using CF and GFPGAN but the quality is better.
-
(new) Rope can now undock and redock
-
(new) Rope will remember window positions and sizes between sessions, for both docked and undocked views
-
(fixed) Fixed multiple embedding selection bug
-
(fixed) Recording with one thread works again
-
(fixed) CV_64F error related to passing float64 to opencv
-
(fixed) Indexerror error related to differences in detection performance between resnet50 and Retinaface
- Recording starts on the next frame. It's an issue with how the opencv lib is used. In the future, I hope to get around this with another lib or just working directly with ffmpeg.
- Toggling between img/vid leaves a residual frame in the window. I'll clean this up in the future
- Unfortunately recording is bugged with Threads = 1. I need to change some logic.
- When using Markers, the frames before the first marker will use parameters from the the last settings in your options. Not sure if it is a true bug, but best way to deal with this is to create a marker at the first frame.
Machine: 3090Ti (24GB), i5-13600K
File: benchmark/target-1080p.mp4, 2048x1080, 269 frames, 25 fps, 10s Rendering tiem in seconds:
| Option | Crystal | Sapphire |
|---|---|---|
| Only Swap | 7.3 | 7.5 |
| Swap+GFPGAN | 10.7 | 11.0 |
| Swap+Codeformer | 12.4 | 13.5 |
| Swap+one word CLIP | 10.4 | 11.2 |
| Swap+Occluder | 7.8 | 7.8 |
| Swap+MouthParser | 13.9 | 12.1 |
Rope is a personal project that I'm making available to the community as a thank you for all of the contributors ahead of me. I've copied the disclaimer from Swap-Mukham here since it is well-written and applies 100% to this repo.
I would like to emphasize that our swapping software is intended for responsible and ethical use only. I must stress that users are solely responsible for their actions when using our software.
Intended Usage: This software is designed to assist users in creating realistic and entertaining content, such as movies, visual effects, virtual reality experiences, and other creative applications. I encourage users to explore these possibilities within the boundaries of legality, ethical considerations, and respect for others' privacy.
Ethical Guidelines: Users are expected to adhere to a set of ethical guidelines when using our software. These guidelines include, but are not limited to:
Not creating or sharing content that could harm, defame, or harass individuals. Obtaining proper consent and permissions from individuals featured in the content before using their likeness. Avoiding the use of this technology for deceptive purposes, including misinformation or malicious intent. Respecting and abiding by applicable laws, regulations, and copyright restrictions.
Privacy and Consent: Users are responsible for ensuring that they have the necessary permissions and consents from individuals whose likeness they intend to use in their creations. We strongly discourage the creation of content without explicit consent, particularly if it involves non-consensual or private content. It is essential to respect the privacy and dignity of all individuals involved.
Legal Considerations: Users must understand and comply with all relevant local, regional, and international laws pertaining to this technology. This includes laws related to privacy, defamation, intellectual property rights, and other relevant legislation. Users should consult legal professionals if they have any doubts regarding the legal implications of their creations.
Liability and Responsibility: We, as the creators and providers of the deep fake software, cannot be held responsible for the actions or consequences resulting from the usage of our software. Users assume full liability and responsibility for any misuse, unintended effects, or abusive behavior associated with the content they create.
By using this software, users acknowledge that they have read, understood, and agreed to abide by the above guidelines and disclaimers. We strongly encourage users to approach this technology with caution, integrity, and respect for the well-being and rights of others.
Remember, technology should be used to empower and inspire, not to harm or deceive. Let's strive for ethical and responsible use of deep fake technology for the betterment of society.