[Issue]: Flux Model Never Loads

[Cyberes]

Issue Description

I am attempting to load the Black Forest Labs FLUX.1 Dev qint4 model from the model selection list. The relevant model is downloaded off HF successfully.

Unfortunately, the loading process hangs. I can see a very small amount of GPU utilization:

The model never finishes loading. The GPU memory increases extremely slowly and 12 hours later it was at 7.5G with no model loaded.

Version Platform Description

Ubuntu Server 22.04.5
NVIDIA A4000
Accessed via Ubuntu Desktop + Librewolf

Relevant log output

See first comment.

Backend

Diffusers

UI

Standard

Branch

Master

Model

Disty0/FLUX.1-dev-qint4

Acknowledgements

• I have read the above and searched for existing issues
• I confirm that this is classified correctly and its not an extension issue

[Cyberes]

user@server:/storage/flux/sd.next$ SD_LOAD_DEBUG=true ./webui.sh --debug --use-cuda --models-dir /storage/flux/models/                                                                                                                     
Create python venv                                                                                                                                                                                                                            
Activate python venv: /storage/flux/sd.next/venv                                                                                                                                                                                              
Launch: venv/bin/python3                                                                                                                                                                                                                      
18:10:19-797186 INFO     Starting SD.Next                                                                                                                                                                                                     
18:10:19-805137 INFO     Logger: file="/storage/flux/sd.next/sdnext.log" level=DEBUG size=64 mode=create                                                                                                                                      
18:10:19-807630 INFO     Python: version=3.10.12 platform=Linux bin="/storage/flux/sd.next/venv/bin/python3" venv="/storage/flux/sd.next/venv"                                                                                                
18:10:19-835586 INFO     Version: app=sd.next updated=2024-11-02 hash=65ddc611 branch=master url=https://github.com/vladmandic/automatic/tree/master ui=main                                                                                  
18:10:20-344591 INFO     Platform: arch=x86_64 cpu=x86_64 system=Linux release=5.15.0-125-generic python=3.10.12                                                                                                                              
18:10:20-347550 INFO     Args: ['--debug', '--use-cuda', '--models-dir', '/storage/flux/models/']                                                                                                                                             
18:10:20-349535 DEBUG    Setting environment tuning                                                                                                                                                                                           
18:10:20-352981 DEBUG    Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512"                                                                                                                                           
18:10:20-363251 DEBUG    Torch overrides: cuda=True rocm=False ipex=False directml=False openvino=False zluda=False                                                                                                                           
18:10:20-366364 INFO     CUDA: nVidia toolkit detected                                                                                                                                                                                        
18:10:20-368670 INFO     Install: package="onnxruntime-gpu" mode=pip                                                                                                                                                                          
18:10:20-370658 DEBUG    Running: pip="install --upgrade onnxruntime-gpu"                                                                                                                                                                     
18:10:55-548252 INFO     Install: package="torch==2.5.1+cu124 torchvision==0.20.1+cu124 --index-url https://download.pytorch.org/whl/cu124" mode=pip                                                                                          
18:10:55-550963 DEBUG    Running: pip="install --upgrade torch==2.5.1+cu124 torchvision==0.20.1+cu124 --index-url https://download.pytorch.org/whl/cu124"                                                                                     
18:15:07-401249 DEBUG    Package: onnx not found                                                                                                                                                                                              
18:15:07-403326 INFO     Install: package="onnx" mode=pip                                                                                                                                                                                     
18:15:07-405350 DEBUG    Running: pip="install --upgrade onnx"                                                                                                                                                                                
18:15:14-585281 DEBUG    Package: onnxruntime not found                                                                                                                                                                                       18:15:14-588058 INFO     Install: package="onnxruntime" mode=pip                                                                                                                                                                              
18:15:14-590085 DEBUG    Running: pip="install --upgrade onnxruntime"                                                                                                                                                                         
18:15:24-865122 DEBUG    Diffusers install: package=None current= target=0d1d267b12e47b40b0e8f265339c76e0f45f8c49                    
18:15:56-869006 INFO     Installing requirements: this may take a while...                                                                                                                                                                    
18:15:56-873765 DEBUG    Running: pip="install -r requirements.txt"                                                                                                                                                                           
18:18:10-342026 DEBUG    Package: torch not found                                                                                                                                                                                             
18:18:10-344273 INFO     Verifying requirements                                                                                                                                                                                               
18:18:10-349205 DEBUG    Package: psutil not found                                                                                                                                                                                            
18:18:10-416316 DEBUG    Package: rich not found                                                                                                                                                                                              
18:18:10-486323 DEBUG    Package: requests not found                                                                                                                                                                                          
18:18:10-488550 INFO     Install: package="requests==2.32.3" mode=pip                                                                                                                                                                         
18:18:10-490432 DEBUG    Running: pip="install --upgrade requests==2.32.3"                                                                                                                                                                    
18:18:16-063461 INFO     Verifying packages                                                                                                                                                                                                   
18:18:16-065691 INFO     Install: package="git+https://github.com/openai/CLIP.git" mode=pip                                                                                                                                                   
18:18:16-067739 DEBUG    Running: pip="install --upgrade git+https://github.com/openai/CLIP.git"                                                                                                                                              
18:18:29-194904 INFO     Install: package="open-clip-torch" mode=pip                                                                                                                                                                          
18:18:29-197352 DEBUG    Running: pip="install --upgrade --no-deps open-clip-torch"                                                                                                                                                           
18:18:31-149755 INFO     Startup: standard                                                                                                                                                                                                    
18:18:31-151864 INFO     Verifying submodules                                                                                                                                                                                                 
18:20:06-992517 DEBUG    Git detached head detected: folder="extensions-builtin/sd-extension-chainner" reattach=main                                                                                                                          
18:20:06-995113 DEBUG    Git submodule: extensions-builtin/sd-extension-chainner / main                                                                                                                                                       
18:20:07-030749 DEBUG    Git detached head detected: folder="extensions-builtin/sd-extension-system-info" reattach=main                                                                                                                       
18:20:07-033273 DEBUG    Git submodule: extensions-builtin/sd-extension-system-info / main                                                                                                                                                    
18:20:07-058069 DEBUG    Git detached head detected: folder="extensions-builtin/sd-webui-agent-scheduler" reattach=main                                                                                                                       
18:20:07-060240 DEBUG    Git submodule: extensions-builtin/sd-webui-agent-scheduler / main                                                                                                                                                    
18:20:07-105581 DEBUG    Git detached head detected: folder="extensions-builtin/sdnext-modernui" reattach=main                                                                                                                                
18:20:07-108126 DEBUG    Git submodule: extensions-builtin/sdnext-modernui / main                                                                                                                                                             
18:20:07-143732 DEBUG    Git detached head detected: folder="extensions-builtin/stable-diffusion-webui-rembg" reattach=master                                                                                                                 
18:20:07-145938 DEBUG    Git submodule: extensions-builtin/stable-diffusion-webui-rembg / master                                                                                                                                              
18:20:07-172925 DEBUG    Git detached head detected: folder="modules/k-diffusion" reattach=master                                                                                                                                             
18:20:07-175147 DEBUG    Git submodule: modules/k-diffusion / master                                                                                                                                                                          18:20:07-197656 DEBUG    Git detached head detected: folder="wiki" reattach=master                                                                                                                                                            
18:20:07-199991 DEBUG    Git submodule: wiki / master                                                                                                                                                                                         
18:20:07-216945 DEBUG    Register paths  
18:20:07-289291 DEBUG    Installed packages: 173                                                                                                                                                                                              
18:20:07-291690 DEBUG    Extensions all: ['sd-webui-agent-scheduler', 'sd-extension-chainner', 'sdnext-modernui', 'Lora', 'stable-diffusion-webui-rembg', 'sd-extension-system-info']                                                         
18:20:07-293890 DEBUG    Extension installer: /storage/flux/sd.next/extensions-builtin/sd-webui-agent-scheduler/install.py                                                                                                                    
18:20:17-320511 INFO     Extension installed packages: sd-webui-agent-scheduler ['SQLAlchemy==2.0.36', 'greenlet==3.1.1']                                                                                                                     
18:20:17-525004 DEBUG    Extension installer: /storage/flux/sd.next/extensions-builtin/stable-diffusion-webui-rembg/install.py                                                                                                                
18:20:37-569219 INFO     Extension installed packages: stable-diffusion-webui-rembg ['PyMatting==1.1.12', 'opencv-python-headless==4.10.0.84', 'pooch==1.8.2', 'rembg==2.0.59']                                                               
18:20:37-639254 DEBUG    Extensions all: []                                                                                                                                                                                                   
18:20:37-641435 INFO     Extensions enabled: ['sd-webui-agent-scheduler', 'sd-extension-chainner', 'sdnext-modernui', 'Lora', 'stable-diffusion-webui-rembg', 'sd-extension-system-info']                                                     
18:20:37-643574 INFO     Installing requirements: this may take a while...                                                                                                                                                                    
18:20:37-645397 INFO     Verifying requirements                                                                                                                                                                                               
18:20:37-647251 DEBUG    Setup complete without errors: 1731201638                                                                                                                                                                            
18:20:37-652850 DEBUG    Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}                                                                                                                                                    
18:20:37-655515 INFO     Command line args: ['--debug', '--use-cuda', '--models-dir', '/storage/flux/models/'] models_dir=/storage/flux/models/ use_cuda=True debug=True                                                                      
18:20:37-657990 DEBUG    Env flags: ['SD_LOAD_DEBUG=true']                                                                                                                                                                                    
18:20:37-660095 DEBUG    Starting module: <module 'webui' from '/storage/flux/sd.next/webui.py'>                                                                                                                                              
18:20:47-387167 DEBUG    System: cores=16 affinity=16 threads=16                                                                                                                                                                              
18:20:47-395338 INFO     System packages: {'torch': '2.5.1+cu124', 'diffusers': '0.32.0.dev0', 'gradio': '3.43.2', 'transformers': '4.46.1', 'accelerate': '1.0.1'}                                                                           
18:20:48-176714 DEBUG    Huggingface cache: folder="/home/user/.cache/huggingface/hub"                                                                                                                                                     
18:20:48-179586 DEBUG    Reading failed: config.json [Errno 2] No such file or directory: 'config.json'                                                                                                                                       
18:20:48-471413 INFO     Device detect: memory=15.7 optimization=none                                                                                                                                                                         
18:20:48-475369 DEBUG    Created default config: config.json                                                                                                                                                                                  
18:20:48-480474 INFO     Engine: backend=Backend.DIFFUSERS compute=cuda device=cuda attention="Scaled-Dot-Product" mode=no_grad                                                                                                               
18:20:48-483429 DEBUG    Migrated styles: file="styles.csv" folder="/storage/flux/models/styles"                                                                                                                                              
18:20:48-485274 DEBUG    Save: file="config.json" json=18 bytes=723 time=0.007                                                                                                                                                                
18:20:48-501013 INFO     Available Styles: folder="/storage/flux/models/styles" items=288 time=0.01                                                                                                                                           
18:20:48-503853 DEBUG    Read: file="html/reference.json" json=59 bytes=31175 time=0.000                                                                                                                                                      
18:20:48-573783 INFO     Torch parameters: backend=cuda device=cuda config=Auto dtype=torch.bfloat16 vae=torch.bfloat16 unet=torch.bfloat16 context=no_grad nohalf=False nohalfvae=False upscast=False deterministic=False test-fp16=True     
                         test-bf16=True optimization="Scaled-Dot-Product"                                                                                                                                                                     18:20:48-605884 INFO     Device: device=NVIDIA RTX A4000 n=1 arch=sm_90 capability=(8, 6) cuda=12.4 cudnn=90100 driver=535.183.01                                                                                                             
18:20:49-174269 DEBUG    Importing LDM                                                                                                                                                                                                        
18:20:49-212707 DEBUG    Entering start sequence
18:20:49-216874 INFO     Create: folder="/storage/flux/models/Stable-diffusion"                                                                                                                                                               
18:20:49-218756 INFO     Create: folder="/storage/flux/models/Diffusers"                                                                                                                                                                      
18:20:49-220709 INFO     Create: folder="/storage/flux/models/VAE"                                                                                                                                                                            
18:20:49-222532 INFO     Create: folder="/storage/flux/models/UNET"                                                                                                                                                                           
18:20:49-224450 INFO     Create: folder="/storage/flux/models/Text-encoder"                                                                                                                                                                   
18:20:49-226266 INFO     Create: folder="/storage/flux/models/Lora"                                                                                                                                                                           
18:20:49-228121 INFO     Create: folder="/storage/flux/models/embeddings"                                                                                                                                                                     
18:20:49-229993 INFO     Create: folder="/storage/flux/models/hypernetworks"                                                                                                                                                                  
18:20:49-231911 INFO     Create: folder="/storage/flux/models/ONNX/temp"                                                                                                                                                                      
18:20:49-233866 INFO     Create: folder="outputs/text"                                                                                                                                                                                        
18:20:49-235863 INFO     Create: folder="outputs/image"                                                                                                                                                                                       
18:20:49-237857 INFO     Create: folder="outputs/control"                                                                                                                                                                                     
18:20:49-240341 INFO     Create: folder="outputs/extras"                                                                                                                                                                                      
18:20:49-242268 INFO     Create: folder="outputs/init-images"                                                                                                                                                                                 
18:20:49-244445 INFO     Create: folder="outputs/grids"                                                                                                                                                                                       
18:20:49-246517 INFO     Create: folder="outputs/save"                                                                                                                                                                                        
18:20:49-248469 INFO     Create: folder="outputs/video"                                                                                                                                                                                       
18:20:49-250345 INFO     Create: folder="/storage/flux/models/yolo"                                                                                                                                                                           
18:20:49-252287 INFO     Create: folder="/storage/flux/models/wildcards"                                                                                                                                                                      
18:20:49-254719 DEBUG    Initializing                                                                                                                                                                                                         
18:20:49-318393 INFO     Available VAEs: path="/storage/flux/models/VAE" items=0                                                                                                                                                              
18:20:49-323399 INFO     Available UNets: path="/storage/flux/models/UNET" items=0                                                                                                                                                            
18:20:49-328585 INFO     Available TEs: path="/storage/flux/models/Text-encoder" items=0                                                                                                                                                      
18:20:49-332987 INFO     Disabled extensions: ['sdnext-modernui']                                                                                                                                                                             
18:20:49-338168 DEBUG    Scanning diffusers cache: folder="/storage/flux/models/Diffusers" items=0 time=0.00                                                                                                                                  
18:20:49-342691 INFO     Available Models: path="/storage/flux/models/Stable-diffusion" items=0 time=0.01                                                                                                                                     
18:20:49-356054 INFO     Install: package="basicsr" mode=pip                                                                                                                                                                                  18:20:49-360034 DEBUG    Running: pip="install --upgrade basicsr"                                                                                                                                                                             
18:21:03-023291 INFO     Install: package="gfpgan" mode=pip                                                                                                                                                                                   
18:21:03-025881 DEBUG    Running: pip="install --upgrade gfpgan"  
18:20:49-216874 INFO     Create: folder="/storage/flux/models/Stable-diffusion"                                                                                                                                                               
18:20:49-218756 INFO     Create: folder="/storage/flux/models/Diffusers"                                                                                                                                                                      
18:20:49-220709 INFO     Create: folder="/storage/flux/models/VAE"                                                                                                                                                                            
18:20:49-222532 INFO     Create: folder="/storage/flux/models/UNET"                                                                                                                                                                           
18:20:49-224450 INFO     Create: folder="/storage/flux/models/Text-encoder"                                                                                                                                                                   
18:20:49-226266 INFO     Create: folder="/storage/flux/models/Lora"                                                                                                                                                                           
18:20:49-228121 INFO     Create: folder="/storage/flux/models/embeddings"                                                                                                                                                                     
18:20:49-229993 INFO     Create: folder="/storage/flux/models/hypernetworks"                                                                                                                                                                  
18:20:49-231911 INFO     Create: folder="/storage/flux/models/ONNX/temp"                                                                                                                                                                      
18:20:49-233866 INFO     Create: folder="outputs/text"                                                                                                                                                                                        
18:20:49-235863 INFO     Create: folder="outputs/image"                                                                                                                                                                                       
18:20:49-237857 INFO     Create: folder="outputs/control"                                                                                                                                                                                     
18:20:49-240341 INFO     Create: folder="outputs/extras"                                                                                                                                                                                      
18:20:49-242268 INFO     Create: folder="outputs/init-images"                                                                                                                                                                                 
18:20:49-244445 INFO     Create: folder="outputs/grids"                                                                                                                                                                                       
18:20:49-246517 INFO     Create: folder="outputs/save"                                                                                                                                                                                        
18:20:49-248469 INFO     Create: folder="outputs/video"                                                                                                                                                                                       
18:20:49-250345 INFO     Create: folder="/storage/flux/models/yolo"                                                                                                                                                                           
18:20:49-252287 INFO     Create: folder="/storage/flux/models/wildcards"                                                                                                                                                                      
18:20:49-254719 DEBUG    Initializing                                                                                                                                                                                                         
18:20:49-318393 INFO     Available VAEs: path="/storage/flux/models/VAE" items=0                                                                                                                                                              
18:20:49-323399 INFO     Available UNets: path="/storage/flux/models/UNET" items=0                                                                                                                                                            
18:20:49-328585 INFO     Available TEs: path="/storage/flux/models/Text-encoder" items=0                                                                                                                                                      
18:20:49-332987 INFO     Disabled extensions: ['sdnext-modernui']                                                                                                                                                                             
18:20:49-338168 DEBUG    Scanning diffusers cache: folder="/storage/flux/models/Diffusers" items=0 time=0.00                                                                                                                                  
18:20:49-342691 INFO     Available Models: path="/storage/flux/models/Stable-diffusion" items=0 time=0.01                                                                                                                                     
18:20:49-356054 INFO     Install: package="basicsr" mode=pip                                                                                                                                                                                  18:20:49-360034 DEBUG    Running: pip="install --upgrade basicsr"                                                                                                                                                                             
18:21:03-023291 INFO     Install: package="gfpgan" mode=pip                                                                                                                                                                                   
18:21:03-025881 DEBUG    Running: pip="install --upgrade gfpgan"  
18:21:09-980209 INFO     Available Yolo: path="/storage/flux/models/yolo" items=6 downloaded=0                                                                                                                                                
18:21:09-982749 DEBUG    Load extensions                                                                                                                                                                                                      
18:21:10-307109 INFO     Available LoRAs: path="/storage/flux/models/Lora" items=0 folders=2 time=0.00                                                                                                                                        
18:21:12-489718 INFO     Extension: script='extensions-builtin/sd-webui-agent-scheduler/scripts/task_scheduler.py' Using sqlite file: extensions-builtin/sd-webui-agent-scheduler/task_scheduler.sqlite3                                      
18:21:12-500221 DEBUG    Extensions init time: 2.52 Lora=0.53 sd-extension-chainner=0.19 sd-webui-agent-scheduler=1.49                                                                                                                        
18:21:12-629415 DEBUG    Read: file="html/upscalers.json" json=4 bytes=2640 time=0.000                                                                                                                                                        
18:21:12-632327 INFO     Upscaler create: folder="/storage/flux/models/chaiNNer"                                                                                                                                                              
18:21:12-634654 DEBUG    Read: file="extensions-builtin/sd-extension-chainner/models.json" json=24 bytes=2693 time=0.000                                                                                                                      
18:21:12-638313 DEBUG    chaiNNer models: path="/storage/flux/models/chaiNNer" defined=24 discovered=0 downloaded=0                                                                                                                           
18:21:12-640801 INFO     Upscaler create: folder="/storage/flux/models/RealESRGAN"                                                                                                                                                            
18:21:12-644598 INFO     Available Upscalers: items=53 downloaded=0 user=0 time=0.14 types=['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'SCUNet', 'RealESRGAN', 'SwinIR', 'LDSR', 'SD', 'AuraSR', 'ESRGAN']                                     
18:21:12-660299 INFO     Available Styles: folder="/storage/flux/models/styles" items=288 time=0.01                                                                                                                                           
18:21:12-672221 DEBUG    Creating UI                                                                                                                                                                                                          
18:21:12-675092 DEBUG    UI themes available: type=Standard themes=12                                                                                                                                                                         
18:21:12-677536 INFO     UI theme: type=Standard name="black-teal"                                                                                                                                                                            
18:21:12-684536 DEBUG    UI theme: css="/storage/flux/sd.next/javascript/black-teal.css" base="sdnext.css" user="None"                                                                                                                        
18:21:12-692407 DEBUG    UI initialize: txt2img                                                                                                                                                                                               
18:21:12-777139 DEBUG    Networks: page='model' items=58 subfolders=2 tab=txt2img folders=['/storage/flux/models/Stable-diffusion', '/storage/flux/models/Diffusers', 'models/Reference'] list=0.03 thumb=0.02 desc=0.00 info=0.00 workers=8  
                         sort=Default                                                                                                                                                                                                         
18:21:12-782576 DEBUG    Networks: page='lora' items=0 subfolders=0 tab=txt2img folders=['/storage/flux/models/Lora', '/storage/flux/models/LyCORIS'] list=0.02 thumb=0.02 desc=0.00 info=0.00 workers=8 sort=Default                         
18:21:12-806592 DEBUG    Networks: page='style' items=288 subfolders=1 tab=txt2img folders=['/storage/flux/models/styles', 'html'] list=0.03 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default                                            
18:21:12-814616 DEBUG    Networks: page='embedding' items=0 subfolders=0 tab=txt2img folders=['/storage/flux/models/embeddings'] list=0.01 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default                                              
18:21:12-818865 DEBUG    Networks: page='vae' items=0 subfolders=0 tab=txt2img folders=['/storage/flux/models/VAE'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default                                                           
18:21:12-824433 DEBUG    Networks: page='history' items=0 subfolders=0 tab=txt2img folders=[] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default                                                                                 
18:21:13-041052 DEBUG    Package: clean-fid not found                                                                                                                                                                                         
18:21:13-043494 INFO     Install: package="clean-fid" mode=pip                                                                                                                                                                                
18:21:13-046383 DEBUG    Running: pip="install --upgrade clean-fid"                                                                                                                                                                           
18:21:19-555444 DEBUG    UI initialize: img2img                                                                                                                                                                                               18:21:20-044707 DEBUG    UI initialize: control models=/storage/flux/models/control                                                                                                                                                           
18:21:21-275305 DEBUG    Reading failed: ui-config.json [Errno 2] No such file or directory: 'ui-config.json'                                                                                                                                 
18:21:21-872014 DEBUG    UI themes available: type=Standard themes=12      
18:21:22-466856 DEBUG    Reading failed: /storage/flux/sd.next/html/extensions.json [Errno 2] No such file or directory: '/storage/flux/sd.next/html/extensions.json'                                                                         
18:21:22-470008 INFO     Extension list is empty: refresh required                                                                                                                                                                            
18:21:22-560012 DEBUG    Extension list: processed=6 installed=6 enabled=5 disabled=1 visible=6 hidden=0                                                                                                                                      
18:21:23-280848 DEBUG    Save: file="ui-config.json" json=0 bytes=2 time=0.000                                                                                                                                                                
18:21:23-443230 DEBUG    Root paths: ['/storage/flux/sd.next']                                                                                                                                                                                
18:21:23-641250 INFO     Local URL: http://127.0.0.1:7860/                                                                                                                                                                                    
18:21:23-643575 DEBUG    Gradio functions: registered=1921                                                                                                                                                                                    
18:21:23-646529 DEBUG    FastAPI middleware: ['Middleware', 'Middleware']                                                                                                                                                                     
18:21:23-654766 DEBUG    Creating API                                                                                                                                                                                                         
18:21:24-258845 INFO     [AgentScheduler] Task queue is empty                                                                                                                                                                                 
18:21:24-261631 INFO     [AgentScheduler] Registering APIs                                                                                                                                                                                    
18:21:24-624356 DEBUG    Scripts setup: ['IP Adapters:0.137', 'XYZ Grid:0.119', 'Face:0.059', 'AnimateDiff:0.03', 'APG:0.006', 'CogVideoX:0.034', 'Ctrl-X:0.025', 'DemoFusion:0.012', 'HDR:0.017', 'K-Diffusion:6.325', 'Kohya HiRes          
                         Fix:0.009', 'LayerDiffuse:0.011', 'LUT Color grading:0.025', 'Mixture tiling:0.009', 'MuLan:0.005', 'Prompt enhance:0.015', 'Prompt matrix:0.015', 'Prompts from file:0.011', 'Regional prompting:0.009',            
                         'T-Gate:0.006', 'Text-to-Video:0.017', 'BLIP Diffusion:0.009', 'Differential diffusion:0.008', 'Image-to-Video:0.029', 'LEdits++:0.015', 'Loopback:0.008', 'SD upscale:0.007', 'Stable Video Diffusion:0.023']       
18:21:24-628695 DEBUG    Model metadata: file="metadata.json" no changes                                                                                                                                                                      
18:21:24-632303 DEBUG    Model requested: fn=run:<lambda>                                                                                                                                                                                     
18:21:24-636893 WARNING  Cannot generate without a checkpoint                                                                                                                                                                                 
18:21:24-638730 INFO     Set system paths to use existing folders                                                                                                                                                                             
18:21:24-640648 INFO       or use --models-dir <path-to-folder> to specify base folder with all models                                                                                                                                        
18:21:24-642656 INFO       or use --ckpt-dir <path-to-folder> to specify folder with sd models                                                                                                                                                
18:21:24-644791 INFO       or use --ckpt <path-to-checkpoint> to force using specific model                                                                                                                                                   
18:21:24-648421 DEBUG    Script callback init time: task_scheduler.py:ui_tabs=0.09 system-info.py:app_started=0.23 task_scheduler.py:app_started=0.41                                                                                         
18:21:24-651373 INFO     Startup time: 46.96 torch=7.49 gradio=1.53 diffusers=0.16 libraries=2.27 samplers=0.10 extensions=2.52 detailer=20.64 upscalers=0.15 ui-networks=0.55 ui-txt2img=6.66 ui-img2img=0.36 ui-control=0.59 ui-extras=0.16 
                         ui-models=0.15 ui-gallery=0.10 ui-settings=1.11 ui-extensions=0.26 ui-defaults=0.67 launch=0.36 api=0.33 app-started=0.65                                                                                            
18:21:24-660620 DEBUG    Save: file="config.json" json=21 bytes=868 time=0.013                                                                                                                                                                
18:21:59-700119 DEBUG    Server: alive=True jobs=1 requests=6 uptime=72 memory=1.04/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                                
18:23:22-012236 INFO     MOTD: N/A                                                                                                                                                                                                            
18:23:46-600912 DEBUG    UI themes available: type=Standard themes=12                                                                                                                                                                         18:23:53-256493 INFO     Browser session: user=None client=172.0.1.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.6422.76/77 Safari/537.36                                             
18:23:59-990142 DEBUG    Server: alive=True jobs=1 requests=94 uptime=192 memory=1.12/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                              
18:24:19-295977 DEBUG    Reference: download="Disty0/FLUX.1-dev-qint4" 
18:24:19-359189 DEBUG    Diffusers downloading: id="Disty0/FLUX.1-dev-qint4" args={'force_download': False, 'resume_download': True, 'cache_dir': '/storage/flux/models/Diffusers', 'load_connected_pipeline': True}                          
model_index.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 536/536 [00:00<00:00, 2.16MB/s]
text_encoder/config.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 613/613 [00:00<00:00, 2.43MB/s]
scheduler/scheduler_config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 273/273 [00:00<00:00, 879kB/s]
text_encoder_2/config.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 909/909 [00:00<00:00, 3.13MB/s]
tokenizer/special_tokens_map.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 588/588 [00:00<00:00, 3.09MB/s]
tokenizer/tokenizer_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 705/705 [00:00<00:00, 4.27MB/s]
tokenizer_2/tokenizer_config.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20.8k/20.8k [00:00<00:00, 31.5MB/s]
tokenizer_2/special_tokens_map.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.54k/2.54k [00:00<00:00, 8.12MB/s]
transformer/config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 535/535 [00:00<00:00, 2.03MB/s]
tokenizer/vocab.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.06M/1.06M [00:00<00:00, 1.52MB/s]
spiece.model: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 792k/792k [00:01<00:00, 782kB/s]
vae/config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 820/820 [00:00<00:00, 2.63MB/s]
tokenizer/merges.txt: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 525k/525k [00:01<00:00, 429kB/s]
tokenizer_2/tokenizer.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.42M/2.42M [00:03<00:00, 797kB/s]
diffusion_pytorch_model.safetensors: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 168M/168M [00:56<00:00, 2.98MB/s]
model.safetensors: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 246M/246M [01:10<00:00, 3.48MB/s]
Diffusers 20.88s/it ████▍                 22% 4/18 01:11 04:52 Fetching 18 files███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 246M/246M [01:10<00:00, 3.81MB/s1
8:26:00-126856 DEBUG    Server: alive=True jobs=2 requests=120 uptime=312 memory=1.24/44.49 backend=Backend.DIFFUSERS state=job="HuggingFace" 0/-1                                                                                           ]
model.safetensors:  15%|██████████████████████████                                                                                                                                                        | 398M/2.72G [01:38<06:31, 5.93MB/s1
8:28:00-271109 DEBUG    Server: alive=True jobs=2 requests=143 uptime=432 memory=1.24/44.49 backend=Backend.DIFFUSERS state=job="HuggingFace" 0/-1                                                                                            
model.safetensors:  41%|████████████████████████████████████████████████████████████████████████▏                                                                                                        | 1.11G/2.72G [03:39<04:19, 6.22MB/s1
8:30:00-410485 DEBUG    Server: alive=True jobs=2 requests=167 uptime=552 memory=1.25/44.49 backend=Backend.DIFFUSERS state=job="HuggingFace" 0/-1                                                                                           ]
model.safetensors:  68%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉                                                         | 1.85G/2.72G [05:38<02:34, 5.69MB/s1
8:31:59-550882 DEBUG    Server: alive=True jobs=2 requests=190 uptime=671 memory=1.26/44.49 backend=Backend.DIFFUSERS state=job="HuggingFace" 0/-1                                                                                           ]
model.safetensors: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.72G/2.72G [08:08<00:00, 5.58MB/s]
Diffusers 106.72s/it ██████▎              33% 6/18 08:08 21:20 Fetching 18 files                                                                                                                         | 1.11G/6.33G [03:36<14:35, 5.96MB/s1
8:33:59-694970 DEBUG    Server: alive=True jobs=2 requests=214 uptime=792 memory=1.26/44.49 backend=Backend.DIFFUSERS state=job="HuggingFace" 0/-1                                                                                           ]diffusion_pytorch_model.safetensors:  29%|██████████████████████████████████████████████                                                                                                                 | 1.84G/6.33G [05:38<11:54, 6.29MB/s1
8:35:59-845994 DEBUG    Server: alive=True jobs=2 requests=238 uptime=912 memory=1.26/44.49 backend=Backend.DIFFUSERS state=job="HuggingFace" 0/-1                                                                                            
diffusion_pytorch_model.safetensors: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 6.33G/6.33G [13:06<00:00, 8.05MB/s$
Diffusers 43.75s/it ███████████████████ 100% 18/18 13:07 00:00 Fetching 18 files                                                                                                                                                              
18:37:27-940933 DEBUG    Save: file="/storage/flux/models/Diffusers/models--Disty0--FLUX.1-dev-qint4/snapshots/82811df42b556a1153b971d8375d5170c306a6eb/model_info.json" json=12 bytes=214 time=0.001                                         
18:37:27-945456 DEBUG    Reference download complete: model="Disty0/FLUX.1-dev-qint4"                                                                                                                                                         
18:37:27-948584 DEBUG    Scanning diffusers cache: folder="/storage/flux/models/Diffusers" items=1 time=0.00                                                                                                                                  
18:37:27-951109 INFO     Available Models: path="/storage/flux/models/Stable-diffusion" items=1 time=0.00                                                                                                                                     
18:37:29-104481 DEBUG    HF login: no token provided                                                                                                                                                                                          
18:37:29-107163 INFO     HF search: model="Disty0/FLUX.1-dev-qint4" results=['Disty0/FLUX.1-dev-qint4']                                                                                                                                       
18:37:29-109506 INFO     Load model: select="Diffusers/Disty0/FLUX.1-dev-qint4 [82811df42b]"                                                                                                                                                  
18:37:29-114024 INFO     Autodetect model: detect="FLUX" class=FluxPipeline file="/storage/flux/models/Diffusers/models--Disty0--FLUX.1-dev-qint4/snapshots/82811df42b556a1153b971d8375d5170c306a6eb" size=0MB                                
18:37:29-123205 DEBUG    Load model: type=FLUX model="Diffusers/Disty0/FLUX.1-dev-qint4" repo="Disty0/FLUX.1-dev-qint4" unet="None" te="None" vae="Automatic" quant=qint4 offload=none dtype=torch.bfloat16                                   
18:37:29-126629 TRACE    Load model: type=FLUX config={'low_cpu_mem_usage': True, 'torch_dtype': torch.bfloat16, 'load_connected_pipeline': True, 'safety_checker': None, 'requires_safety_checker': False}                                   
18:37:29-129609 DEBUG    HF login: no token provided                                                                                                                                                                                          
18:37:29-131363 DEBUG    Quantization: type=quanto fn=load_flux:load_flux_quanto                                                                                                                                                              
18:37:29-133472 INFO     Install: package="optimum-quanto" mode=pip                                                                                                                                                                           
18:37:29-135358 DEBUG    Running: pip="install --upgrade optimum-quanto"                                                                                                                                                                      
18:37:36-681967 TRACE    Load model: type=FLUX quantization map="/storage/flux/models/Diffusers/models--Disty0--FLUX.1-dev-qint4/snapshots/82811df42b556a1153b971d8375d5170c306a6eb/transformer/quantization_map.json"                        
                         repo="Diffusers/Disty0/FLUX.1-dev-qint4" component="transformer"                                                                                                                                                     
transformer/quantization_map.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 42.9k/42.9k [00:00<00:00, 4.26MB/s]
18:38:00-382485 DEBUG    Server: alive=True jobs=2 requests=262 uptime=1032 memory=1.39/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                            
18:38:53-597782 TRACE    Load model: type=FLUX quantization map="/storage/flux/models/Diffusers/models--Disty0--FLUX.1-dev-qint4/snapshots/82811df42b556a1153b971d8375d5170c306a6eb/text_encoder_2/quantization_map.json"                     
                         repo="Diffusers/Disty0/FLUX.1-dev-qint4" component="text_encoder_2"                                                                                                                                                  
text_encoder_2/quantization_map.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15.1k/15.1k [00:00<00:00, 31.7MB/s]
18:39:08-440690 DEBUG    Load model: type=FLUX preloaded=['transformer', 'text_encoder_2']                                                                                                                                                    
Diffusers  4.80it/s ████████ 100% 7/7 00:01 00:00 Loading pipeline components...                                                                                                                                                              
18:39:10-163326 TRACE    Model components: [<Parameter "scheduler: diffusers.schedulers.scheduling_flow_match_euler_discrete.FlowMatchEulerDiscreteScheduler">, <Parameter "vae: diffusers.models.autoencoders.autoencoder_kl.AutoencoderKL">,
                         <Parameter "text_encoder: transformers.models.clip.modeling_clip.CLIPTextModel">, <Parameter "tokenizer: transformers.models.clip.tokenization_clip.CLIPTokenizer">, <Parameter "text_encoder_2:                     
                         transformers.models.t5.modeling_t5.T5EncoderModel">, <Parameter "tokenizer_2: transformers.models.t5.tokenization_t5_fast.T5TokenizerFast">, <Parameter "transformer:                                                
                         diffusers.models.transformers.transformer_flux.FluxTransformer2DModel">]                                                                                                                                             18:39:10-168367 INFO     Load network: type=embeddings loaded=0 skipped=0 time=0.00                                                                                                                                                           
18:39:10-170788 DEBUG    Setting model: component=VAE slicing=True                                                                                                                                                                            
18:39:10-173032 DEBUG    Setting model: attention="Scaled-Dot-Product"                                                               
18:39:10-227079 DEBUG    Setting model: offload=none                                                                                                                                                                                          
18:40:00-061280 DEBUG    Server: alive=True jobs=2 requests=286 uptime=1152 memory=16.97/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                           
18:42:00-202434 DEBUG    Server: alive=True jobs=2 requests=310 uptime=1272 memory=16.94/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                           
18:44:00-381820 DEBUG    Server: alive=True jobs=2 requests=334 uptime=1392 memory=16.94/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                           
18:45:59-508502 DEBUG    Server: alive=True jobs=2 requests=358 uptime=1511 memory=17.02/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                           
18:47:59-640472 DEBUG    Server: alive=True jobs=2 requests=382 uptime=1632 memory=17.07/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                           
18:49:59-765429 DEBUG    Server: alive=True jobs=2 requests=406 uptime=1752 memory=17.08/44.49 backend=Backend.DIFFUSERS state=idle                                                                                                           
18:51:59-955587 DEBUG    Server: alive=True jobs=2 requests=430 uptime=1872 memory=17.23/44.49 backend=Backend.DIFFUSERS state=idle
...

[vladmandic]

duplicate of #3484