Running SDXL on 48GB VRAM need Speed UP

[ruichang555]

Running SD A1111 (v1.10.1) on RTX A6000. Loaded XL checkpoint (realvisxlv40_v20Bakedvae), ControlNet XL ip-(adaptor-plus-sdxl-vit-h) to process 1080 x 1920 images. Using --xformer and --medvram, live preview disabled. Batch sizee=4, Batch count=1 (but I do enabled "Batch Loopback"-since my batch count=1, it shouldn't do anything?) Not using Loopback in Script. GPU temp is 81 Celsius.

But I can tell ya A6000 is not impressively fast. It's about 12-14s/it. I wonder if anyone know how to speed it up further. Maybe need more tweak to unleash the full power?

+++++Further Info+++++
After I dig more threads, there was an excellent discussion on speed up RTX 4000s card.
#6954

But there was not much info on speeding up RTX A6000 with Cuda12 installed. Here are real-time run report. Shall I still copy the dlls in that Zip to mt /torch/lib?

Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.10.1
Commit hash: 82a973c
Installing requirements
current transparent-background 1.3.2
Installing sd-webui-controlnet requirement: changing opencv-python version from 4.7.0.72 to 4.8.0
CUDA 12.1
Requirement already satisfied: insightface==0.7.3 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from -r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (0.7.3)
Requirement already satisfied: onnx==1.14.0 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from -r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: onnxruntime==1.15.0 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from -r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (1.15.0)
Collecting opencv-python==4.7.0.72 (from -r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 4))
Using cached opencv_python-4.7.0.72-cp37-abi3-win_amd64.whl.metadata (18 kB)
Requirement already satisfied: ifnude in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from -r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 5)) (0.0.3)
Requirement already satisfied: cython in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from -r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 6)) (3.0.11)
Requirement already satisfied: numpy in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.26.2)
Requirement already satisfied: tqdm in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (4.66.5)
Requirement already satisfied: requests in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (2.32.3)
Requirement already satisfied: matplotlib in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.9.2)
Requirement already satisfied: Pillow in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (9.5.0)
Requirement already satisfied: scipy in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.14.1)
Requirement already satisfied: scikit-learn in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.5.1)
Requirement already satisfied: scikit-image in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (0.21.0)
Requirement already satisfied: easydict in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.13)
Requirement already satisfied: albumentations in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.4.3)
Requirement already satisfied: prettytable in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.11.0)
Collecting protobuf>=3.20.2 (from onnx==1.14.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 2))
Using cached protobuf-5.28.0-cp310-abi3-win_amd64.whl.metadata (592 bytes)
Requirement already satisfied: typing-extensions>=3.6.2.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from onnx==1.14.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 2)) (4.12.2)
Requirement already satisfied: coloredlogs in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (15.0.1)
Requirement already satisfied: flatbuffers in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (24.3.25)
Requirement already satisfied: packaging in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (23.2)
Requirement already satisfied: sympy in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (1.13.2)
Requirement already satisfied: opencv-python-headless>=4.5.1.48 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from ifnude->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 5)) (4.10.0.84)
Requirement already satisfied: PyYAML in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from albumentations->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (6.0.2)
Requirement already satisfied: networkx>=2.8 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.3)
Requirement already satisfied: imageio>=2.27 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (2.35.1)
Requirement already satisfied: tifffile>=2022.8.12 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (2024.8.24)
Requirement already satisfied: PyWavelets>=1.1.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.7.0)
Requirement already satisfied: lazy_loader>=0.2 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (0.4)
Requirement already satisfied: joblib>=1.2.0 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-learn->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.4.2)
Requirement already satisfied: threadpoolctl>=3.1.0 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from scikit-learn->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.5.0)
Requirement already satisfied: humanfriendly>=9.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from coloredlogs->onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (10.0)
Requirement already satisfied: contourpy>=1.0.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.2.1)
Requirement already satisfied: cycler>=0.10 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (4.53.1)
Requirement already satisfied: kiwisolver>=1.3.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.1.4)
Requirement already satisfied: python-dateutil>=2.7 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (2.9.0.post0)
Requirement already satisfied: wcwidth in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from prettytable->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (0.2.13)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from requests->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from requests->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (3.8)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from requests->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (2.2.2)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from requests->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (2024.7.4)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from sympy->onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (1.3.0)
Requirement already satisfied: colorama in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from tqdm->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: pyreadline3 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from humanfriendly>=9.1->coloredlogs->onnxruntime==1.15.0->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 3)) (3.4.1)
Requirement already satisfied: six>=1.5 in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (from python-dateutil>=2.7->matplotlib->insightface==0.7.3->-r C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-roop\requirements.txt (line 1)) (1.16.0)
Using cached opencv_python-4.7.0.72-cp37-abi3-win_amd64.whl (38.2 MB)
Using cached protobuf-5.28.0-cp310-abi3-win_amd64.whl (431 kB)
Installing collected packages: protobuf, opencv-python
Attempting uninstall: protobuf
Found existing installation: protobuf 3.20.0
Uninstalling protobuf-3.20.0:
Successfully uninstalled protobuf-3.20.0
Attempting uninstall: opencv-python
Found existing installation: opencv-python 4.10.0.84
Uninstalling opencv-python-4.10.0.84:
Successfully uninstalled opencv-python-4.10.0.84
Successfully installed opencv-python-4.7.0.72 protobuf-5.28.0
Launching Web UI with arguments: --xformers --medvram
[-] ADetailer initialized. version: 24.9.0, num models: 10
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
ControlNet preprocessor location: C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-controlnet\annotator\downloads
2024-09-02 22:27:50,373 - ControlNet - INFO - ControlNet v1.1.455
Requirement already satisfied: toolz in c:\users\user\desktop\sd.webui\system\python\lib\site-packages (0.12.1)
sd-webui-prompt-all-in-one background API service started successfully.
22:27:52 - ReActor - STATUS - Running v0.7.1-a2 on Device: CUDA
2024-09-02 22:27:53,141 - roop - INFO - roop v0.0.2
2024-09-02 22:27:53,166 - roop - INFO - roop v0.0.2
[ControlNet-Travel] extension Mikubill/sd-webui-controlnet found, ControlNet-Travel loaded :)
Loading weights [74dda471cc] from C:\Users\User\Desktop\sd.webui\webui\models\Stable-diffusion\realvisxlV40_v20Bakedvae.safetensors
Creating model from config: C:\Users\User\Desktop\sd.webui\webui\repositories\generative-models\configs\inference\sd_xl_base.yaml
Applying attention optimization: xformers... done.
Model loaded in 17.1s (load weights from disk: 0.7s, create model: 2.4s, apply weights to model: 6.6s, apply half(): 0.1s, calculate empty prompt: 7.2s).
2024-09-02 22:28:11,527 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch().
Startup time: 65.6s (prepare environment: 27.3s, import torch: 3.9s, import gradio: 1.2s, setup paths: 1.2s, initialize shared: 2.0s, other imports: 0.8s, load scripts: 6.0s, scripts before_ui_callback: 0.5s, create ui: 20.1s, gradio launch: 1.6s, app_started_callback: 0.8s).
2024-09-02 22:32:15,421 - ControlNet - INFO - Preview Resolution = 1920
2024-09-02 22:32:15,421 - ControlNet - INFO - ip-adapter-auto => ip-adapter_clip_h
Starting job task(lyuq9l9hufqa290)
INFO:modules.shared_state:Starting job task(lyuq9l9hufqa290)

Inpaint batch is enabled. 3 masks found.
Will process 3 images, creating 4 new images for each.
2024-09-02 22:33:19,097 - ControlNet - INFO - unit_separate = False, style_align = True
2024-09-02 22:33:19,371 - ControlNet - INFO - Loading model: ip-adapter-plus_sdxl_vit-h [bc449f62]
2024-09-02 22:33:19,458 - ControlNet - INFO - Loaded state_dict from [C:\Users\User\Desktop\sd.webui\webui\extensions\sd-webui-controlnet\models\ip-adapter-plus_sdxl_vit-h.safetensors]
2024-09-02 22:33:21,331 - ControlNet - INFO - ControlNet model ip-adapter-plus_sdxl_vit-h bc449f62 loaded.
2024-09-02 22:33:21,336 - ControlNet - INFO - Using preprocessor: ip-adapter-auto
2024-09-02 22:33:21,336 - ControlNet - INFO - preprocessor resolution = 1920
2024-09-02 22:33:21,337 - ControlNet - INFO - ip-adapter-auto => ip-adapter_clip_h
2024-09-02 22:33:21,399 - ControlNet - INFO - IP-Adapter using advanced weighting [0.0, 0.0, 0.0, 0.5, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
2024-09-02 22:33:24,852 - ControlNet - INFO - ControlNet Hooked - Time = 5.762352466583252
100%|██████████████████████████████████████████████████████████████████████████████████| 40/40 [09:34<00:00, 14.36s/it]
2024-09-02 22:43:33,834 - ControlNet - INFO - unit_separate = False, style_align = True 40/120 [09:17<19:05, 14.32s/it]
2024-09-02 22:43:33,835 - ControlNet - INFO - Loading model from cache: ip-adapter-plus_sdxl_vit-h [bc449f62]
2024-09-02 22:43:33,838 - ControlNet - INFO - Using preprocessor: ip-adapter-auto
2024-09-02 22:43:33,838 - ControlNet - INFO - preprocessor resolution = 1920
2024-09-02 22:43:33,839 - ControlNet - INFO - IP-Adapter using advanced weighting [0.0, 0.0, 0.0, 0.5, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
2024-09-02 22:43:33,936 - ControlNet - INFO - ControlNet Hooked - Time = 0.10921502113342285
100%|██████████████████████████████████████████████████████████████████████████████████| 40/40 [09:22<00:00, 14.06s/it]
2024-09-02 22:53:08,790 - ControlNet - INFO - unit_separate = False, style_align = True 80/120 [18:53<09:25, 14.14s/it]
2024-09-02 22:53:08,790 - ControlNet - INFO - Loading model from cache: ip-adapter-plus_sdxl_vit-h [bc449f62]
2024-09-02 22:53:08,794 - ControlNet - INFO - Using preprocessor: ip-adapter-auto
2024-09-02 22:53:08,794 - ControlNet - INFO - preprocessor resolution = 1920
2024-09-02 22:53:08,795 - ControlNet - INFO - IP-Adapter using advanced weighting [0.0, 0.0, 0.0, 0.5, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
2024-09-02 22:53:08,895 - ControlNet - INFO - ControlNet Hooked - Time = 0.1121377944946289
100%|██████████████████████████████████████████████████████████████████████████████████| 40/40 [09:24<00:00, 14.10s/it]
Total progress: 100%|████████████████████████████████████████████████████████████████| 120/120 [28:38<00:00, 14.32s/it]
Ending job 3 out of 3 (1766.75 seconds)██████████████████████████████████████████████| 120/120 [28:38<00:00, 13.74s/it]
INFO:modules.shared_state:Ending job 3 out of 3 (1766.75 seconds)
Starting job task(7x7xxkckemjhqcr)
INFO:modules.shared_state:Starting job task(7x7xxkckemjhqcr)