Intel ARC

Notes

GPU Support with IPEX and SD.Next

• Intel ARC Series
• Intel Flex Series
• Intel Max Series

iGPUs are not supported with IPEX, use OpenVINO with iGPUs.

Benchmarks for Intel ARC A770: https://github.com/vladmandic/automatic/wiki/Benchmark#intel-arc

Data Types

BF16 is faster than FP16 in general.

8 bit for storing model weights is supported.
Enable Compress Model weights to 8 bit with NNCF in Compute Settings to use 8 bit.

Backend:

Diffusers backend is 10%-25% faster than the original backend.

Errors with iGPU:

Disable your iGPU (if any, e.g. UHD or Iris Xe) in the device manager.

Errors with ipexrun on Linux

If you get random errors at the startup, it's probably from ipexrun.
Export DISABLE_IPEXRUN=1 to disable ipexrun.

Windows Installation

Preparations

• Install Intel GPU Driver.
• Install Git.
• Install Python 3.10 or 3.11.
• Open CMD in a folder you want to install SD.Next.

Using SD.Next

Install SD.Next from Github:

git clone https://github.com/vladmandic/automatic

Then enter into the automatic folder:

cd automatic

Then start WebUI with this command:

.\webui.bat --use-ipex

Note: It will install the necessary libraries at the first run so it will take a while depending on your internet.

Linux and WSL Installation

Install Intel Compute Runtime

Ubuntu

Use Ubuntu 23.04 or newer because we will need Linux 6.2 kernel or newer.

Update your kernel to at least Linux 6.2 if you are on older Ubuntu builds.

Note: Updating kernel is not neccesary for WSL.

Then add the package lists for Intel Level Zero Drivers:

sudo apt update && sudo apt install -y ca-certificates wget gpg

wget -qO - https://repositories.intel.com/gpu/intel-graphics.key | sudo gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg

echo "deb [arch=amd64,i386 signed-by=/usr/share/keyrings/intel-graphics.gpg] https://repositories.intel.com/gpu/ubuntu jammy client" | sudo tee /etc/apt/sources.list.d/intel-gpu-jammy.list

sudo apt update && sudo apt upgrade -y

Then install the necessary packages:

sudo apt-get install intel-opencl-icd intel-level-zero-gpu level-zero git python3-pip python3-venv libgl1 libglib2.0-0 libgomp1 libjemalloc-dev

Arch Linux

Install the necessary packages for Arch Linux:

pacman -S intel-compute-runtime level-zero-headers level-zero-loader git python-pip python-virtualenv jemalloc

Using SD.Next

Install SD.Next from Github:

git clone https://github.com/vladmandic/automatic

Then enter into the automatic folder:

cd automatic

Then start WebUI with this command:

./webui.sh --use-ipex

Note: It will install the necessary libraries at the first run so it will take a while depending on your internet.