Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

simply change __init__.py, add onnxruntime with dml support. #3045

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

FNsi
Copy link

@FNsi FNsi commented Oct 28, 2024

switch Non-NVIDIA onnx version from CPU to directml version to support whatever GPU in windows,
Screenshot 2024-10-28 155759
which could handle CPU inference too.
Screenshot 2024-10-28 155346

@zelenooki87
Copy link

Just wanted to test directml performance versus CUDA.
Have Nvidia GPU. Unfortunately, for me, Directml is not listed. I have built chainner by following your commit and npm.

@FNsi
Copy link
Author

FNsi commented Nov 4, 2024

Just wanted to test directml performance versus CUDA.

Have Nvidia GPU. Unfortunately, for me, Directml is not listed. I have built chainner by following your commit and npm.

Nice! The reason for dml is unlimited vram, throw a 4K picture without tiling in iGPU!

Update:
😅To clarify, try onnx-dml only needed with onnxruntime-directml installed because current script will automatically looking for "provider"

That means, you don't need to build from my source,

just using system python, simply run

pip install onnxruntime-directml

Could enable the ability to function dml.

@zelenooki87
Copy link

Script working okay. No need to modify. Directml working, this is super helpful for folks with AMD cards.

@FNsi
Copy link
Author

FNsi commented Nov 6, 2024

Script working okay. No need to modify. Directml working, this is super helpful for folks with AMD cards.

That would be fine.

No much clue since my last nv burned years ago🤣

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants