Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AMD GPU support for CNN mode #965

Open
wherron01 opened this issue Oct 27, 2024 · 1 comment
Open

AMD GPU support for CNN mode #965

wherron01 opened this issue Oct 27, 2024 · 1 comment

Comments

@wherron01
Copy link

With ROCm/HIP in newer Radeon cards, AMD is a capable neural network platform. Howdy's implementation of cuDNN locks AMD users out of the much more capable CNN mode. AMD has several compatibility layers published for translating between CUDA and ROCm, notably hipDNN for cuDNN, which should facilitate the implementation of CNN mode on Raedon cards. My Radeon card is capable of running neural network based applications such as Stable Diffusion with relative ease, so I expect it would not struggle running Howdy. However, installing compatibilitly layers (notably zluda) on my end has not enabled support for Howdy's CNN mode, as no 1:1 layers I could find currently support cuDNN. hipDNN, as far as I can tell, supports the same calls cuDNN does, but in a different namespace, so it should be relatively simple to translate.

@wherron01
Copy link
Author

After further inspection, it seems this is probably a dlib issue, rather than a Howdy issue. Unless Howdy devs want to switch from dlib (seems unwise), this probably can't be implemented without support from dlib devs (who have expressed disinterest in AMD support). I won't close in case it's still something that could be pursued, but feel free to close if it can't be.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant