Will multi-GPU support be available in the future?

[skytodmoon]

I have 8 3090 card, how to allocate automaticaly?

[andimarafioti]

Hi! The use-case with multi-GPU is interesting if we allow several clients to connect with one server. It's one of the ideas that we have for the future of this library but it's not clear when we would work on it. If you just need multi-gpu support, the changes needed are probably not very large (some device here and there). Would you like to tackle that?