Pytorch 2.0, Cuda 11.8 and future 12.0 & 12.1 compatible #4868

johnnynunez · 2023-03-18T23:09:38Z

I have been able to compile with CUDA 11.8 and CUDA 12.0 & 12.1 using PyTorch 1.13.1, PyTorch dev 2.0 and python 3.10.6(In local)

johnnynunez · 2023-03-19T01:03:05Z

@ppwwyyxx @wat3rBro @thiagocrepaldi Now, the changes is clearer.

gianscarpe · 2023-04-03T11:29:51Z

Up

LeonidAlekseev · 2023-04-05T03:20:54Z

up

CanKorkut · 2023-04-06T14:39:50Z

up

elvizlai · 2023-04-10T11:06:21Z

PTAL

wadhah101 · 2023-05-03T14:36:00Z

Why this PR is not merged yet ? The current pytorch has some serious vulnerabilities

wqh17101 · 2023-05-16T07:35:43Z

Please merge it in.

johnnynunez · 2023-06-16T13:50:17Z

Great work!
Are there any known backward incompatibilities (requiring reconfiguration or retraining)?
Are you perhaps also going to address any of the following?

INSTALL.md: update table of prebuilt wheels

docker/Dockerfile: update versions, maybe drop nvidia/cuda base image (as Pytorch does not use apt packages for CUDA and cuDNN anyway)

setup.py treats torch as a setup-time dependency #4472 (i.e. fixing source distribution for platforms not covered by wheels, and adding torch as an overt dependency)

I'm not from Meta so I don't have access from links. But I updated the Install.md. @ppwwyyxx @facebook-github-bot merge it. It generates artifacts from macOS, Linux automatically.

Why do you need docker here? It should be in another PR

do you mean this?

bertsky · 2023-06-16T14:22:25Z

Why do you need docker here? It should be in another PR

Yes, maybe off-topic. But if it's not too much work, would be great to update as well (currently trying myself, will perhaps make a differential PR)

do you mean this?

Not quite. Since Pytorch (esp. the CUDA releases) may need a different index, and the dependency_links mechanism of setuptools has been dropped for good, I don't know how to cover this correctly. But in the very least, one would need to avoid the import torch statements further up in setup.py.

johnnynunez · 2023-06-16T15:58:12Z

for cuda releases you need extra index url

--extra-index-url https://download.pytorch.org/whl/cu118
onnx==1.14.0
torch==2.0.1+cu118; sys_platform != 'darwin'
torch==2.0.1; sys_platform == 'darwin'
onnxruntime==1.15.0; sys_platform == 'darwin' and platform_machine != 'arm64'
onnxruntime-silicon==1.13.1; sys_platform == 'darwin' and platform_machine == 'arm64'
onnxruntime-gpu==1.15.0; sys_platform != 'darwin'

ZekunZh · 2023-07-18T09:42:29Z

Up, @ppwwyyxx could you please approve and merge this PR ?

janzd · 2023-08-09T20:35:24Z

Could you please explain how to install using your wheels? Or if you have any installation instructions anywhere, could you send a link to it?

johnnynunez · 2023-08-09T21:29:13Z

Could you please explain how to install using your wheels? Or if you have any installation instructions anywhere, could you send a link to it?

download it and pip install name.whl

danieltudosiu · 2023-09-06T10:14:10Z

Any update on this?

lijain · 2024-01-19T08:56:53Z

mac6894 · 2024-01-20T08:40:54Z

hi, I am using Ubuntu 22.04, CUDA 12.3, and would like to install detectron2. I did "python3 -m pip install 'git+https://github.com/johnnynunez/detectron2.git' ", but, I still get this runtime error:

"RuntimeError:
The detected CUDA version (12.3) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.

  [end of output]"

Do you know how I can fix this? Thanks.

johnnynunez · 2024-01-20T08:56:48Z

hi, I am using Ubuntu 22.04, CUDA 12.3, and would like to install detectron2. I did "python3 -m pip install 'git+https://github.com/johnnynunez/detectron2.git' ", but, I still get this runtime error:

"RuntimeError: The detected CUDA version (12.3) mismatches the version that was used to compile PyTorch (11.7). Please make sure to use the same CUDA versions.
  [end of output]"
Do you know how I can fix this? Thanks.

First install pytorch:

pip3 install -U torch torchvision torchaudio

CQHofsns · 2024-07-09T17:23:21Z

Hi @johnnynunez

I am using Ubuntu server, CUDA 12.2, torch-2.3.1 torchaudio-2.3.1 torchvision-0.18.1. However, when I try to follow the guide in the installation tutorial I get this error:

Collecting git+https://github.com/facebookresearch/detectron2.git
Cloning https://github.com/facebookresearch/detectron2.git to /tmp/pip-req-build-eb1t5q_j
Running command git clone --filter=blob:none --quiet https://github.com/facebookresearch/detectron2.git /tmp/pip-req-build-eb1t5q_j
Resolved https://github.com/facebookresearch/detectron2.git to commit 70f4543
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [20 lines of output]
Traceback (most recent call last):
File "/path/to/project/.env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
main()
File "/path/to/project/env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/path/to/project/.env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 327, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=[])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 297, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 497, in run_setup
super().run_setup(setup_script=setup_script)
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 313, in run_setup
exec(code, locals())
File "", line 10, in
ModuleNotFoundError: No module named 'torch'
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

Does this mean Detectron not work on CUDA 12.2? Is there any workaround?

Thanks

johnnynunez · 2024-07-10T13:17:04Z

Hi @johnnynunez

I am using Ubuntu server, CUDA 12.2, torch-2.3.1 torchaudio-2.3.1 torchvision-0.18.1. However, when I try to follow the guide in the installation tutorial I get this error:

Collecting git+https://github.com/facebookresearch/detectron2.git
Cloning https://github.com/facebookresearch/detectron2.git to /tmp/pip-req-build-eb1t5q_j
Running command git clone --filter=blob:none --quiet https://github.com/facebookresearch/detectron2.git /tmp/pip-req-build-eb1t5q_j
Resolved https://github.com/facebookresearch/detectron2.git to commit 70f4543
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [20 lines of output]
Traceback (most recent call last):
File "/path/to/project/.env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
main()
File "/path/to/project/env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/path/to/project/.env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 327, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=[])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 297, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 497, in run_setup
super().run_setup(setup_script=setup_script)
File "/tmp/pip-build-env-2qctbu22/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 313, in run_setup
exec(code, locals())
File "", line 10, in
ModuleNotFoundError: No module named 'torch'
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.

Does this mean Detectron not work on CUDA 12.2? Is there any workaround?

Thanks

it is working, you only have to compile it

nitinmukesh · 2024-10-15T09:26:24Z

I am trying to download wheel for Windows
https://dl.fbaipublicfiles.com/detectron2/wheels/cu117/torch1.13.1/index.html

Coming with Access denied error

oximi123 · 2025-01-10T08:11:00Z

Could you please explain how to install using your wheels? Or if you have any installation instructions anywhere, could you send a link to it?

download it and pip install name.whl

Hi, where is the link for downloading your wheel? Thanks!

init

e350b60

facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 18, 2023

johnnynunez added 7 commits March 19, 2023 00:26

updating

2e9f74c

artifacts circleci

1f8e149

artifacts circleci

185e377

artifacts circleci

ee1804f

fix python circleci

7a95502

fix python circleci

d4ad6d2

update workflow github actions

2509466

update workflow github actions

8bc3926

This was referenced Mar 20, 2023

The latest release is 2021, this year is 2023, why not release new version? #4859

Open

Pytorch 2.0, Cuda 11.8 and future 12.0 & 12.1 compatible #4740

Closed

johnnynunez and others added 4 commits March 26, 2023 11:35

Merge branch 'main' into main

17822c8

Update build-wheels.yml

49a24e6

updated cache

fbc0a48

Merge branch 'main' into main

3b22eb3

Merge branch 'main' into main

4bcc304

Merge branch 'main' into main

66b8066

johnnynunez mentioned this pull request Apr 11, 2023

Wheels for torch 2.0 #4901

Open

johnnynunez added 3 commits April 11, 2023 21:34

Merge branch 'main' into main

543b208

Merge branch 'main' into main

525867a

Merge branch 'main' into main

c43b03a

Merge branch 'main' into main

2b1f84e

try

dac7929

johnnynunez closed this Jun 16, 2023

johnnynunez reopened this Jun 16, 2023

johnnynunez and others added 7 commits June 16, 2023 18:01

upgrade minimum pytorch by security

99efa22

upgrade minimum pytorch by security

b5dfdef

Merge branch 'main' into main

6873034

Merge branch 'main' into main

9077ab9

Merge branch 'main' into main

1ee975b

wheels

80747a9

Merge branch 'main' into main

7c9af57

Merge branch 'main' into main

fb54a4d

ldorigo mentioned this pull request Aug 18, 2023

Installing detectron2 errors out ("ModuleNotFoundError: No module named 'torch' even though torch is part of the environment) python-poetry/poetry#8330

Closed

4 tasks

johnnynunez added 2 commits August 23, 2023 17:44

Merge branch 'main' into main

7091cd6

Merge branch 'main' into main

7755101

Merge branch 'main' into main

ee8a854

johnnynunez closed this by deleting the head repository Sep 22, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Pytorch 2.0, Cuda 11.8 and future 12.0 & 12.1 compatible #4868

Pytorch 2.0, Cuda 11.8 and future 12.0 & 12.1 compatible #4868

johnnynunez commented Mar 18, 2023

johnnynunez commented Mar 19, 2023

gianscarpe commented Apr 3, 2023

LeonidAlekseev commented Apr 5, 2023

CanKorkut commented Apr 6, 2023

elvizlai commented Apr 10, 2023

wadhah101 commented May 3, 2023

wqh17101 commented May 16, 2023

johnnynunez commented Jun 16, 2023

bertsky commented Jun 16, 2023

johnnynunez commented Jun 16, 2023 •

edited

Loading

ZekunZh commented Jul 18, 2023

janzd commented Aug 9, 2023

johnnynunez commented Aug 9, 2023

danieltudosiu commented Sep 6, 2023

lijain commented Jan 19, 2024

mac6894 commented Jan 20, 2024

johnnynunez commented Jan 20, 2024

CQHofsns commented Jul 9, 2024

johnnynunez commented Jul 10, 2024

nitinmukesh commented Oct 15, 2024

oximi123 commented Jan 10, 2025

Pytorch 2.0, Cuda 11.8 and future 12.0 & 12.1 compatible #4868

Pytorch 2.0, Cuda 11.8 and future 12.0 & 12.1 compatible #4868

Conversation

johnnynunez commented Mar 18, 2023

johnnynunez commented Mar 19, 2023

gianscarpe commented Apr 3, 2023

LeonidAlekseev commented Apr 5, 2023

CanKorkut commented Apr 6, 2023

elvizlai commented Apr 10, 2023

wadhah101 commented May 3, 2023

wqh17101 commented May 16, 2023

johnnynunez commented Jun 16, 2023

bertsky commented Jun 16, 2023

johnnynunez commented Jun 16, 2023 • edited Loading

ZekunZh commented Jul 18, 2023

janzd commented Aug 9, 2023

johnnynunez commented Aug 9, 2023

danieltudosiu commented Sep 6, 2023

lijain commented Jan 19, 2024

mac6894 commented Jan 20, 2024

johnnynunez commented Jan 20, 2024

CQHofsns commented Jul 9, 2024

johnnynunez commented Jul 10, 2024

nitinmukesh commented Oct 15, 2024

oximi123 commented Jan 10, 2025

johnnynunez commented Jun 16, 2023 •

edited

Loading