0.3.1 #862 new build failure, stop at mistralrs-quant

[misureaudio]

Minimum reproducible example

cargo build --release --features cuda

Error

error: failed to run custom build command for mistralrs-quant v0.3.1 (C:\Users\misur\Desktop\rustsrc\mistral.rs.0.3.1.0862\mistralrs-quant)

Caused by:
process didn't exit successfully: C:\Users\misur\Desktop\rustsrc\mistral.rs.0.3.1.0862\target\release\build\mistralrs-quant-a5b0a5658b3f8319\build-script-build (exit code: 101)
--- stdout
cargo:rerun-if-changed=build.rs
cargo:rerun-if-changed=kernels/gptq/q_gemm.cu
cargo:rerun-if-changed=kernels/hqq/hqq.cu
cargo:rerun-if-changed=kernels/ops/ops.cu
cargo:rerun-if-changed=kernels/marlin/marlin_kernel.cu
cargo:info=["/usr", "/usr/local/cuda", "/opt/cuda", "/usr/lib/cuda", "C:/Program Files/NVIDIA GPU Computing Toolkit", "C:/CUDA"]
cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP
cargo:rustc-env=CUDA_COMPUTE_CAP=75

Other information

Please specify:
Windows 11

• GPU or accelerator information
  nvcc: NVIDIA (R) Cuda compiler driver
  Copyright (c) 2005-2024 NVIDIA Corporation
  Built on Wed_Apr_17_19:36:51_Pacific_Daylight_Time_2024
  Cuda compilation tools, release 12.5, V12.5.40
  Build cuda_12.5.r12.5/compiler.34177558_0

Sat Oct 19 14:49:11 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.90 Driver Version: 565.90 CUDA Version: 12.7 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce GTX 1650 ... WDDM | 00000000:01:00.0 Off | N/A |
| N/A 46C P8 3W / 40W | 0MiB / 4096MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+

Latest commit or version

0.3.1 #862

[misureaudio]

No problem in building #820

#862 build on one of my Win11 laptops, all relevant libs and sw on disk C:
#862 doesn't build on a second laptop, having CUDA toolkit on D:, however all preceding #xxx are built ok.
#862 doesn't build on a third laptop, with all relevant lib and sw on C:

[misureaudio]

BTW, #859 (pre metal fix) compiled with no issue.

[gfxenjoyer]

kernels/marlin/marlin_kernel.cu fails to compile on --gpu-architecture=sm_75. Seems to work fine for 80, 86, 89, and 90.
I manually tested by setting $env:CUDA_COMPUTE_CAP="75".

[misureaudio]

Fine on a Quadro A2000, CI 86

[misureaudio]

OK on 4070 laptop. CI 89,
No go on GTX1650 CI 75
No go on GTX1070 CI 61

[DenisBobrovskiy]

Pretty sure it is caused by Marlin kernel support that was added in #856 Try falling back to #848 . Marlin kernels are built for Compute Capability of 8+