Need `libnvcuvid.so` in CUDA wheel buidling job

[NicolasHug]

Opening this issue as requested by @atalman .

We'll need to take a build-time dependency on libnvcuvid.so, but it's currently not available on the CI runner that build the wheel. I suspect we'll have to install nvidia-driver somehow, but I'm unclear on what the recommended way is to do that on test-infra.

cc @tinglvv @nWEIdia

[atalman]

Looks like the libnvcuvid.so is not installed on Manylinux builder image with cuda-toolkit, however installed with nvidia-driver :

 ls usr/local/cuda/lib64/libcu*
usr/local/cuda/lib64/libcublasLt.so				 usr/local/cuda/lib64/libcudnn_engines_runtime_compiled_static_v9.a  usr/local/cuda/lib64/libcufile.so
usr/local/cuda/lib64/libcublasLt.so.12				 usr/local/cuda/lib64/libcudnn_graph.so				     usr/local/cuda/lib64/libcufile.so.0
usr/local/cuda/lib64/libcublasLt.so.12.8.4.1			 usr/local/cuda/lib64/libcudnn_graph.so.9			     usr/local/cuda/lib64/libcufile.so.1.13.1
usr/local/cuda/lib64/libcublasLt_static.a			 usr/local/cuda/lib64/libcudnn_graph.so.9.8.0			     usr/local/cuda/lib64/libcufile_static.a
usr/local/cuda/lib64/libcublas.so				 usr/local/cuda/lib64/libcudnn_graph_static.a			     usr/local/cuda/lib64/libcufilt.a
usr/local/cuda/lib64/libcublas.so.12				 usr/local/cuda/lib64/libcudnn_graph_static_v9.a		     usr/local/cuda/lib64/libcuinj64.so
usr/local/cuda/lib64/libcublas.so.12.8.4.1			 usr/local/cuda/lib64/libcudnn_heuristic.so			     usr/local/cuda/lib64/libcuinj64.so.12.8
usr/local/cuda/lib64/libcublas_static.a				 usr/local/cuda/lib64/libcudnn_heuristic.so.9			     usr/local/cuda/lib64/libcuinj64.so.12.8.90
usr/local/cuda/lib64/libcudadevrt.a				 usr/local/cuda/lib64/libcudnn_heuristic.so.9.8.0		     usr/local/cuda/lib64/libculibos.a
usr/local/cuda/lib64/libcudart.so				 usr/local/cuda/lib64/libcudnn_heuristic_static.a		     usr/local/cuda/lib64/libcurand.so
usr/local/cuda/lib64/libcudart.so.12				 usr/local/cuda/lib64/libcudnn_heuristic_static_v9.a		     usr/local/cuda/lib64/libcurand.so.10
usr/local/cuda/lib64/libcudart.so.12.8.90			 usr/local/cuda/lib64/libcudnn_ops.so				     usr/local/cuda/lib64/libcurand.so.10.3.9.90
usr/local/cuda/lib64/libcudart_static.a				 usr/local/cuda/lib64/libcudnn_ops.so.9				     usr/local/cuda/lib64/libcurand_static.a
usr/local/cuda/lib64/libcudnn_adv.so				 usr/local/cuda/lib64/libcudnn_ops.so.9.8.0			     usr/local/cuda/lib64/libcusolver_lapack_static.a
usr/local/cuda/lib64/libcudnn_adv.so.9				 usr/local/cuda/lib64/libcudnn_ops_static.a			     usr/local/cuda/lib64/libcusolver_metis_static.a
usr/local/cuda/lib64/libcudnn_adv.so.9.8.0			 usr/local/cuda/lib64/libcudnn_ops_static_v9.a			     usr/local/cuda/lib64/libcusolverMg.so
usr/local/cuda/lib64/libcudnn_adv_static.a			 usr/local/cuda/lib64/libcudnn.so				     usr/local/cuda/lib64/libcusolverMg.so.11
usr/local/cuda/lib64/libcudnn_adv_static_v9.a			 usr/local/cuda/lib64/libcudnn.so.9				     usr/local/cuda/lib64/libcusolverMg.so.11.7.3.90
usr/local/cuda/lib64/libcudnn_cnn.so				 usr/local/cuda/lib64/libcudnn.so.9.8.0				     usr/local/cuda/lib64/libcusolver.so
usr/local/cuda/lib64/libcudnn_cnn.so.9				 usr/local/cuda/lib64/libcufft.so				     usr/local/cuda/lib64/libcusolver.so.11
usr/local/cuda/lib64/libcudnn_cnn.so.9.8.0			 usr/local/cuda/lib64/libcufft.so.11				     usr/local/cuda/lib64/libcusolver.so.11.7.3.90
usr/local/cuda/lib64/libcudnn_cnn_static.a			 usr/local/cuda/lib64/libcufft.so.11.3.3.83			     usr/local/cuda/lib64/libcusolver_static.a
usr/local/cuda/lib64/libcudnn_cnn_static_v9.a			 usr/local/cuda/lib64/libcufft_static.a				     usr/local/cuda/lib64/libcusparseLt.so
usr/local/cuda/lib64/libcudnn_engines_precompiled.so		 usr/local/cuda/lib64/libcufft_static_nocallback.a		     usr/local/cuda/lib64/libcusparseLt.so.0
usr/local/cuda/lib64/libcudnn_engines_precompiled.so.9		 usr/local/cuda/lib64/libcufftw.so				     usr/local/cuda/lib64/libcusparseLt.so.0.7.1.0
usr/local/cuda/lib64/libcudnn_engines_precompiled.so.9.8.0	 usr/local/cuda/lib64/libcufftw.so.11				     usr/local/cuda/lib64/libcusparseLt_static.a
usr/local/cuda/lib64/libcudnn_engines_precompiled_static.a	 usr/local/cuda/lib64/libcufftw.so.11.3.3.83			     usr/local/cuda/lib64/libcusparse.so
usr/local/cuda/lib64/libcudnn_engines_precompiled_static_v9.a	 usr/local/cuda/lib64/libcufftw_static.a			     usr/local/cuda/lib64/libcusparse.so.12
usr/local/cuda/lib64/libcudnn_engines_runtime_compiled.so	 usr/local/cuda/lib64/libcufile_rdma.so				     usr/local/cuda/lib64/libcusparse.so.12.5.8.93
usr/local/cuda/lib64/libcudnn_engines_runtime_compiled.so.9	 usr/local/cuda/lib64/libcufile_rdma.so.1			     usr/local/cuda/lib64/libcusparse_static.a
usr/local/cuda/lib64/libcudnn_engines_runtime_compiled.so.9.8.0  usr/local/cuda/lib64/libcufile_rdma.so.1.13.1
usr/local/cuda/lib64/libcudnn_engines_runtime_compiled_static.a  usr/local/cuda/lib64/libcufile_rdma_static.a

its available on host machine but not from Docker env.

ls /usr/lib/libnvcuvid.so*
/usr/lib/libnvcuvid.so  /usr/lib/libnvcuvid.so.1  /usr/lib/libnvcuvid.so.570.133.07

[ptrblck]

Cross-posting: we should check if the needed driver capabilities are used based on: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/docker-specialized.html#driver-capabilities