Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

undeclared inclusion(s) in rule '@local_xla//xla/service/gpu:buffer_comparator_kernel' #72

Open
jlo62 opened this issue Nov 9, 2024 · 0 comments
Open

undeclared inclusion(s) in rule '@local_xla//xla/service/gpu:buffer_comparator_kernel' #72

jlo62 opened this issue Nov 9, 2024 · 0 comments

Comments

@jlo62
Copy link

jlo62 commented Nov 9, 2024 


:: Resolving dependencies...
:: Calculating conflicts...
:: Calculating inner conflicts...

:: Conflicts found:
    python-tensorflow-opt-rocm: python-tensorflow  
    tensorflow-opt-rocm: tensorflow-opt (tensorflow)  tensorflow-opt (tensorflow)  

:: Conflicting packages will have to be confirmed manually

Aur (1) tensorflow-rocm-2.17.0-1 (tensorflow-opt-rocm python-tensorflow-opt-rocm)

:: Proceed to review? [Y/n]: y

:: Downloading PKGBUILDs...
 PKGBUILDs up to date
 nothing new to review
fetching devel info...
==> Making package: tensorflow-rocm 2.17.0-1 (Sat 09 Nov 2024 08:31:29 AM CET)
==> Retrieving sources...
  -> Found tensorflow-rocm-2.17.0.tar.gz
  -> Found tensorflow-2.16.1-python-distutils-removal.patch
  -> Found tensorflow-numpy2.patch
  -> Found bazel_nojdk-6.5.0-linux-x86_64
==> Validating source files with sha512sums...
    tensorflow-rocm-2.17.0.tar.gz ... Passed
    tensorflow-2.16.1-python-distutils-removal.patch ... Passed
    tensorflow-numpy2.patch ... Passed
    bazel_nojdk-6.5.0-linux-x86_64 ... Passed
==> Making package: tensorflow-rocm 2.17.0-1 (Sat 09 Nov 2024 08:31:33 AM CET)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> Retrieving sources...
  -> Found tensorflow-rocm-2.17.0.tar.gz
  -> Found tensorflow-2.16.1-python-distutils-removal.patch
  -> Found tensorflow-numpy2.patch
  -> Found bazel_nojdk-6.5.0-linux-x86_64
==> Validating source files with sha512sums...
    tensorflow-rocm-2.17.0.tar.gz ... Passed
    tensorflow-2.16.1-python-distutils-removal.patch ... Passed
    tensorflow-numpy2.patch ... Passed
    bazel_nojdk-6.5.0-linux-x86_64 ... Passed
==> Removing existing $srcdir/ directory...
==> Extracting sources...
  -> Extracting tensorflow-rocm-2.17.0.tar.gz with bsdtar
  -> Extracting bazel_nojdk-6.5.0-linux-x86_64 with bsdtar
==> Starting prepare()...
bazel 6.5.0
patching file tensorflow/api_template.__init__.py
Hunk #2 succeeded at 96 (offset 2 lines).
patching file tensorflow/api_template_v1.__init__.py
patching file tensorflow/lite/python/convert.py
Hunk #3 succeeded at 411 (offset 9 lines).
sed: can't read /usr/include/cudnn_version.h: No such file or directory
==> Sources are ready.
tensorflow-rocm-2.17.0-1 (tensorflow-opt-rocm python-tensorflow-opt-rocm): parsing pkg list...
==> Making package: tensorflow-rocm 2.17.0-1 (Sat 09 Nov 2024 08:31:42 AM CET)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> WARNING: Using existing $srcdir/ tree
==> Starting build()...
Building with rocm and without non-x86-64 optimizations
You have bazel 6.5.0 installed.
Please specify the location of python. [Default is /usr/bin/python3]: 


Found possible Python library paths:
  /usr/lib/python3.12/site-packages
Please input the desired Python library path to use.  Default is [/usr/lib/python3.12/site-packages]

Do you want to use Clang to build TensorFlow? [Y/n]: 
Clang will be used to compile TensorFlow.

Please specify the path to clang executable. [Default is /usr/bin/clang]: 


You have Clang 18.1.8 installed.

Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: 
Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
	--config=mkl         	# Build with MKL support.
	--config=mkl_aarch64 	# Build with oneDNN and Compute Library for the Arm Architecture (ACL).
	--config=monolithic  	# Config for mostly static monolithic build.
	--config=numa        	# Build with NUMA support.
	--config=dynamic_kernels	# (Experimental) Build kernels into separate shared objects.
	--config=v1          	# Build with TensorFlow 1 API instead of TF 2 API.
Preconfigured Bazel build configs to DISABLE default on features:
	--config=nogcp       	# Disable GCP support.
	--config=nonccl      	# Disable NVIDIA NCCL support.
Configuration finished
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [rocm, no_tfrt]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Reading 'startup' options from /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --windows_enable_symlinks
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=142
INFO: Reading rc options for 'build' from /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc:
  'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
INFO: Reading rc options for 'build' from /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3.12/site-packages --python_path=/usr/bin/python3 --config=rocm --action_env CLANG_COMPILER_PATH=/usr/bin/clang-18 --repo_env=CC=/usr/bin/clang-18 --repo_env=BAZEL_COMPILER=/usr/bin/clang-18
INFO: Found applicable config definition build:short_logs in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:rocm in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --crosstool_top=@local_config_rocm//crosstool:toolchain --define=using_rocm_hipcc=true --define=tensorflow_mkldnn_contraction_kernel=0 --repo_env TF_NEED_ROCM=1 --config=no_tfrt
INFO: Found applicable config definition build:no_tfrt in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/ir,tensorflow/compiler/mlir/tfrt/ir/mlrt,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ifrt,tensorflow/compiler/mlir/tfrt/tests/mlrt,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/compiler/mlir/tfrt/transforms/mlrt,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/runtime_fallback/test,tensorflow/core/runtime_fallback/test/gpu,tensorflow/core/runtime_fallback/test/saved_model,tensorflow/core/runtime_fallback/test/testdata,tensorflow/core/tfrt/stubs,tensorflow/core/tfrt/tfrt_session,tensorflow/core/tfrt/mlrt,tensorflow/core/tfrt/mlrt/attribute,tensorflow/core/tfrt/mlrt/kernel,tensorflow/core/tfrt/mlrt/bytecode,tensorflow/core/tfrt/mlrt/interpreter,tensorflow/compiler/mlir/tfrt/translate/mlrt,tensorflow/compiler/mlir/tfrt/translate/mlrt/testdata,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils,tensorflow/core/tfrt/utils/debug,tensorflow/core/tfrt/saved_model/python,tensorflow/core/tfrt/graph_executor/python,tensorflow/core/tfrt/saved_model/utils
INFO: Found applicable config definition build:rocm in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --crosstool_top=@local_config_rocm//crosstool:toolchain --define=using_rocm_hipcc=true --define=tensorflow_mkldnn_contraction_kernel=0 --repo_env TF_NEED_ROCM=1 --config=no_tfrt
INFO: Found applicable config definition build:no_tfrt in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/ir,tensorflow/compiler/mlir/tfrt/ir/mlrt,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ifrt,tensorflow/compiler/mlir/tfrt/tests/mlrt,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/compiler/mlir/tfrt/transforms/mlrt,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/runtime_fallback/test,tensorflow/core/runtime_fallback/test/gpu,tensorflow/core/runtime_fallback/test/saved_model,tensorflow/core/runtime_fallback/test/testdata,tensorflow/core/tfrt/stubs,tensorflow/core/tfrt/tfrt_session,tensorflow/core/tfrt/mlrt,tensorflow/core/tfrt/mlrt/attribute,tensorflow/core/tfrt/mlrt/kernel,tensorflow/core/tfrt/mlrt/bytecode,tensorflow/core/tfrt/mlrt/interpreter,tensorflow/compiler/mlir/tfrt/translate/mlrt,tensorflow/compiler/mlir/tfrt/translate/mlrt/testdata,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils,tensorflow/core/tfrt/utils/debug,tensorflow/core/tfrt/saved_model/python,tensorflow/core/tfrt/graph_executor/python,tensorflow/core/tfrt/saved_model/utils
INFO: Found applicable config definition build:linux in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tmp/makepkg/tensorflow-rocm/src/tensorflow-2.17.0-rocm/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
WARNING: The following configs were expanded more than once: [rocm, no_tfrt]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Analyzed 5 targets (710 packages loaded, 50519 targets configured).
INFO: Found 5 targets...
ERROR: /home/janluca/.cache/bazel/_bazel_janluca/604c7e0350e7b3b80f4666a83c15fa30/external/local_xla/xla/service/gpu/BUILD:4442:19: Compiling xla/service/gpu/buffer_comparator.cu.cc failed: undeclared inclusion(s) in rule '@local_xla//xla/service/gpu:buffer_comparator_kernel':
this rule is missing dependency declarations for the following files included by 'xla/service/gpu/buffer_comparator.cu.cc':
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_hip_runtime_wrapper.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/cuda_wrappers/cmath'
  '/opt/rocm/lib/llvm/lib/clang/18/include/stddef.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_size_t.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_wchar_t.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_null.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_hip_libdevice_declares.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_hip_math.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/limits.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/stdint.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_hip_stdlib.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_cuda_math_forward_declares.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_hip_cmath.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__clang_cuda_complex_builtins.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/cuda_wrappers/algorithm'
  '/opt/rocm/lib/llvm/lib/clang/18/include/cuda_wrappers/new'
  '/opt/rocm/lib/llvm/lib/clang/18/include/cuda_wrappers/complex'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_ptrdiff_t.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_nullptr_t.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_max_align_t.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stddef_offsetof.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/stdarg.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/__stdarg___gnuc_va_list.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/cuda_wrappers/bits/basic_string.h'
  '/opt/rocm/lib/llvm/lib/clang/18/include/cuda_wrappers/bits/basic_string.tcc'
/home/janluca/.cache/bazel/_bazel_janluca/604c7e0350e7b3b80f4666a83c15fa30/execroot/org_tensorflow/external/local_config_rocm/crosstool/clang/bin/crosstool_wrapper_driver_is_not_gcc:162: SyntaxWarning: invalid escape sequence '\.'
  re.search('\.cpp$|\.cc$|\.c$|\.cxx$|\.C$', f)]
/home/janluca/.cache/bazel/_bazel_janluca/604c7e0350e7b3b80f4666a83c15fa30/execroot/org_tensorflow/external/local_config_rocm/crosstool/clang/bin/crosstool_wrapper_driver_is_not_gcc:23: DeprecationWarning: 'pipes' is deprecated and slated for removal in Python 3.13
  import pipes
clang++: warning: argument unused during compilation: '-fcuda-flush-denormals-to-zero' [-Wunused-command-line-argument]
INFO: Elapsed time: 17.224s, Critical Path: 8.66s
INFO: 210 processes: 40 internal, 170 local.
FAILED: Build did NOT complete successfully
==> ERROR: A failure occurred in build().
    Aborting...
error: failed to build 'tensorflow-rocm-2.17.0-1 (tensorflow-opt-rocm python-tensorflow-opt-rocm)': 
error: packages failed to build: tensorflow-rocm-2.17.0-1 (tensorflow-opt-rocm python-tensorflow-opt-rocm)

All the ROCM packages have been updated to ROCM 6.2.2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jlo62