Skip to content

Enables Matmul and Gemm for float16 on CPU #5746

Enables Matmul and Gemm for float16 on CPU

Enables Matmul and Gemm for float16 on CPU #5746

Triggered via pull request September 1, 2025 16:25
Status Failure
Total duration 1h 9m 50s
Artifacts

linux_ci.yml

on: pull_request
Build Linux x64 Debug (ASan)  /  build_test_pipeline
44m 11s
Build Linux x64 Debug (ASan) / build_test_pipeline
Build Linux x64 Release  /  build_test_pipeline
47m 58s
Build Linux x64 Release / build_test_pipeline
Build Linux x64 Release with training  /  build_test_pipeline
1h 3m
Build Linux x64 Release with training / build_test_pipeline
Build Linux arm64 Debug  /  build_test_pipeline
46m 5s
Build Linux arm64 Debug / build_test_pipeline
Build Linux arm64 Release  /  build_test_pipeline
27m 22s
Build Linux arm64 Release / build_test_pipeline
Fit to window
Zoom out
Zoom in

Annotations

4 errors and 27 warnings
Build Linux x64 Release with training / build_test_pipeline
Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/onnx:/data/onnx:ro --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 -e RUNNER_TEMP=/onnxruntime_src/build ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildpythonx64:sha256-c9d2e9eb611fc211058f66620961903a39ef2a7141a6dee63867025d4a5b6e5c /bin/bash -c set -ex; PATH=/opt/python/cp310-cp310/bin:$PATH && python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt && python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test" failed with exit code 1
Build Linux x64 Release with training / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-09-01 16:51:14,151 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-09-01 16:51:14,155 build [INFO] - Build started 2025-09-01 16:51:14,155 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-09-01 16:51:14,155 build [INFO] - Running tests for Release configuration 2025-09-01 16:51:14,155 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Release/Release/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 2674, in <module> sys.exit(main()) File "/onnxruntime_src/tools/ci_build/build.py", line 2582, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 1731, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 148, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( File "/opt/python/cp310-cp310/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Release', '--verbose', '--timeout', '10800']' returned non-zero exit status 8.
Build Linux x64 Release with training / build_test_pipeline
stdout: Requirement already satisfied: numpy==2.2.6 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 1)) (2.2.6) Requirement already satisfied: mypy in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 2)) (1.17.1) Requirement already satisfied: pytest in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 3)) (8.4.1) Requirement already satisfied: setuptools>=68.2.2 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 4)) (80.9.0) Requirement already satisfied: wheel in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 5)) (0.45.1) Requirement already satisfied: onnx==1.18.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 6)) (1.18.0) Requirement already satisfied: protobuf==4.25.1 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 7)) (4.25.1) Requirement already satisfied: sympy==1.14 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 8)) (1.14.0) Requirement already satisfied: flatbuffers in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 9)) (25.2.10) Requirement already satisfied: psutil in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from -r tools/ci_build/github/linux/python/requirements.txt (line 10)) (7.0.0) Collecting onnxscript==0.3.2 (from -r tools/ci_build/github/linux/python/requirements.txt (line 11)) Using cached onnxscript-0.3.2-py3-none-any.whl.metadata (13 kB) Collecting jinja2 (from -r tools/ci_build/github/linux/python/requirements.txt (line 12)) Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) Collecting markupsafe (from -r tools/ci_build/github/linux/python/requirements.txt (line 13)) Using cached MarkupSafe-3.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) Requirement already satisfied: typing_extensions>=4.7.1 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from onnx==1.18.0->-r tools/ci_build/github/linux/python/requirements.txt (line 6)) (4.14.1) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from sympy==1.14->-r tools/ci_build/github/linux/python/requirements.txt (line 8)) (1.3.0) Collecting ml_dtypes (from onnxscript==0.3.2->-r tools/ci_build/github/linux/python/requirements.txt (line 11)) Using cached ml_dtypes-0.5.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (8.9 kB) Collecting onnx_ir<2,>=0.1.3 (from onnxscript==0.3.2->-r tools/ci_build/github/linux/python/requirements.txt (line 11)) Using cached onnx_ir-0.1.7-py3-none-any.whl.metadata (3.5 kB) Requirement already satisfied: packaging in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from onnxscript==0.3.2->-r tools/ci_build/github/linux/python/requirements.txt (line 11)) (25.0) Requirement already satisfied: mypy_extensions>=1.0.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 2)) (1.1.0) Requirement already satisfied: pathspec>=0.9.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 2)) (0.12.1) Requirement already satisfied: tomli>=1.1.0 in /opt/_internal/cpython-3.10.18/lib/python3.10/site-packages (from mypy->-r tools/ci_build/github/linux/python/requirements.txt (line 2)) (2.2.1) Requirement already satisfied: exceptiongroup>=1 in /opt/_internal/cpython-3.10.18/lib/python3.10/si
Build Linux x64 Release with training / build_test_pipeline
Command failed with exit code 1
Build Linux arm64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux arm64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-09-01 16:54:18,106 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-09-01 16:54:18,111 build [INFO] - Build started 2025-09-01 16:54:18,111 build [INFO] - Running tests for Release configuration 2025-09-01 16:54:18,112 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 2025-09-01 16:55:15,730 build [INFO] - /opt/python/cp310-cp310/bin/python3 onnxruntime_test_python.py .............../onnxruntime_src/build/Release/Release/onnxruntime/capi/onnxruntime_inference_collection.py:123: UserWarning: Specified provider 'InvalidProvider' is not in available provider names.Available providers: 'CPUExecutionProvider' warnings.warn( .....2025-09-01 16:55:16.014436908 [I:onnxruntime:TestModelSerialization, inference_session.cc:606 TraceSessionOptions] Session Options { execution_mode:0 execution_order:DEFAULT enable_profiling:0 optimized_model_filepath:"./PythonApiTestOptimizedModel.onnx" enable_mem_pattern:1 enable_mem_reuse:1 enable_cpu_mem_arena:1 profile_file_prefix:onnxruntime_profile_ session_logid:TestModelSerialization session_log_severity_level:1 session_log_verbosity_level:0 max_num_graph_transformation_steps:10 graph_optimization_level:4 intra_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } inter_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } use_per_session_threads:1 thread_pool_allow_spinning:1 use_deterministic_compute:0 ep_selection_policy:0 config_options: { } } 2025-09-01 16:55:16.014462068 [I:onnxruntime:TestModelSerialization, inference_session.cc:422 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2025-09-01 16:55:16.014469468 [I:onnxruntime:TestModelSerialization, inference_session.cc:446 ConstructorCommon] Dynamic block base set to 0 2025-09-01 16:55:16.014851668 [I:onnxruntime:TestModelSerialization, inference_session.cc:2042 Initialize] Initializing session. 2025-09-01 16:55:16.014866148 [I:onnxruntime:TestModelSerialization, inference_session.cc:2080 Initialize] Adding default CPU execution provider. 2025-09-01 16:55:16.014975028 [I:onnxruntime:TestModelSerialization, graph_partitioner.cc:1181 InlineFunctionsAOT] This model does not have any local functions defined. AOT Inlining is not performed 2025-09-01 16:55:16.014985828 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK 2025-09-01 16:55:16.014994028 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK 2025-09-01 16:55:16.014999788 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK 2025-09-01 16:55:16.015012228 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer ConstantSharing modified: 0 with
Build Linux arm64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux arm64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-09-01 16:36:03,463 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-09-01 16:36:03,468 build [INFO] - Build started 2025-09-01 16:36:03,468 build [INFO] - Building targets for Release configuration 2025-09-01 16:36:03,468 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j8 2025-09-01 16:54:07,580 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: MIT License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. By 2025-Oct-31, you need to update your project and remove deprecated calls or your builds will no longer be supported. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.main_repair:The libc could not be deduced from the wheel filename INFO:auditwheel.main_repair:Repairing onnxruntime-1.23.0.dev20250901-cp310-cp310-linux_aarch64.whl DEBUG:auditwheel.tools:zip2dir from /onnxruntime_src/build/Release/Release/dist/onnxruntime-1.23.0.dev20250901-cp310-cp310-linux_aarch64.whl to /tmp/tmpj46u3vbm takes 0:00:00.300906 DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.23.0 DEBUG:auditwheel.lddtree:ldd(onnxruntime/capi/libonnxruntime.so.1.23.0) DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmpj46u3vbm/onnxruntime/capi'] DEBUG:auditwheel.lddtree:ldd(/lib64/libdl-2.28.so) DEBUG:auditwheel.lddtree:ldd(/lib64/libc-2.28.so) DEBUG:auditwheel.lddtree:ldd(/lib64/ld-2.28.so) DEBUG:auditwheel.lddtree:ldd(/lib64/librt-2.28.so) DEBUG:auditwheel.lddtree:ldd(/lib64/libpthread-2.28.so) D
Build Linux arm64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux arm64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-09-01 16:30:11,991 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-09-01 16:30:11,997 build [INFO] - Build started 2025-09-01 16:30:11,997 build [INFO] - Generating CMake build tree 2025-09-01 16:30:12,013 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=OFF -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -Donnxruntime_BUILD_BENCHMAR
Build Linux arm64 Release / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux arm64 Debug / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --test 2025-09-01 16:55:18,932 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --test 2025-09-01 16:55:18,935 build [INFO] - Build started 2025-09-01 16:55:18,935 build [INFO] - Running tests for Debug configuration 2025-09-01 16:55:18,935 build [INFO] - /usr/bin/ctest --build-config Debug --verbose --timeout 10800 2025-09-01 17:14:22,036 build [INFO] - Build complete
Build Linux arm64 Debug / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --build 2025-09-01 16:37:51,334 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --build 2025-09-01 16:37:51,337 build [INFO] - Build started 2025-09-01 16:37:51,338 build [INFO] - Building targets for Debug configuration 2025-09-01 16:37:51,338 build [INFO] - /usr/bin/cmake --build build/Debug/Debug --config Debug -- -j8 2025-09-01 16:55:17,539 build [INFO] - Build complete
Build Linux arm64 Debug / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --update 2025-09-01 16:29:28,736 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --update 2025-09-01 16:29:28,739 build [INFO] - Build started 2025-09-01 16:29:28,740 build [INFO] - Generating CMake build tree 2025-09-01 16:29:28,753 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=OFF -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -DCMAKE_TOOLCHAIN_FILE=/usr/local/share/vcpkg/scripts/buildsystems/vcpkg.cmake -G Ninja -DCMAKE_C_FLAGS=-g -O0 -DCMAKE_CXX_FLAGS=-g -O0 -DCMAKE_EXE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -DCMAKE_MODULE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -DCMAKE_SHARED_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -DVCPKG_INSTALL_OPTIONS=--x-feature=tests;--overlay-triplets=/onnxruntime_sr
Build Linux arm64 Debug / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test 2025-09-01 16:50:43,582 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test 2025-09-01 16:50:43,585 build [INFO] - Build started 2025-09-01 16:50:43,585 build [DEBUG] - create symlink /data/models -> build/Debug/models 2025-09-01 16:50:43,585 build [INFO] - Running tests for Debug configuration 2025-09-01 16:50:43,585 build [INFO] - /usr/bin/ctest --build-config Debug --verbose --timeout 10800 2025-09-01 17:15:55,136 build [INFO] - Build complete
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --build 2025-09-01 16:41:57,358 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --build 2025-09-01 16:41:57,360 build [INFO] - Build started 2025-09-01 16:41:57,361 build [INFO] - Building targets for Debug configuration 2025-09-01 16:41:57,361 build [INFO] - /usr/bin/cmake --build build/Debug/Debug --config Debug -- -j16 2025-09-01 16:49:54,087 build [INFO] - Build complete
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --update 2025-09-01 16:34:41,029 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --update 2025-09-01 16:34:41,031 build [INFO] - Build started 2025-09-01 16:34:41,031 build [INFO] - Generating CMake build tree 2025-09-01 16:34:41,043 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -DCMAKE_TOOLCHAIN_FILE=/usr/local/share/vcpkg/scripts/buildsystems/vcpkg.cmake -G Ninja -DCMAKE_C_FLAGS=-g -O0 -fsanitize=address -fstack-clash-protection -fcf-protection -DCMAKE_CXX_FLAGS=-g -O0 -fsanitize=address -fstack-clash-protection -fcf-protection -DCMAKE_EXE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -fsanitize=address -DCMAKE_MODULE_LINKER_FLAGS_INIT=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -Wl,-z,noexecstack -fsanitize=address -DCMAKE_SHARED_LINKER_FLAGS_INIT=-Wl,-Bs
Build Linux x64 Debug (ASan) / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-09-01 16:47:46,527 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-09-01 16:47:46,531 build [INFO] - Build started 2025-09-01 16:47:46,531 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-09-01 16:47:46,531 build [INFO] - Running tests for Release configuration 2025-09-01 16:47:46,531 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 2025-09-01 17:02:03,489 build [INFO] - /opt/python/cp310-cp310/bin/python3 -m pip install torch --index-url https://download.pytorch.org/whl/cpu WARNING: The scripts torchfrtrace and torchrun are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip 2025-09-01 17:02:18,381 build [INFO] - /opt/python/cp310-cp310/bin/python3 onnxruntime_test_python.py .............../onnxruntime_src/build/Release/Release/onnxruntime/capi/onnxruntime_inference_collection.py:123: UserWarning: Specified provider 'InvalidProvider' is not in available provider names.Available providers: 'CPUExecutionProvider' warnings.warn( .....2025-09-01 17:02:18.615127566 [I:onnxruntime:TestModelSerialization, inference_session.cc:606 TraceSessionOptions] Session Options { execution_mode:0 execution_order:DEFAULT enable_profiling:0 optimized_model_filepath:"./PythonApiTestOptimizedModel.onnx" enable_mem_pattern:1 enable_mem_reuse:1 enable_cpu_mem_arena:1 profile_file_prefix:onnxruntime_profile_ session_logid:TestModelSerialization session_log_severity_level:1 session_log_verbosity_level:0 max_num_graph_transformation_steps:10 graph_optimization_level:4 intra_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } inter_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } use_per_session_threads:1 thread_pool_allow_spinning:1 use_deterministic_compute:0 ep_selection_policy:0 config_options: { } } 2025-09-01 17:02:18.615145763 [I:onnxruntime:TestModelSerialization, inference_session.cc:422 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2025-09-01 17:02:18.615151051 [I:onnxruntime:TestModelSerialization, inference_session.cc:446 ConstructorCommon] Dynamic block base set to 0 2025-09-01 17:02:18.615744009 [I:onnxruntime:TestModelSerialization, inference_session.cc:2042 Initialize] Initializing session. 2025-09-01 17:02:18.615758270 [I:onnxruntime:TestModelSerialization, inference_session.cc:2080 Initialize] Adding default CPU execution provider. 2025-09-01 17:02:18.615859572 [I:onnxruntime:TestModelSerialization, graph_partitioner.cc:1181 InlineFunctionsAOT] This model does not have an
Build Linux x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-09-01 16:39:36,346 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-09-01 16:39:36,350 build [INFO] - Build started 2025-09-01 16:39:36,350 build [INFO] - Building targets for Release configuration 2025-09-01 16:39:36,350 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16 2025-09-01 16:47:17,241 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: MIT License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. By 2025-Oct-31, you need to update your project and remove deprecated calls or your builds will no longer be supported. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.main_repair:The libc could not be deduced from the wheel filename INFO:auditwheel.main_repair:Repairing onnxruntime-1.23.0.dev20250901-cp310-cp310-linux_x86_64.whl DEBUG:auditwheel.tools:zip2dir from /onnxruntime_src/build/Release/Release/dist/onnxruntime-1.23.0.dev20250901-cp310-cp310-linux_x86_64.whl to /tmp/tmpcejpd163 takes 0:00:00.282974 DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.23.0 DEBUG:auditwheel.lddtree:ldd(onnxruntime/capi/libonnxruntime.so.1.23.0) DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmpcejpd163/onnxruntime/capi'] DEBUG:auditwheel.lddtree:ldd(/lib64/libdl-2.28.so) DEBUG:auditwheel.lddtree:ldd(/lib64/libc-2.28.so) DEBUG:auditwheel.lddtree:
Build Linux x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-09-01 16:35:40,519 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-09-01 16:35:40,522 build [INFO] - Build started 2025-09-01 16:35:40,522 build [INFO] - Generating CMake build tree 2025-09-01 16:35:40,534 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxrun
Build Linux x64 Release / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/
Build Linux x64 Release with training / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release with training / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-09-01 16:41:15,947 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-09-01 16:41:15,951 build [INFO] - Build started 2025-09-01 16:41:15,951 build [INFO] - Building targets for Release configuration 2025-09-01 16:41:15,952 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16 2025-09-01 16:50:43,066 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build --enable_training --enable_training_apis /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: MIT License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. By 2025-Oct-31, you need to update your project and remove deprecated calls or your builds will no longer be supported. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.main_repair:The libc could not be deduced from the wheel filename INFO:auditwheel.main_repair:Repairing onnxruntime_training-1.23.0.dev20250901+cpu-cp310-cp310-linux_x86_64.whl DEBUG:auditwheel.tools:zip2dir from /onnxruntime_src/build/Release/Release/dist/onnxruntime_training-1.23.0.dev20250901+cpu-cp310-cp310-linux_x86_64.whl to /tmp/tmpoelj2spq takes 0:00:00.334683 DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.23.0 DEBUG:auditwheel.lddtree:ldd(onnxruntime/capi/libonnxruntime.so.1.23.0) DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmpoelj2spq/onnxruntime/capi'] DEBUG:auditwheel.lddtre
Build Linux x64 Release with training / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
Build Linux x64 Release with training / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt [notice] A new release of pip is available: 25.1.1 -> 25.2 [notice] To update, run: pip install --upgrade pip + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-09-01 16:37:13,185 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-09-01 16:37:13,188 build [INFO] - Build started 2025-09-01 16:37:13,188 build [INFO] - Generating CMake build tree 2025-09-01 16:37:13,201 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=ON -Donnxruntime_ENABLE_TRAINING_OPS=ON -Donnxruntime_ENABLE_TRAINING_APIS=ON -Donnxruntime_ENABLE_CPU_FP16_OPS=ON -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DI
Build Linux x64 Release with training / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'. Configure a credential helper to remove this warning. See https://docs.docker.com/go/credential-store/