arm64 image doesn't build libvips

[richarvey]

Steps to reproduce the problem

1. docker buildx build --platform linux/amd64,linux/arm64 --tag masto:test .

Expected behaviour

Docker image should have been built

Actual behaviour

segfault whilst building libvips stops build process

Detailed description

when trying to build the docker images the amd64 build works fine but when compiling libvips on arm64 meson/ninja seg faults. detailed output below:

 => ERROR [linux/arm64 libvips 5/5] RUN   meson setup build --prefix /usr/local/libvips --libdir=lib -Ddeprecated=false -Dintrospection=disab  254.7s
 => CANCELED [linux/amd64 ffmpeg 5/5] RUN   ./configure     --prefix=/usr/local/ffmpeg     --toolchain=hardened     --disable-debug     --dis  255.0s
------
 > [linux/arm64 libvips 5/5] RUN   meson setup build --prefix /usr/local/libvips --libdir=lib -Ddeprecated=false -Dintrospection=disabled -Dmodules=disabled -Dexamples=false;   cd build;   ninja;   ninja install;:
94.69 The Meson build system
94.69 Version: 1.0.1
94.69 Source dir: /usr/local/libvips/src/vips-8.15.3
94.69 Build dir: /usr/local/libvips/src/vips-8.15.3/build
94.69 Build type: native build
94.69 Project name: vips
94.69 Project version: 8.15.3
94.69 C compiler for the host machine: cc (gcc 12.2.0 "cc (Debian 12.2.0-14) 12.2.0")
94.69 C linker for the host machine: cc ld.bfd 2.40
94.69 C++ compiler for the host machine: c++ (gcc 12.2.0 "c++ (Debian 12.2.0-14) 12.2.0")
94.69 C++ linker for the host machine: c++ ld.bfd 2.40
94.69 Host machine cpu family: aarch64
94.69 Host machine cpu: aarch64
94.69 Compiler for C supports arguments -Werror=pointer-arith: YES 
94.69 Found pkg-config: /usr/bin/pkg-config (1.8.1)
94.69 Run-time dependency glib-2.0 found: YES 2.74.6
94.69 Run-time dependency gio-2.0 found: YES 2.74.6
94.69 Run-time dependency gobject-2.0 found: YES 2.74.6
94.69 Dependency gmodule-no-export-2.0 skipped: feature modules disabled
94.69 Run-time dependency expat found: YES 2.5.0
94.69 Run-time dependency threads found: YES
94.69 Library m found: YES
94.69 Compiler for C supports link arguments -Wl,-z,nodelete: YES 
94.69 Compiler for C supports function attribute visibility:hidden: YES 
94.69 Checking if "Has vector arithmetic" with dependency -lm compiles: YES 
94.69 Checking if "Has signed constants in vector templates" with dependency -lm compiles: YES 
94.69 Checking if "Has target_clones attribute" runs: DID NOT COMPILE
94.69 Checking for function "vsnprintf" : YES 
94.69 Checking for function "_aligned_malloc" : NO 
94.69 Checking for function "posix_memalign" : YES 
94.69 Checking for function "memalign" : YES 
94.69 Checking for function "cbrt" with dependency -lm: YES 
94.69 Checking for function "hypot" with dependency -lm: YES 
94.69 Checking for function "atan2" with dependency -lm: YES 
94.69 Checking for function "asinh" with dependency -lm: YES 
94.69 Checking for function "pthread_setattr_default_np" with dependency threads: YES 
94.69 Run-time dependency zlib found: YES 1.2.13
94.69 Found CMake: /usr/bin/cmake (3.25.1)
94.69 Run-time dependency libarchive found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency fftw3 found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency magickcore found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency imagemagick found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency cfitsio found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency imagequant found: YES 2.17.0
94.69 Run-time dependency cgif found: YES 0.3.0
94.69 Checking if "Has CGIF_ATTR_NO_LOOP" with dependency cgif compiles: YES 
94.69 Checking if "Has CGIF_FRAME_ATTR_INTERLACED" with dependency cgif compiles: YES 
94.69 Run-time dependency libexif found: YES 0.6.24
94.69 Has header "exif-data.h" with dependency libexif: NO 
94.69 Run-time dependency libjpeg found: YES 2.1.5
94.69 Checking for function "jpeg_c_bool_param_supported" with dependency libjpeg: NO 
94.69 Run-time dependency spng found: YES 0.7.3
94.69 Run-time dependency libwebp found: YES 1.2.4
94.69 Run-time dependency libwebpmux found: YES 1.2.4
94.69 Run-time dependency libwebpdemux found: YES 1.2.4
94.69 Run-time dependency pangocairo found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency pangoft2 found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency fontconfig found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency libtiff-4 found: YES 4.5.0
94.69 Fetching value of define "COMPRESSION_WEBP" with dependency libtiff-4: 50001 
94.69 Run-time dependency librsvg-2.0 found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency cairo found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency openslide found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency matio found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency lcms2 found: YES 2.14
94.69 Run-time dependency openexr found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency libopenjp2 found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency libhwy found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency orc-0.4 found: YES 0.4.33
94.69 Run-time dependency pdfium found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency libheif found: YES 1.15.1
94.69 Checking for function "heif_image_handle_get_raw_color_profile" with dependency libheif: YES 
94.69 Checking for function "heif_context_set_maximum_image_size_limit" with dependency libheif: YES 
94.69 Checking whether type "struct heif_decoding_options" has member "convert_hdr_to_8bit" with dependency libheif: YES 
94.69 Checking whether type "struct heif_encoding_options" has member "output_nclx_profile" with dependency libheif: YES 
94.69 Run-time dependency libjxl found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency libjxl_threads found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency poppler-glib found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency cairo found: NO (tried pkgconfig and cmake)
94.69 Run-time dependency niftiio found: NO (tried pkgconfig)
94.69 Run-time dependency nifti found: NO (tried cmake)
94.69 Has header "sys/file.h" : YES 
94.69 Has header "sys/param.h" : YES 
94.69 Has header "sys/mman.h" : YES 
94.69 Has header "unistd.h" : YES 
94.69 Has header "io.h" : NO 
94.69 Has header "direct.h" : NO 
94.69 Checking for function "ngettext" : YES 
94.69 Checking for function "bind_textdomain_codeset" : YES 
94.69 Configuring config.h using configuration
94.69 Program g-ir-scanner skipped: feature introspection disabled
94.69 Program glib-mkenums found: YES (/usr/bin/glib-mkenums)
94.69 Program glib-mkenums found: YES (/usr/bin/glib-mkenums)
94.69 Configuring version.h using configuration
94.69 Found pkg-config: /usr/bin/pkg-config (1.8.1)
94.69 Program glib-genmarshal found: YES (/usr/bin/glib-genmarshal)
94.69 Program msgfmt found: NO
94.69 po/meson.build:2: WARNING: Gettext not found, all translation (po) targets will be ignored.
94.69 Program python3 found: YES (/usr/bin/python3)
94.69 Configuring variables.sh using configuration
94.69 Library FuzzingEngine found: NO
94.69 Build targets in project: 39
94.69 NOTICE: Future-deprecated features used:
94.69  * 0.64.0: {'copy arg in configure_file'}
94.69 
94.69 vips 8.15.3
94.69 
94.69   Build options
94.69     enable debug                      : NO
94.69     enable deprecated                 : NO
94.69     enable modules                    : NO
94.69     enable gtk-doc                    : NO
94.69     enable doxygen                    : NO
94.69     enable introspection              : NO
94.69     enable examples                   : NO
94.69     enable cplusplus                  : YES
94.69     enable RAD load/save              : YES
94.69     enable Analyze7 load/save         : YES
94.69     enable PPM load/save              : YES
94.69     enable GIF load                   : YES
94.69 
94.69   Optional external packages
94.69     use fftw for FFTs                 : NO
94.69     SIMD support with highway         : NO
94.69     accelerate loops with ORC         : YES
94.69     ICC profile support with lcms     : YES
94.69     zlib                              : YES
94.69     text rendering with pangocairo    : NO
94.69     font file support with fontconfig : NO
94.69     EXIF metadata support with libexif: YES
94.69 
94.69   External image format libraries
94.69     JPEG load/save with libjpeg       : YES
94.69     JXL load/save with libjxl         : NO (dynamic module: NO)
94.69     JPEG2000 load/save with OpenJPEG  : NO
94.69     PNG load/save with libspng        : YES
94.69     PNG load/save with libpng         : NO
94.69     selected quantisation package     : imagequant
94.69     TIFF load/save with libtiff       : YES
94.69     image pyramid save with libarchive: NO
94.69     HEIC/AVIF load/save with libheif  : YES (dynamic module: NO)
94.69     WebP load/save with libwebp       : YES
94.69     PDF load with PDFium              : NO
94.69     PDF load with poppler-glib        : NO (dynamic module: NO)
94.69     SVG load with librsvg             : NO
94.69     EXR load with OpenEXR             : NO
94.69     OpenSlide load                    : NO (dynamic module: NO)
94.69     Matlab load with libmatio         : NO
94.69     NIfTI load/save with niftiio      : NO
94.69     FITS load/save with cfitsio       : NO
94.69     GIF save with cgif                : YES
94.69     selected Magick package           : none (dynamic module: NO)
94.69     Magick API version                : none
94.69     Magick load                       : NO
94.69     Magick save                       : NO
94.69 
94.69   User defined options
94.69     libdir                            : lib
94.69     prefix                            : /usr/local/libvips
94.69     deprecated                        : false
94.69     examples                          : false
94.69     introspection                     : disabled
94.69     modules                           : disabled
94.69 
94.69 Found ninja-1.11.1 at /usr/bin/ninja
97.93 [1/404] Generating libvips/iofuncs/vipsmarshal_h with a custom command
97.93 INFO: Reading ../libvips/iofuncs/vipsmarshal.list...
100.9 [2/404] Generating libvips/iofuncs/vipsmarshal_c with a custom command
100.9 INFO: Reading ../libvips/iofuncs/vipsmarshal.list...
101.4 [3/404] Compiling C object fuzz/libstandalone_engine.a.p/StandaloneFuzzTargetMain.c.o
102.0 [4/404] Linking static target fuzz/libstandalone_engine.a
102.3 [5/404] Generating libvips/include/vips/enumtypes.h with a custom command (wrapped by meson to capture output)
113.5 [6/404] Compiling C object libvips/foreign/libforeign.a.p/archive.c.o
113.8 [7/404] Generating libvips/include/vips/enumtypes.c with a custom command (wrapped by meson to capture output)
115.0 [8/404] Compiling C object libvips/foreign/libnsgif/libnsgif.a.p/lzw.c.o
120.4 [9/404] Compiling C object libvips/foreign/libforeign.a.p/fits.c.o
121.2 [10/404] Compiling C object libvips/foreign/libforeign.a.p/cairo.c.o
121.6 [11/404] Compiling C object libvips/foreign/libforeign.a.p/analyzeload.c.o
126.4 [12/404] Compiling C object libvips/foreign/libnsgif/libnsgif.a.p/gif.c.o
126.5 [13/404] Compiling C object libvips/foreign/libforeign.a.p/cgifsave.c.o
126.7 [14/404] Compiling C object libvips/foreign/libforeign.a.p/analyze2vips.c.o
127.6 [15/404] Linking static target libvips/foreign/libnsgif/libnsgif.a
127.8 [16/404] Compiling C object libvips/foreign/libforeign.a.p/csvload.c.o
127.9 [17/404] Compiling C object libvips/foreign/libforeign.a.p/csvsave.c.o
129.0 [18/404] Compiling C object libvips/foreign/libforeign.a.p/dzsave.c.o
134.3 [19/404] Compiling C object libvips/foreign/libforeign.a.p/fitssave.c.o
136.9 [20/404] Compiling C object libvips/foreign/libforeign.a.p/fitsload.c.o
141.2 [21/404] Compiling C object libvips/foreign/libforeign.a.p/jp2ksave.c.o
142.7 [22/404] Compiling C object libvips/foreign/libforeign.a.p/jp2kload.c.o
143.2 [23/404] Compiling C object libvips/foreign/libforeign.a.p/matlab.c.o
144.4 [24/404] Compiling C object libvips/foreign/libforeign.a.p/jpegload.c.o
144.7 [25/404] Compiling C object libvips/foreign/libforeign.a.p/magickload.c.o
148.3 [26/404] Compiling C object libvips/foreign/libforeign.a.p/jpeg2vips.c.o
149.1 [27/404] Compiling C object libvips/foreign/libforeign.a.p/magicksave.c.o
152.5 [28/404] Compiling C object libvips/foreign/libforeign.a.p/matload.c.o
152.6 [29/404] Compiling C object libvips/foreign/libforeign.a.p/exif.c.o
154.3 [30/404] Compiling C object libvips/foreign/libforeign.a.p/openexr2vips.c.o
158.5 [31/404] Compiling C object libvips/foreign/libforeign.a.p/jpegsave.c.o
160.7 [32/404] Compiling C object libvips/foreign/libforeign.a.p/niftisave.c.o
161.1 [33/404] Compiling C object libvips/foreign/libforeign.a.p/niftiload.c.o
165.4 [34/404] Compiling C object libvips/foreign/libforeign.a.p/pdfiumload.c.o
165.8 [35/404] Compiling C object libvips/foreign/libforeign.a.p/matrixload.c.o
166.2 [36/404] Compiling C object libvips/foreign/libforeign.a.p/foreign.c.o
166.5 [37/404] Compiling C object libvips/foreign/libforeign.a.p/matrixsave.c.o
167.4 [38/404] Compiling C object libvips/foreign/libforeign.a.p/pngload.c.o
169.0 [39/404] Compiling C object libvips/foreign/libforeign.a.p/openexrload.c.o
176.2 [40/404] Compiling C object libvips/foreign/libforeign.a.p/nsgifload.c.o
178.7 [41/404] Compiling C object libvips/foreign/libforeign.a.p/pngsave.c.o
184.6 [42/404] Compiling C object libvips/foreign/libforeign.a.p/ppmsave.c.o
186.2 [43/404] Compiling C object libvips/foreign/libforeign.a.p/rawload.c.o
188.5 [44/404] Compiling C object libvips/foreign/libforeign.a.p/rawsave.c.o
189.5 [45/404] Compiling C object libvips/foreign/libforeign.a.p/radsave.c.o
189.5 [46/404] Compiling C object libvips/foreign/libforeign.a.p/radload.c.o
191.6 [47/404] Compiling C object libvips/foreign/libforeign.a.p/ppmload.c.o
192.9 [48/404] Compiling C object libvips/foreign/libforeign.a.p/svgload.c.o
194.8 [49/404] Compiling C object libvips/foreign/libforeign.a.p/quantise.c.o
205.0 [50/404] Compiling C object libvips/foreign/libforeign.a.p/tiff.c.o
208.6 [51/404] Compiling C object libvips/foreign/libforeign.a.p/radiance.c.o
211.1 [52/404] Compiling C object libvips/foreign/libforeign.a.p/spngload.c.o
211.7 [53/404] Compiling C object libvips/foreign/libforeign.a.p/spngsave.c.o
214.6 [54/404] Compiling C object libvips/foreign/libforeign.a.p/vipsload.c.o
214.6 [55/404] Compiling C object libvips/foreign/libforeign.a.p/tiffload.c.o
216.8 [56/404] Compiling C object libvips/foreign/libforeign.a.p/vipspng.c.o
220.3 [57/404] Compiling C object libvips/foreign/libforeign.a.p/tiffsave.c.o
222.3 [58/404] Compiling C object libvips/foreign/libforeign.a.p/magick2vips.c.o
222.3 [59/404] Compiling C object libvips/foreign/libforeign.a.p/vips2jpeg.c.o
223.8 [60/404] Compiling C object libvips/foreign/libforeign.a.p/magick.c.o
227.2 [61/404] Compiling C object libvips/foreign/libforeign.a.p/vipssave.c.o
231.5 [62/404] Compiling C object libvips/foreign/libforeign.a.p/magick6load.c.o
232.7 [63/404] Compiling C object libvips/foreign/libforeign.a.p/jxlsave.c.o
234.6 [64/404] Compiling C object libvips/foreign/libforeign.a.p/vips2magick.c.o
234.8 [65/404] Compiling C object libvips/foreign/libforeign.a.p/webp2vips.c.o
234.8 [66/404] Compiling C object libvips/foreign/libforeign.a.p/magick7load.c.o
234.8 [67/404] Compiling C object libvips/foreign/libforeign.a.p/jxlload.c.o
234.8 [68/404] Compiling C object libvips/foreign/libforeign.a.p/webpload.c.o
235.4 [69/404] Compiling C object libvips/foreign/libforeign.a.p/openslideload.c.o
235.4 FAILED: libvips/foreign/libforeign.a.p/openslideload.c.o 
235.4 cc -Ilibvips/foreign/libforeign.a.p -Ilibvips/foreign -I../libvips/foreign -I. -I.. -Ilibvips/include -I../libvips/include -Ilibvips/include/vips -I/usr/include/glib-2.0 -I/usr/lib/aarch64-linux-gnu/glib-2.0/include -I/usr/include/libmount -I/usr/include/blkid -I/usr/include/aarch64-linux-gnu -I/usr/include/orc-0.4 -fvisibility=hidden -fdiagnostics-color=always -DNDEBUG -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -std=gnu99 -O3 -DG_DISABLE_CAST_CHECKS -DG_DISABLE_CHECKS -DG_DISABLE_ASSERT -Werror=pointer-arith -fPIC -DHAVE_CONFIG_H=1 -pthread -MD -MQ libvips/foreign/libforeign.a.p/openslideload.c.o -MF libvips/foreign/libforeign.a.p/openslideload.c.o.d -o libvips/foreign/libforeign.a.p/openslideload.c.o -c ../libvips/foreign/openslideload.c
235.4 cc: internal compiler error: Segmentation fault signal terminated program cc1
235.4 Please submit a full bug report, with preprocessed source (by using -freport-bug).
235.4 See <file:///usr/share/doc/gcc-12/README.Bugs> for instructions.
242.5 [70/404] Compiling C object libvips/arithmetic/libarithmetic.a.p/sum.c.o
244.4 [71/404] Compiling C object libvips/foreign/libforeign.a.p/popplerload.c.o
246.2 [72/404] Compiling C object libvips/foreign/libforeign.a.p/vips2tiff.c.o
246.3 [73/404] Compiling C object libvips/foreign/libforeign.a.p/webpsave.c.o
248.1 [74/404] Compiling C object libvips/foreign/libforeign.a.p/tiff2vips.c.o
248.7 [75/404] Compiling C object libvips/arithmetic/libarithmetic.a.p/hough.c.o
251.1 [76/404] Compiling C object libvips/arithmetic/libarithmetic.a.p/find_trim.c.o
253.3 [77/404] Compiling C object libvips/foreign/libforeign.a.p/heifsave.c.o
254.6 [78/404] Compiling C object libvips/foreign/libforeign.a.p/heifload.c.o
254.6 ninja: build stopped: subcommand failed.
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
Dockerfile:206
--------------------
 205 |     # Configure and compile libvips
 206 | >>> RUN \
 207 | >>>   meson setup build --prefix /usr/local/libvips --libdir=lib -Ddeprecated=false -Dintrospection=disabled -Dmodules=disabled -Dexamples=false; \
 208 | >>>   cd build; \
 209 | >>>   ninja; \
 210 | >>>   ninja install;
 211 |     
--------------------
ERROR: failed to solve: process "/dev/.buildkit_qemu_emulator /bin/bash -o pipefail -o errexit -c meson setup build --prefix /usr/local/libvips --libdir=lib -Ddeprecated=false -Dintrospection=disabled -Dmodules=disabled -Dexamples=false;   cd build;   ninja;   ninja install;" did not complete successfully: exit code: 1

I attempted to fix this with later versions of libvips but had no luck. I assume it may be meson that is the issue, but I'm unfamiliure with this so I may be wrong.

Mastodon instance

mastodon.squarecows.com

Mastodon version

v4.3.2

Environment

• Operating system: Debian 12.7 bookworm
• Docker: 27.3.1, build ce12230

Everything else is standard in the Dockerfile

• Ruby version: 3.3.5
• Node version: 20

Technical details

I tried bumping the libvips version to 8.15.4, 8.15.5 and 8.16.0 to see if it was a libvips issue but these failed also. I also noticed that mastodon v4.3.1 successfully built libvips 8.15.3 (8.15.2 also fails)

I believe this is the critical part of the log which is included in the details above

235.4 [69/404] Compiling C object libvips/foreign/libforeign.a.p/openslideload.c.o
235.4 FAILED: libvips/foreign/libforeign.a.p/openslideload.c.o 
235.4 cc -Ilibvips/foreign/libforeign.a.p -Ilibvips/foreign -I../libvips/foreign -I. -I.. -Ilibvips/include -I../libvips/include -Ilibvips/include/vips -I/usr/include/glib-2.0 -I/usr/lib/aarch64-linux-gnu/glib-2.0/include -I/usr/include/libmount -I/usr/include/blkid -I/usr/include/aarch64-linux-gnu -I/usr/include/orc-0.4 -fvisibility=hidden -fdiagnostics-color=always -DNDEBUG -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -std=gnu99 -O3 -DG_DISABLE_CAST_CHECKS -DG_DISABLE_CHECKS -DG_DISABLE_ASSERT -Werror=pointer-arith -fPIC -DHAVE_CONFIG_H=1 -pthread -MD -MQ libvips/foreign/libforeign.a.p/openslideload.c.o -MF libvips/foreign/libforeign.a.p/openslideload.c.o.d -o libvips/foreign/libforeign.a.p/openslideload.c.o -c ../libvips/foreign/openslideload.c
235.4 cc: internal compiler error: Segmentation fault signal terminated program cc1
235.4 Please submit a full bug report, with preprocessed source (by using -freport-bug).
235.4 See <file:///usr/share/doc/gcc-12/README.Bugs> for instructions.

[renchap]

This is weird and probably related to your setup (lack of memory / disk space?), as it builds correctly on ARM64 on our CI (see https://github.com/mastodon/mastodon/actions/runs/12151857539/job/33887208269 where it builds AMD64+ARM64)

[vmstan]

I see this occasionally when building locally and it usually has to do with stale Docker build cache.

docker buildx prune --all -f

[vmstan]

I think mine usually fails on the amd64 compile because I'm doing it on an M3 Max (Arm) system. @richarvey are you by chance doing the arm compile on Intel/AMD?

As I understand it the CI pipeline does the builds on native hardware for each and then combines them together. I wonder if there is something in the Dockerfile we could do better here, or if this is just an artifact of cross compiling.

[richarvey]

So if i compile this on m apple M2 no issues. if i Use my intel debian laptop it fails.

I tried running:

docker buildx prune --all -f

Unfortunately it didn't help. The last successful build was 4.3.0 as i build 4.3.1 on the mac.

[vmstan]

What versions of Docker and buildx?

[richarvey]

To add to the fact it's probably a cross compile issue I just tried this on an AWS Graviton m4a and the amd64 build failed.

Docker version 27.3.1, build ce12230

buildx

0.17.1-1~debian.12~bookworm

and buildkit:

v0.18.1