From 916bf533a3ebf0d6569e502295f1d073ca2990c2 Mon Sep 17 00:00:00 2001 From: Fokko Driesprong Date: Tue, 12 Nov 2024 10:17:51 -0800 Subject: [PATCH] [SPARK-50259][BUILD] Update Parquet to 1.14.4 ### What changes were proposed in this pull request? Bumping Apache Parquet to 1.14.4 because of a critical bug when writing a dictionary larger than 8kb. For a full overview of bugfixes, see: https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.14.4 ### Why are the changes needed? A serious issue was discovered in the 1.14.x line: https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.14.4-rc2 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Existing unit tests. ### Was this patch authored or co-authored using generative AI tooling? No Closes #48790 from Fokko/fd-bump-parquet-java. Lead-authored-by: Fokko Driesprong Co-authored-by: Fokko Signed-off-by: Dongjoon Hyun --- dev/deps/spark-deps-hadoop-3-hive-2.3 | 12 ++++++------ pom.xml | 2 +- 2 files changed, 7 insertions(+), 7 deletions(-) diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3 b/dev/deps/spark-deps-hadoop-3-hive-2.3 index 048fdb9c219f5..342af10de7083 100644 --- a/dev/deps/spark-deps-hadoop-3-hive-2.3 +++ b/dev/deps/spark-deps-hadoop-3-hive-2.3 @@ -241,12 +241,12 @@ orc-shims/2.0.2//orc-shims-2.0.2.jar oro/2.0.8//oro-2.0.8.jar osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar paranamer/2.8//paranamer-2.8.jar -parquet-column/1.14.3//parquet-column-1.14.3.jar -parquet-common/1.14.3//parquet-common-1.14.3.jar -parquet-encoding/1.14.3//parquet-encoding-1.14.3.jar -parquet-format-structures/1.14.3//parquet-format-structures-1.14.3.jar -parquet-hadoop/1.14.3//parquet-hadoop-1.14.3.jar -parquet-jackson/1.14.3//parquet-jackson-1.14.3.jar +parquet-column/1.14.4//parquet-column-1.14.4.jar +parquet-common/1.14.4//parquet-common-1.14.4.jar +parquet-encoding/1.14.4//parquet-encoding-1.14.4.jar +parquet-format-structures/1.14.4//parquet-format-structures-1.14.4.jar +parquet-hadoop/1.14.4//parquet-hadoop-1.14.4.jar +parquet-jackson/1.14.4//parquet-jackson-1.14.4.jar pickle/1.5//pickle-1.5.jar py4j/0.10.9.7//py4j-0.10.9.7.jar remotetea-oncrpc/1.1.2//remotetea-oncrpc-1.1.2.jar diff --git a/pom.xml b/pom.xml index a5d978e1e981e..a0d9e44ca1634 100644 --- a/pom.xml +++ b/pom.xml @@ -138,7 +138,7 @@ 3.8.1 10.16.1.1 - 1.14.3 + 1.14.4 2.0.2 shaded-protobuf 11.0.24