Skip to content

Commit

Permalink
[SPARK-50259][BUILD] Update Parquet to 1.14.4
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?

Bumping Apache Parquet to 1.14.4 because of a critical bug when writing a dictionary larger than 8kb. For a full overview of bugfixes, see: https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.14.4

### Why are the changes needed?

A serious issue was discovered in the 1.14.x line: https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.14.4-rc2

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

Existing unit tests.

### Was this patch authored or co-authored using generative AI tooling?

No

Closes apache#48790 from Fokko/fd-bump-parquet-java.

Lead-authored-by: Fokko Driesprong <[email protected]>
Co-authored-by: Fokko <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
  • Loading branch information
Fokko authored and dongjoon-hyun committed Nov 12, 2024
1 parent e7ebda6 commit 916bf53
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 7 deletions.
12 changes: 6 additions & 6 deletions dev/deps/spark-deps-hadoop-3-hive-2.3
Original file line number Diff line number Diff line change
Expand Up @@ -241,12 +241,12 @@ orc-shims/2.0.2//orc-shims-2.0.2.jar
oro/2.0.8//oro-2.0.8.jar
osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
paranamer/2.8//paranamer-2.8.jar
parquet-column/1.14.3//parquet-column-1.14.3.jar
parquet-common/1.14.3//parquet-common-1.14.3.jar
parquet-encoding/1.14.3//parquet-encoding-1.14.3.jar
parquet-format-structures/1.14.3//parquet-format-structures-1.14.3.jar
parquet-hadoop/1.14.3//parquet-hadoop-1.14.3.jar
parquet-jackson/1.14.3//parquet-jackson-1.14.3.jar
parquet-column/1.14.4//parquet-column-1.14.4.jar
parquet-common/1.14.4//parquet-common-1.14.4.jar
parquet-encoding/1.14.4//parquet-encoding-1.14.4.jar
parquet-format-structures/1.14.4//parquet-format-structures-1.14.4.jar
parquet-hadoop/1.14.4//parquet-hadoop-1.14.4.jar
parquet-jackson/1.14.4//parquet-jackson-1.14.4.jar
pickle/1.5//pickle-1.5.jar
py4j/0.10.9.7//py4j-0.10.9.7.jar
remotetea-oncrpc/1.1.2//remotetea-oncrpc-1.1.2.jar
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -138,7 +138,7 @@
<kafka.version>3.8.1</kafka.version>
<!-- After 10.17.1.0, the minimum required version is JDK19 -->
<derby.version>10.16.1.1</derby.version>
<parquet.version>1.14.3</parquet.version>
<parquet.version>1.14.4</parquet.version>
<orc.version>2.0.2</orc.version>
<orc.classifier>shaded-protobuf</orc.classifier>
<jetty.version>11.0.24</jetty.version>
Expand Down

0 comments on commit 916bf53

Please sign in to comment.