Skip to content

Commit

Permalink
Merge pull request modakanalytics#28 from rohithvangapalli/spark-3.1
Browse files Browse the repository at this point in the history
Updated the spark and almaren version
  • Loading branch information
badrinathpatchikolla authored Sep 21, 2023
2 parents d369ee4 + fc88a61 commit c7e48ce
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 9 deletions.
18 changes: 10 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,24 +6,26 @@ JDBC Connector allows you to execute any SQL statement using Apache Spark.

To add JDBC connector dependency to your sbt build:
```
libraryDependencies += "com.github.music-of-the-ainur" %% "jdbc-almaren" % "0.0.5-3.1"
libraryDependencies += "com.github.music-of-the-ainur" %% "jdbc-almaren" % "0.0.6-3.1"
```

To run in spark-shell:
```
spark-shell --master "local[*]" --packages "com.github.music-of-the-ainur:almaren-framework_2.12:0.9.8-3.1,com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.5-3.1"
spark-shell --master "local[*]" --packages "com.github.music-of-the-ainur:almaren-framework_2.12:0.9.10-3.1,com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.6-3.1"
```
JDBC Connector is available in [Maven Central](https://mvnrepository.com/artifact/com.github.music-of-the-ainur) repository.


| versions | Connector Artifact |
|----------------------------|-------------------------------------------------------------|
| Spark 3.3.x and scala 2.13 | `com.github.music-of-the-ainur:jdbc-almaren_2.13:0.0.5-3.3` |
| Spark 3.3.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.5-3.3` |
| Spark 3.2.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.5-3.2` |
| Spark 3.1.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.5-3.1` |
| Spark 2.4.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.5-2.4` |
| Spark 2.4.x and scala 2.11 | `com.github.music-of-the-ainur:jdbc-almaren_2.11:0.0.5-2.4` |
| Spark 3.4.x and scala 2.13 | `com.github.music-of-the-ainur:jdbc-almaren_2.13:0.0.6-3.4` |
| Spark 3.4.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.6-3.4` |
| Spark 3.3.x and scala 2.13 | `com.github.music-of-the-ainur:jdbc-almaren_2.13:0.0.6-3.3` |
| Spark 3.3.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.6-3.3` |
| Spark 3.2.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.6-3.2` |
| Spark 3.1.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.6-3.1` |
| Spark 2.4.x and scala 2.12 | `com.github.music-of-the-ainur:jdbc-almaren_2.12:0.0.6-2.4` |
| Spark 2.4.x and scala 2.11 | `com.github.music-of-the-ainur:jdbc-almaren_2.11:0.0.6-2.4` |

## JDBC Batch

Expand Down
2 changes: 1 addition & 1 deletion build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ scalacOptions ++= Seq("-deprecation", "-feature")
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % sparkVersion % "provided",
"org.apache.spark" %% "spark-sql" % sparkVersion % "provided",
"com.github.music-of-the-ainur" %% "almaren-framework" % s"0.9.8-${majorVersion}" % "provided",
"com.github.music-of-the-ainur" %% "almaren-framework" % s"0.9.10-${majorVersion}" % "provided",
"com.typesafe.scala-logging" %% "scala-logging" % "3.9.5",
"org.scalikejdbc" %% "scalikejdbc" % "3.4.0",
"org.scalatest" %% "scalatest" % "3.2.14" % "test",
Expand Down

0 comments on commit c7e48ce

Please sign in to comment.