Skip to content

Commit

Permalink
Merge branch 'master' into spark-3.3
Browse files Browse the repository at this point in the history
  • Loading branch information
ChinthapallyAkanksha authored Nov 2, 2022
2 parents d06de51 + 426a424 commit abe8e81
Showing 1 changed file with 14 additions and 3 deletions.
17 changes: 14 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@
Adding Quenya-DSL dependency to your sbt build:

```
libraryDependencies += "com.github.music-of-the-ainur" %% "quenya-dsl" % "1.2.2-3.3"
libraryDependencies += "com.github.music-of-the-ainur" %% "quenya-dsl" % "1.2.2-$SPARK_VERSION"
```

To run in spark-shell:

```
spark-shell --packages "com.github.music-of-the-ainur:quenya-dsl_2.13:1.2.2-3.3"
spark-shell --packages "com.github.music-of-the-ainur:quenya-dsl_2.12:1.2.0-$SPARK_VERSION"
```


Expand Down Expand Up @@ -161,6 +161,18 @@ val quenyaDsl = QuenyaDSL
quenyaDsl.printDsl(df)
```

### getDsl
You can generate and asssign a DSL to variable based on a DataFrame:

```scala
import com.github.music.of.the.ainur.quenya.QuenyaDSL

val df:DataFrame = ...
val quenyaDsl = QuenyaDSL
val dsl = quenyaDsl.getDsl(df)
```


json:
```
{
Expand Down Expand Up @@ -256,7 +268,6 @@ race$race:StringType
| DoubleType | FloatType | ByteType | IntegerType | LongType | ShortType
```


## Author
Daniel Mantovani [[email protected]](mailto:[email protected])

Expand Down

0 comments on commit abe8e81

Please sign in to comment.