Skip to content

Commit

Permalink
change: 1.更新readme
Browse files Browse the repository at this point in the history
  • Loading branch information
Kyofin committed Jun 26, 2019
1 parent 97b1f0d commit aa18692
Showing 1 changed file with 7 additions and 2 deletions.
9 changes: 7 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -161,10 +161,15 @@ SparkSession spark = SparkSession
.config("spark.some.config.option", "some-value")
.getOrCreate();
```
2.shell中声明`YARN_CONF_DIR``HADOOP_CONF_DIR`
```
export YARN_CONF_DIR=/Users/huzekang/opt/hadoop-cdh/hadoop-2.6.0-cdh5.14.2/etc/hadoop
export HADOOP_CONF_DIR=/Users/huzekang/opt/hadoop-cdh/hadoop-2.6.0-cdh5.14.2/etc/hadoop
```

2.使用`mvn clean package`打包好的作业,并提交到本地安装好的spark环境上跑
3.使用`mvn clean package`打包好的作业,并提交到本地安装好的yarn环境上跑。
```
~/opt/spark-2.4.0-bin-hadoop2.7 » bin/spark-submit --master yarn --deploy-mode cluster --class "com.wugui.sparkstarter.SparkHiveNewVersion" /Users/huzekang/study/spark-starter/target/spark-starter-1.0-SNAPSHOT.jar
```
3.打开yarn观察到作业已经完成了。
4.打开yarn观察到作业已经完成了。
![](https://raw.githubusercontent.com/huzekang/picbed/master/20190626133707.png)

0 comments on commit aa18692

Please sign in to comment.