spark 提交submit任务的shell脚本

sudo -u hdfs /usr/hdp/2.6.5.0-292/spark2/bin/spark-submit
–master yarn
–deploy-mode cluster
–driver-cores 1
–driver-memory 2g
–num-executors 3
–executor-memory 1g
–executor-cores 1
–class main.scala.controllers.test.TestDealData
–conf spark.default.parallelism=9
–conf spark.storage.memoryFraction=0.4
–conf spark.shuffle.memoryFraction=0.4
/bigdata/app_jars/bigdataCount.jar