Skip to content

About

Code of example of working with Apache Spark using Java

Resources

Stars

0 stars

Watchers

0 watching

Forks

 
 

Latest commit

 

History

43 Commits

Folders and files

Repository files navigation

SparkJavaExamples

Code of example of working with Apache Spark using Java

Build package

$ mvn package 

Copy the output jar to cluster and submit

$ ./bin/spark-submit \
    --class org.apache.spark.examples.SparkPi \
    --master yarn \
    --deploy-mode cluster \
    --driver-memory 4g \
    --executor-memory 16g \
    --executor-cores 4 \
    --queue default \
    --num-executors 4 \
    spark-examples*.jar \
    10

About

Code of example of working with Apache Spark using Java

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages