Skip to content

About

Code of example of working with Apache Spark using Java

Resources

Stars

0 stars

Watchers

0 watching

Forks

 
 

Latest commit

 

History

38 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SparkJavaExamples

Code of example of working with Apache Spark using Java

Build package

$ mvn package 

Copy the output jar to cluster and submit

$ ./bin/spark-submit \
    --class org.apache.spark.examples.SparkPi \
    --master yarn \
    --deploy-mode cluster \
    --driver-memory 4g \
    --executor-memory 16g \
    --executor-cores 4 \
    --queue default \
    --num-executors 4 \
    spark-examples*.jar \
    10

About

Code of example of working with Apache Spark using Java

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages