What is the SparkContext in Apache Spark?

Vaibhav Kothia May 26, 2023 0 Comments

The SparkContext is the entry point to any spark functionality. It is the main connection point to the Spark cluster and it allows your application to access the cluster resources. It is responsible for making RDDs, broadcasting variables, and running jobs on the cluster.

Example:

val conf = new SparkConf().setAppName(“My Spark App”).setMaster(“local[*]”)
val sc = new SparkContext(conf)