Courses
Apache Spark
Spark Applications

Spark Applications

Lesson objectives

In this lesson, we will explain the following topics:

  • Understand the components of a Spark application, including the driver and executors.
  • Learn about the execution process of Spark applications in a distributed environment.
  • Explore the different languages supported by Spark for application development.

Apache Spark Distributed Execution

Spark Distributed Execution

  • Spark Application.
  • Spark driver.
  • Spark session.
  • Cluster manager.
  • Spark executors.
  • Deployment mode.
  • Data partition.

Spark Application

Spark Distributed Execution: Spark Application

  • A Spark application is a program designed for distributed data processing using Spark.
  • It includes a driver program to run the main function and execute parallel operations on a cluster.
  • The application divides processing tasks into smaller units called tasks, distributed across cluster nodes.
  • Spark applications support various languages like Scala, Java, Python, and R.

Spark Application

Spark Application
Spark the definitive guide, Ch.02

Watch on Youtube

Watch on our Servers

You can download the videog the link and chose save link as: Download Video