Spark Ecosystem

Apache Spark consists of following components.

  1. Spark Core
  2. Spark SQL
  3. Spark Streaming
  4. Spark MLlib
  5. Spark GraphX
  6. SparkR

Spark Core is the heart of Spark Ecosystem.

It is the fundamental component of Spark. It is an API. It uses a specialized fundamental data structure known as RDD (Resilient Distributed Datasets). It contains the basic functionality of Spark, including components for task scheduling, memory management, fault recovery, interacting with storage systems. 

All other components of spark ecosystem are built on top of spark core.

Scroll to Top