spark architecture

Spark Installation In this section, we will perform the installation of Spark. So, follow the below steps. Download the Apache Spark tar…

Spark Char Count Example In Spark char count example, we find out the frequency of each character exists in a particular file.…

Spark Filter Function In Spark, the Filter function returns a new dataset formed by selecting those elements of the source on which…

Spark Word Count Example In Spark word count example, we find out the frequency of each word exists in a particular file.…

Spark First Function In Spark, the First function always returns the first element of the dataset. It is similar to take(1). Example…

Spark groupByKey Function In Spark, the groupByKey function is a frequently used transformation operation that performs shuffling of data. It receives key-value…

Spark Intersection Function In Spark, Intersection function returns a new dataset that contains the intersection of elements present in the different datasets.…

What is Spark? Apache Spark is an open-source cluster computing framework. Its primary purpose is to handle the real-time generated data. Spark…

Spark Map function In Spark, the Map passes each element of the source through a function and forms a new distributed dataset.…

RDD Operations The RDD provides the two types of operations: Transformation Action Transformation In Spark, the role of transformation is to create…