spark architecture

Spark Components The Spark project consists of different types of tightly integrated components. At its core, Spark is a computational engine that…

Spark Take Function In Spark, the take function behaves like an array. It receives an integer value (let say, n) as a…

Spark Count Function In Spark, the Count function returns the number of elements present in the dataset. Example of Count function In…

Apache Spark Tutorial Apache Spark tutorial provides basic and advanced concepts of Spark. Our Spark tutorial is designed for beginners and professionals.…

Spark Distinct Function In Spark, the Distinct function returns the distinct elements from the provided dataset. Example of Distinct function In this…

Spark Union Function In Spark, Union function returns a new dataset that contains the combination of elements present in the different datasets.…

Spark Filter Function In Spark, the Filter function returns a new dataset formed by selecting those elements of the source on which…

Spark Word Count Example In Spark word count example, we find out the frequency of each word exists in a particular file.…

Spark First Function In Spark, the First function always returns the first element of the dataset. It is similar to take(1). Example…

Spark groupByKey Function In Spark, the groupByKey function is a frequently used transformation operation that performs shuffling of data. It receives key-value…