What is RDD? The RDD (Resilient Distributed Dataset) is the Spark’s core abstraction. It is a collection of elements, partitioned across the…
Tag:
rdd persistence
-
-
Spark reduceByKey Function In Spark, the reduceByKey function is a frequently used transformation operation that performs aggregation of data. It receives key-value…
-
Spark cogroup Function In Spark, the cogroup function performs on different datasets, let’s say, (K, V) and (K, W) and returns a…
-
Spark sortByKey Function In Spark, the sortByKey function maintains the order of elements. It receives key-value pairs (K, V) as an input,…
-
Spark Components The Spark project consists of different types of tightly integrated components. At its core, Spark is a computational engine that…
-
Spark Take Function In Spark, the take function behaves like an array. It receives an integer value (let say, n) as a…
-
Spark Count Function In Spark, the Count function returns the number of elements present in the dataset. Example of Count function In…
-
Apache Spark Tutorial Apache Spark tutorial provides basic and advanced concepts of Spark. Our Spark tutorial is designed for beginners and professionals.…
-
Spark Distinct Function In Spark, the Distinct function returns the distinct elements from the provided dataset. Example of Distinct function In this…
-
Spark Union Function In Spark, Union function returns a new dataset that contains the combination of elements present in the different datasets.…