Skip to content

Commit

Permalink
typo in 2-JobLogicalPlan.md
Browse files Browse the repository at this point in the history
  • Loading branch information
lukasnalezenec authored Apr 12, 2018
1 parent 20e97f1 commit 1f65e50
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion EnglishVersion/2-JobLogicalPlan.md
Original file line number Diff line number Diff line change
Expand Up @@ -151,7 +151,7 @@ We have talked about `groupByKey`'s dependency before, now we make it more clear

![reduceyByKey](../PNGfigures/reduceByKey.png)

`reduceByKey()` is similar to `reduce()` in MapReduce. The data flow is equivalent. `redcuceByKey` enables map-side combine by default, which is carried out by `mapPartitions()` before shuffle and results in `MapPartitionsRDD`. After shuffle, `aggregate + mapPartitions()` is applied to `ShuffledRDD`. Again, we get a `MapPartitionsRDD`.
`reduceByKey()` is similar to `reduce()` in MapReduce. The data flow is equivalent. `reduceByKey` enables map-side combine by default, which is carried out by `mapPartitions()` before shuffle and results in `MapPartitionsRDD`. After shuffle, `aggregate + mapPartitions()` is applied to `ShuffledRDD`. Again, we get a `MapPartitionsRDD`.

**3) distinct(numPartitions)**

Expand Down

0 comments on commit 1f65e50

Please sign in to comment.