How to Create Compressed Output Files in Spark 2.0

Please see below on how to create compressed files in Spark 2.0. For Ex. It became lot easier to use the keyword “compression” “gzip” in 2.0.

See the output in the terminal:

Screen Shot 2016-08-18 at 8.44.03 PM

 

Advertisements