#spark-sql

[ follow ]
Medium
3 months ago
Data science

From CSV to Parquet: A Journey Through File Formats in Apache Spark with Scala

SparkSession is used as the entry point to Spark SQL functionality.
Different file formats like CSV, Parquet, JSON, and Avro can be read into DataFrames in Spark. [ more ]
[ Load more ]