Deploy a Scala Spark job on GCP Dataproc with IntelliJ

To create a Scala Spark job for GCP Dataproc, ensure you correctly configure dependencies in your build.sbt for compatibility with the target Dataproc image.

Installing IntelliJ and Scala plugin is the first step. After creating a new Scala project, defining the necessary Spark dependencies in build.sbt follows.

Read at Medium