Skip to content

Instantly share code, notes, and snippets.

@tomduhourq
Created December 24, 2018 19:51
Show Gist options
  • Select an option

  • Save tomduhourq/58fe5473397d5c686a96ca8a43f51dfa to your computer and use it in GitHub Desktop.

Select an option

Save tomduhourq/58fe5473397d5c686a96ca8a43f51dfa to your computer and use it in GitHub Desktop.
SBT with elasticsearch, postgresql, http client....
name := "etl-store-availability"
version := "0.1"
scalaVersion := "2.11.8"
libraryDependencies ++= Seq(
// Spark
"org.apache.spark" %% "spark-core" % "2.3.2" % "provided",
"org.apache.spark" %% "spark-sql" % "2.3.2" % "provided",
"org.apache.spark" %% "spark-hive" % "2.3.2" % "provided",
// ElasticSearch
"org.elasticsearch" %% "elasticsearch-spark-20" % "6.5.0",
// PostgreSQL Driver
"org.postgresql" % "postgresql" % "42.2.5",
// Http client
"org.apache.httpcomponents" % "httpclient" % "4.5.6",
// Config parsing
"com.typesafe" % "config" % "1.3.2",
"com.github.andr83" %% "scalaconfig" % "0.4",
// Tests
"org.scalactic" %% "scalactic" % "3.0.5",
"org.scalatest" %% "scalatest" % "3.0.5" % "test"
)
assemblyJarName in assembly := s"${name.value}-${version.value}.jar"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment