Skip to content

Instantly share code, notes, and snippets.

@yaravind

yaravind/spark-shell-init-load-file

Last active April 10, 2020 01:38
Show Gist options
  • Save yaravind/944fd9c65e7e19eb972add9d341fb1c0 to your computer and use it in GitHub Desktop.
Save yaravind/944fd9c65e7e19eb972add9d341fb1c0 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. yaravind revised this gist Apr 10, 2020. 1 changed file with 3 additions and 1 deletion.
    4 changes: 3 additions & 1 deletion spark-shell-init-load-file
    View file
    Original file line number Diff line number Diff line change
    @@ -2,4 +2,6 @@

    import org.apache.spark.sql.types._
    import com.databricks.spark.xml._
    import org.apache.spark.sql.functions._
    import org.apache.spark.sql.functions._
    // For implicit conversions like converting RDDs to DataFrames
    import spark.implicits._
  2. yaravind revised this gist May 26, 2019. 1 changed file with 2 additions and 0 deletions.
    2 changes: 2 additions & 0 deletions spark-shell-init-load-file
    View file
    Original file line number Diff line number Diff line change
    @@ -1,3 +1,5 @@
    :paste

    import org.apache.spark.sql.types._
    import com.databricks.spark.xml._
    import org.apache.spark.sql.functions._
  3. yaravind created this gist May 25, 2019.
    3 changes: 3 additions & 0 deletions spark-shell-init-load-file
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,3 @@
    import org.apache.spark.sql.types._
    import com.databricks.spark.xml._
    import org.apache.spark.sql.functions._