Skip to content

Instantly share code, notes, and snippets.

@vanerpool

vanerpool/pyspark_tips.py

Created November 1, 2018 10:10
Show Gist options
  • Save vanerpool/9be57e925f33ba37172be1ab2f825f19 to your computer and use it in GitHub Desktop.
Save vanerpool/9be57e925f33ba37172be1ab2f825f19 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pyspark_tips.py
# insert overwrite table partition
df.write.mode("overwrite").partitionBy("col1","col2","col3").insertInto("db_name.table_name")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment