Skip to content

Instantly share code, notes, and snippets.

@skghosh-invn

skghosh-invn/emr_spark_thrift_on_yarn

Forked from elliottcordo/emr_spark_thrift_on_yarn
Created June 8, 2016 19:18
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save skghosh-invn/f7cf2afe4ffea8bf3b23c90a571cf588 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save skghosh-invn/f7cf2afe4ffea8bf3b23c90a571cf588 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. @elliottcordo elliottcordo created this gist Dec 15, 2014.
    5 changes: 5 additions & 0 deletions emr_spark_thrift_on_yarn
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,5 @@
    #on cluster
    thrift /spark/sbin/start-thriftserver.sh --master yarn-client
    #ssh tunnel, direct 10000 to unused 8157
    ssh -i ~/caserta-1.pem -N -L 8157:ec2-54-221-27-21.compute-1.amazonaws.com:10000 [email protected]
    #see this for JDBC config on client http://blogs.aws.amazon.com/bigdata/post/TxT7CJ0E7CRX88/Using-Amazon-EMR-with-SQL-Workbench-and-other-BI-Tools