Skip to content

Instantly share code, notes, and snippets.

@itbcodedev

itbcodedev/data-science-setup.sh

Forked from Ic3fr0g/data-science-setup.sh
Created March 16, 2019 14:34
Show Gist options
  • Save itbcodedev/27fc23dba4c3b18e3450ae198e517c95 to your computer and use it in GitHub Desktop.
Save itbcodedev/27fc23dba4c3b18e3450ae198e517c95 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. @Ic3fr0g Ic3fr0g revised this gist Dec 17, 2018. No changes.
  2. @Ic3fr0g Ic3fr0g revised this gist Dec 17, 2018. 1 changed file with 3 additions and 0 deletions.
    3 changes: 3 additions & 0 deletions data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -24,6 +24,9 @@ yum install R
    # is in PATH of root user, else export that directory to PATH
    # export PATH=$PATH:~/anaconda3/lib/

    # Fixes issues like `error while loading shared libraries: libicui18n.so.58: cannot open shared object file: No such file or directory`
    # Fixes issues like `package ‘xml2’ had non-zero exit status`

    # Install essential datascience packages in R
    R -e 'install.packages(c("tidyverse", "devtools", "ggplot2", "forecast", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel", "Metrics"))'

  3. @Ic3fr0g Ic3fr0g revised this gist Dec 17, 2018. 1 changed file with 5 additions and 4 deletions.
    9 changes: 5 additions & 4 deletions data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -18,13 +18,14 @@ vi /etc/yum.repos.d/redhat-rhui.repo
    yum install R

    # Might have to additionally install the following
    yum install libssh2-devel libgit2-devel
    # yum install libssh2-devel libgit2-devel libxml2-devel

    # Install some problematic packages
    R -e 'install.packages("devtools"); devtools::install_github("hadley/xml2")'
    # Make sure the paths of $locate libicuio.so (generally stored in ~/anaconda3/lib/)
    # is in PATH of root user, else export that directory to PATH
    # export PATH=$PATH:~/anaconda3/lib/

    # Install essential datascience packages in R
    R -e 'install.packages(c("ggplot2", "forecast", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel", "Metrics"))'
    R -e 'install.packages(c("tidyverse", "devtools", "ggplot2", "forecast", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel", "Metrics"))'

    # Command to make R kernel available in Jupyter Notebook
    R -e 'IRkernel::installspec(name="ir3.5", displayname="R35"); devtools::install_github("ellisp/forecastxgb-r-package/pkg")'
  4. @Ic3fr0g Ic3fr0g revised this gist Dec 15, 2018. 1 changed file with 8 additions and 1 deletion.
    9 changes: 8 additions & 1 deletion data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -17,7 +17,14 @@ conda install pandas numpy scipy scikit-learn keras tensorflow pytorch nltk matp
    vi /etc/yum.repos.d/redhat-rhui.repo
    yum install R

    # Might have to additionally install the following
    yum install libssh2-devel libgit2-devel

    # Install some problematic packages
    R -e 'install.packages("devtools"); devtools::install_github("hadley/xml2")'

    # Install essential datascience packages in R
    R -e 'install.packages(c("tidyverse", "ggplot2", "forecast", "devtools", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel", "Metrics"))'
    R -e 'install.packages(c("ggplot2", "forecast", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel", "Metrics"))'

    # Command to make R kernel available in Jupyter Notebook
    R -e 'IRkernel::installspec(name="ir3.5", displayname="R35"); devtools::install_github("ellisp/forecastxgb-r-package/pkg")'
  5. @Ic3fr0g Ic3fr0g revised this gist Dec 15, 2018. No changes.
  6. @Ic3fr0g Ic3fr0g revised this gist Dec 14, 2018. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -18,6 +18,6 @@ vi /etc/yum.repos.d/redhat-rhui.repo
    yum install R

    # Install essential datascience packages in R
    R -e 'install.packages(c("tidyverse", "ggplot2", "forecast", "devtools", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel"))'
    R -e 'install.packages(c("tidyverse", "ggplot2", "forecast", "devtools", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel", "Metrics"))'
    # Command to make R kernel available in Jupyter Notebook
    R -e 'IRkernel::installspec(name="ir3.5", displayname="R35"); devtools::install_github("ellisp/forecastxgb-r-package/pkg")'
  7. @Ic3fr0g Ic3fr0g revised this gist Dec 14, 2018. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -19,4 +19,5 @@ yum install R

    # Install essential datascience packages in R
    R -e 'install.packages(c("tidyverse", "ggplot2", "forecast", "devtools", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel"))'
    # Command to make R kernel available in Jupyter Notebook
    R -e 'IRkernel::installspec(name="ir3.5", displayname="R35"); devtools::install_github("ellisp/forecastxgb-r-package/pkg")'
  8. @Ic3fr0g Ic3fr0g revised this gist Dec 11, 2018. 1 changed file with 12 additions and 3 deletions.
    15 changes: 12 additions & 3 deletions data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -5,9 +5,18 @@ yum install -y wget bzip2 tmux
    # Download and run anaconda3 for python3 and follow instructions
    wget https://repo.continuum.io/archive/Anaconda3-5.3.1-Linux-x86_64.sh | sh

    # Conda installs
    # Conda install essential datascience packages
    conda update --all
    conda install pandas numpy scipy scikit-learn keras tensorflow pytorch nltk matplotlib seaborn

    # Source for R
    # https://blog.sellorm.com/2017/11/11/basic-installation-of-r-on-redhat-linux-7/
    # Source for installing R
    # https://bluehatrecord.wordpress.com/2014/10/13/installing-r-on-red-hat-enterprise-linux-6-5/

    # To install R, under [rhui-REGION-rhel-server-optional]
    # change enabled=0 to enabled=1 in the following file
    vi /etc/yum.repos.d/redhat-rhui.repo
    yum install R

    # Install essential datascience packages in R
    R -e 'install.packages(c("tidyverse", "ggplot2", "forecast", "devtools", "IRkernel", "lubridate", "caret", "doSNOW", "foreach", "doParallel"))'
    R -e 'IRkernel::installspec(name="ir3.5", displayname="R35"); devtools::install_github("ellisp/forecastxgb-r-package/pkg")'
  9. @Ic3fr0g Ic3fr0g created this gist Dec 6, 2018.
    13 changes: 13 additions & 0 deletions data-science-setup.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,13 @@
    # Need to be sudo to install the following
    yum update
    yum install -y wget bzip2 tmux

    # Download and run anaconda3 for python3 and follow instructions
    wget https://repo.continuum.io/archive/Anaconda3-5.3.1-Linux-x86_64.sh | sh

    # Conda installs
    conda update --all
    conda install pandas numpy scipy scikit-learn keras tensorflow pytorch nltk matplotlib seaborn

    # Source for R
    # https://blog.sellorm.com/2017/11/11/basic-installation-of-r-on-redhat-linux-7/