Girish Pasupathy girip11

Local setup to debug airflow using VSCODE

I did this setup after reading this blogpost of Willem. I can't thank him enough for this wonderful blogpost.

Directory structure

Under the workspace root folder I created airflow_local which I set as AIRFLOW_HOME. The structure of this directory looks as follows

config - In this directory, I kept the variables.json, secrets.json(which is again variables but these are secrets) and connections.json
logs - Logs directory

Setup MacOS shortcuts to be same as Ubuntu

I have been using Ubuntu for last few years. Now I have to work on Mac OS for work. But I still use personal laptop which has Ubuntu. So I decided to setup the Mac OS shortcuts to be exactly same as in Ubuntu.

Prerequisites

Karabiner-elements
Goku - To create the karabiner configuration in a concise format(EDN)
Hammerspoon

Python 3.8.13 installation on Mac M1

Install the following

# install pyenv using brew if not already installed
brew install pyenv
brew install openssl readline sqlite3 xz zlib

# Install python 3.8.13

brew install libpq
echo 'export PATH="/opt/homebrew/opt/libpq/bin:$PATH"' >> $HOME/.bash_profile

export PATH="/opt/homebrew/opt/libpq/bin:$PATH"
brew install openssl
export LDFLAGS="-L/opt/homebrew/opt/openssl@3/lib"
export CPPFLAGS="-I/opt/homebrew/opt/openssl@3/include"

pip install psycopg2-binary==2.9.3 --force-reinstall --no-cache-dir

tmux cheatsheet

As configured in my dotfiles.

start new:

tmux

start new with session name:

Kernel settings for installation

Use a live usb to try Ubuntu before installing. Boot from the live usb. On the GRUB screen highlight the "Try Ubuntu ...." option and press e. Update kernel parameters by adding options before quiet splash such that the line should read as below

nogpumanager nomodeset i915.modeset=1 quiet splash

Note: On HighDPI screen machines there is a known issue whereby Ubiquity (ubuntu installer) craashes at the copying files step i.e. immediatly after the user setup screen. The cause and workaround are discussed in other gist post

Persist GRUB configuration

Post installation, to avoid updating the above mentioned kernel options each time the system is booted, edit GRUB configuration file sudo vi /etc/default/grub and make th

People

`:bowtie:`	😄 `:smile:`	😆 `:laughing:`
😊 `:blush:`	😃 `:smiley:`	☺️ `:relaxed:`
😏 `:smirk:`	😍 `:heart_eyes:`	😘 `:kissing_heart:`
😚 `:kissing_closed_eyes:`	😳 `:flushed:`	😌 `:relieved:`
😆 `:satisfied:`	😁 `:grin:`	😉 `:wink:`
😜 `:stuck_out_tongue_winking_eye:`	😝 `:stuck_out_tongue_closed_eyes:`	😀 `:grinning:`
😗 `:kissing:`	😙 `:kissing_smiling_eyes:`	😛 `:stuck_out_tongue:`

Pipenv Cheat Sheet

Install pipenv

pip3 install pipenv

Activate

pipenv shell

	// Future versions of Hyper may add additional config options,
	// which will not automatically be merged into this file.
	// See https://hyper.is#cfg for all currently supported options.

	module.exports = {
	config: {
	// choose either `'stable'` for receiving highly polished,
	// or `'canary'` for less polished but more frequent updates
	updateChannel: 'stable',