pm-hwks / aws_service_principals.txt

Last active January 6, 2025 23:50 — forked from shortjared/list.txt

List of AWS Service Principals

	a4b.amazonaws.com
	access-analyzer.amazonaws.com
	account.amazonaws.com
	acm-pca.amazonaws.com
	acm.amazonaws.com
	airflow-env.amazonaws.com
	airflow.amazonaws.com
	alexa-appkit.amazon.com
	alexa-connectedhome.amazon.com
	amazonmq.amazonaws.com

pm-hwks / ansible_update_user.yml

Created May 24, 2021 00:08 — forked from trongnghia203/ansible_update_user.yml

Ansible: Add/update/remove user

	---
	# -----------------------------------------------------------------------------------------
	# Purpose: To manage system users:
	# - create/upadate a user who is allowed accessing via ssh connection
	# - add public ssh-key of user into its authorized_keys
	# - allow user to use sudo by putting a config into /etc/sudoers.d/
	# - remove authorized_keys of inactive users
	# - remove inactive users
	# - remove sudo permission by removing its config file in /etc/sudoers.d/ if any
	# Maintanance: Nghia Le [at] INFOTECHVIET

pm-hwks / vbox_install.sh

Last active May 8, 2021 18:14

[Install Virtualbox] Install virtualbox on centos #centos #virtualbox #setup #install #virtualization


	## Reference :
	### https://phoenixnap.com/kb/how-to-install-virtualbox-centos-7

	sudo yum update -y

	### Install vboxdrv Kernel Module
	sudo yum install –y patch gcc kernel-headers kernel-devel make perl wget
	sudo reboot

pm-hwks / tmux-cheatsheet.markdown

Last active July 14, 2022 04:52 — forked from MohamedAlaa/tmux-cheatsheet.markdown

tmux shortcuts & cheatsheet

start new:

tmux

start new with session name:

tmux new -s myname

pm-hwks / kubectl-multi-version-brews.md

Created January 14, 2020 22:29 — forked from rdump/kubectl-multi-version-brews.md

kubectl multi-version brews (kubernetes-cli formula)

kubectl multi-version brews

We need to run multiple versions of kubectl for compatibility with various kubernetes clusters.

It's a bit easier to get and use multiple versions of kubectl using Homebrew than it is using Macports.

With brew, it's simple to:

pm-hwks / s3_access.sc

Created January 9, 2020 03:17

[spark/Scala - Access S3 data] Access S3 data from spark #spark #scala #s3

	// Set up AWS credentials
	sc.hadoopConfiguration.set("fs.s3a.access.key", "AKI*****************")
	sc.hadoopConfiguration.set("fs.s3a.secret.key", "kd8***********************************")

	def wordcount() = {
	// Read & process S3 file - word count
	val abc_file = sc.textFile("s3a://prms-s3/data/abc.txt")
	val counts = abc_file.flatMap(line => line.split(" ")).map(word => (word, 1)).reduceByKey(_ + _)
	//counts.saveAsTextFile("s3a://s3-to-ec2/output")
	counts.toDF().show()

pm-hwks / s3_access.py

Last active January 9, 2020 03:17

[pyspark - Access S3 data] Access S3 data from pyspark #spark #pyspark #s3

	## Reference :- https://docs.cloudera.com/documentation/enterprise/5-9-x/topics/spark_s3.html
	## Pyspark/ Python:
	## Step1 : Generate Hadoop AWS credential file (Run this on a cluster node)
	# hadoop credential create fs.s3a.access.key -provider jceks://hdfs/user/centos/awskeyfile.jceks -value AKI*****************
	# hadoop credential create fs.s3a.secret.key -provider jceks://hdfs/user/centos/awskeyfile.jceks -value kd8**********************************

	## Step 2 : simple pyspark program to access S3 file (s3_access.py)

	from pyspark import SparkConf, SparkContext
	from pyspark.sql import SparkSession

pm-hwks / pdsh.sh

Created December 11, 2019 20:36

[Parallel SSH] PDSH - Parallel ssh #ssh #pdsh

	## Macos install
	brew install pdsh

	## Skip strict host file checking - Add this to .zshrc file
	export PDSH_SSH_ARGS_APPEND="-q -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o PreferredAuthentications=publickey"

	## Setup default ssh key file in "~/.ssh/config" file
	IdentityFile "~/.ssh/xyz.pem"

	## Add an alias helper commands in the .zshrc file

pm-hwks / aws_describe_instances.sh

Last active August 26, 2019 06:41

[awscli - list of AWS instances] Using awscli & jq, get a list of running aws instances #aws #cli #awscli #jq #ec2

	# Note : (pre-reqs) : Install & configure AWSCLI, install jq

	aws ec2 describe-instances \| tee /tmp/ins \|
	jq --raw-output '.Reservations[].Instances[0] \| [ .InstanceId, .PublicIpAddress , .PrivateIpAddress, .PrivateDnsName,
	(.Tags[] \| select(.Key == "Name") \| .Value ) ] \| @tsv '

pm-hwks / iperf.sh

Created August 22, 2019 20:12

[iperf - network performance testing] Netowrk performance testing using iperf #network #iperf #perf #linux

	## Reference : https://www.tecmint.com/test-network-throughput-in-linux/

	## Install iperf
	sudo apt install iperf3 #Debian/Ubuntu
	sudo yum install iperf3 #RHEL/CentOS
	sudo dnf install iperf3 #Fedora 22+

	## Start the server an port 3000
	iperf3 -s -f K -p 3000

	# Note : (pre-reqs) : Install & configure AWSCLI, install jq

	aws ec2 describe-instances \| tee /tmp/ins \|
	jq --raw-output '.Reservations[].Instances[0] \| [ .InstanceId, .PublicIpAddress , .PrivateIpAddress, .PrivateDnsName,
	(.Tags[] \| select(.Key == "Name") \| .Value ) ] \| @tsv '

pm-hwks pm-hwks