francoisfernando

Create a new repository, or reuse an existing one.

Generate a new SSH key:

ssh-keygen -t rsa -C "[email protected]"

Copy the contents of the file ~/.ssh/id_rsa.pub to your SSH keys in your GitHub account settings (https://github.com/settings/keys).

Test SSH key:

Get the source distribution from Spark Github releases page. Extract it somewhere. Following was tested on MacOS.

# Run following script from root of extracted directory
./dev/make-distribution.sh --name spark-2.4.4-hadoop-2.9.2 --pip --tgz -DskipTests -Psparkpy -Phadoop-2.9 -Dhadoop.version=2.9.2 -Pkubernetes

This will build a .tgz binary distribution at root of extracted directory. Extract the binary distibution locally.

Java, do you trust me? 🤔

Using openssl to test an SSL connection to google.com, using a CA file that's been pulled out from a Java keystore. For those days when you want to verify that you've got the right certificate in the store:

Download the Equifax root certificate (which is the root CA for Google)
Import the certificate into a new Java keystore
Export the certificate back out again
Convert the certificate to PEM
Use openssl to test an SSL connection to Google with that cert

PSQL

Magic words:

psql -U postgres

Some interesting flags (to see all, use -h):

-E: will describe the underlaying queries of the \ commands (cool for learning!)
-l: psql will list all databases and then exit (useful if the user you connect with doesn't has a default database, like at AWS RDS)

	# Compile and install certificates for the Java trust keystore
	# and main keystore. Let's face it, this is everyone's keystore password.
	# Note I install java very flatly normally.
	COPY trust-certs/ /usr/local/share/ca-certificates/
	RUN update-ca-certificates && \
	ls -1 /usr/local/share/ca-certificates \| while read cert; do \
	openssl x509 -outform der -in /usr/local/share/ca-certificates/$cert -out $cert.der; \
	/java/bin/keytool -import -alias $cert -keystore /java/jre/lib/security/cacerts -trustcacerts -file $cert.der -storepass changeit -noprompt; \
	rm $cert.der; \
	done

	import javax.net.ssl.SSLSocket;
	import javax.net.ssl.SSLSocketFactory;
	import java.io.*;

	/** Establish a SSL connection to a host and port, writes a byte and
	* prints the response. See
	* http://confluence.atlassian.com/display/JIRA/Connecting+to+SSL+services
	*/
	public class SSLPoke {
	public static void main(String[] args) {

	So you've cloned somebody's repo from github, but now you want to fork it and contribute back. Never fear!

	if you want to follow convention:

	1. Fork their repo on Github
	2. In your local, rename your origin remote to upstream

	git remote rename origin upstream

	3. Add a new origin