Samay Kapadia sa-

Principal ML Eng @ Zalando

yoyama / Schema2CaseClass.scala

Created January 20, 2017 07:36

Generate case class from spark DataFrame/Dataset schema.

	/**
	* Generate Case class from DataFrame.schema
	*
	* val df:DataFrame = ...
	*
	* val s2cc = new Schema2CaseClass
	* import s2cc.implicit._
	*
	* println(s2cc.schemaToCaseClass(df.schema, "MyClass"))
	*

miguelsaddress / memInfo.scala

Last active October 26, 2020 16:13

Fetch info about the memory of you machine with Scala

	import scala.language.postfixOps
	import scala.util.{Success, Failure}
	import scala.concurrent.ExecutionContext.Implicits.global
	import scala.concurrent.duration._
	import scala.concurrent._
	import scala.util.Try

	import sys.process._
	import concurrent.Future
	import concurrent.Promise

bwhite / rank_metrics.py

Created September 15, 2012 03:23

Ranking Metrics

	"""Information Retrieval metrics

	Useful Resources:
	http://www.cs.utexas.edu/~mooney/ir-course/slides/Evaluation.ppt
	http://www.nii.ac.jp/TechReports/05-014E.pdf
	http://www.stanford.edu/class/cs276/handouts/EvaluationNew-handout-6-per.pdf
	http://hal.archives-ouvertes.fr/docs/00/72/67/60/PDF/07-busa-fekete.pdf
	Learning to Rank for Information Retrieval (Tie-Yan Liu)
	"""
	import numpy as np

jboner / latency.txt

Last active November 2, 2025 13:31

Latency Numbers Every Programmer Should Know

	Latency Comparison Numbers (~2012)
	----------------------------------
	L1 cache reference 0.5 ns
	Branch mispredict 5 ns
	L2 cache reference 7 ns 14x L1 cache
	Mutex lock/unlock 25 ns
	Main memory reference 100 ns 20x L2 cache, 200x L1 cache
	Compress 1K bytes with Zippy 3,000 ns 3 us
	Send 1K bytes over 1 Gbps network 10,000 ns 10 us
	Read 4K randomly from SSD* 150,000 ns 150 us ~1GB/sec SSD