Farshid Varno fvarno

High-Performance Matrix Multiplication

This is a short post that explains how to write a high-performance matrix multiplication program on modern processors. In this tutorial I will use a single core of the Skylake-client CPU with AVX2, but the principles in this post also apply to other processors with different instruction sets (such as AVX512).

Intro

Matrix multiplication is a mathematical operation that defines the product of

	"""
	Create train, valid, test iterators for CIFAR-10 [1].
	Easily extended to MNIST, CIFAR-100 and Imagenet.

	[1]: https://discuss.pytorch.org/t/feedback-on-pytorch-for-kaggle-competitions/2252/4
	"""

	import torch
	import numpy as np