automaticcat tikikun

I have taken quite some machine learning courses and have done a few projects already. I think I know the math formula involved in transformers and GPT models. However, I always wondered how they work in reality. The best way for me is to read and understand source codes implementing these models. I am a C/C++ programmer mostly. I am more comfortable to read C/C++ programs. So, recently I started to read, run, and debug ggml's gpt-2 inference example since ggml is entirely written in C and can run many transformer models on a laptop: https://github.com/ggerganov/ggml/tree/master/examples/gpt-2 . The famous llama.cpp is closely connected to this library. My experiment environment is a MacBook Pro laptop+ Visual Studio Code + cmake+ CodeLLDB (gdb does not work with my M2 chip), and GPT-2 117 M model. Here is what I have learned so far:

The high-level main function has the following structure https://github.com/ggerganov/ggml/blob/master/examples/gpt-2/main-backend.cpp

load the model: ggml specific format us

Semantic Commit Messages

See how a minor change to your commit message style can make you a better programmer.

Format: <type>(<scope>): <subject>

<scope> is optional

Example

Things to remember when compiling/linking C/C++ software

by Angel Leon. March 17, 2015;

Updated August 29, 2019.

Updated last on February 27, 2023

Include Paths

On the compilation phase, you will usually need to specify the different include paths so that the interfaces (.h, .hpp) which define structs, classes, constants, and functions can be found.

	import threading
	from IPython.display import display
	import ipywidgets as widgets
	import time
	def get_ioloop():
	import IPython, zmq
	ipython = IPython.get_ipython()
	if ipython and hasattr(ipython, 'kernel'):
	return zmq.eventloop.ioloop.IOLoop.instance()
	ioloop = get_ioloop()

	import threading
	from IPython.display import display
	import ipywidgets as widgets
	import time
	def get_ioloop():
	import IPython, zmq
	ipython = IPython.get_ipython()
	if ipython and hasattr(ipython, 'kernel'):
	return zmq.eventloop.ioloop.IOLoop.instance()
	ioloop = get_ioloop()

	#!/usr/bin/env python

	import string
	import random

	def password_generator(size=8, chars=string.ascii_letters + string.digits):
	"""
	Returns a string of random characters, useful in generating temporary
	passwords for automated password resets.

	#!/usr/bin/env python
	# -- coding: utf-8 --
	"""Chương trình chuyển đổi từ Tiếng Việt có dấu sang Tiếng Việt không dấu
	Chỉnh sửa từ mã nguồn của anh NamNT
	http://www.vithon.org/2009/06/14/x%E1%BB%AD-ly-ti%E1%BA%BFng-vi%E1%BB%87t-trong-python
	"""

	import re

	INTAB = "ạảãàáâậầấẩẫăắằặẳẵóòọõỏôộổỗồốơờớợởỡéèẻẹẽêếềệểễúùụủũưựữửừứíìịỉĩýỳỷỵỹđẠẢÃÀÁÂẬẦẤẨẪĂẮẰẶẲẴÓÒỌÕỎÔỘỔỖỒỐƠỜỚỢỞỠÉÈẺẸẼÊẾỀỆỂỄÚÙỤỦŨƯỰỮỬỪỨÍÌỊỈĨÝỲỶỴỸĐ"