Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.
Avoid being a link dump. Try to provide only valuable well tuned information.
Neural network links before starting with transformers.
Georges Pantalos gpantalos
apaszke
/ jacobian_hessian.py
Last active
August 8, 2025 07:29
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import torch | |
| def jacobian(y, x, create_graph=False): | |
| jac = [] | |
| flat_y = y.reshape(-1) | |
| grad_y = torch.zeros_like(flat_y) | |
| for i in range(len(flat_y)): | |
| grad_y[i] = 1. | |
| grad_x, = torch.autograd.grad(flat_y, x, grad_y, retain_graph=True, create_graph=create_graph) | |
| jac.append(grad_x.reshape(x.shape)) |
dusty-nv
/ pytorch_jetson_install.sh
Last active
March 21, 2025 16:39
Install procedure for pyTorch on NVIDIA Jetson TX1/TX2 with JetPack <= 3.2.1. For JetPack 4.2 and Xavier/Nano/TX2, see https://devtalk.nvidia.com/default/topic/1049071/jetson-nano/pytorch-for-jetson-nano/
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # | |
| # EDIT: this script is outdated, please see https://forums.developer.nvidia.com/t/pytorch-for-jetson-nano-version-1-6-0-now-available | |
| # | |
| sudo apt-get install python-pip | |
| # upgrade pip | |
| pip install -U pip | |
| pip --version | |
| # pip 9.0.1 from /home/ubuntu/.local/lib/python2.7/site-packages (python 2.7) |