Skip to content

Instantly share code, notes, and snippets.

@orlandotorres
orlandotorres / grpo_demo.py
Created February 1, 2025 00:43 — forked from willccbb/grpo_demo.py
GRPO Llama-1B
# train_grpo.py
import re
import torch
from datasets import load_dataset, Dataset
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import LoraConfig
from trl import GRPOConfig, GRPOTrainer
# Load and prep dataset

Harbor

Instructions to update authentication within Harbor on Photon OS.

Switch Authentication Modes

In order to switch authentication modes you must delete all the users.

docker exec -it harbor-db bash