Skip to content

Instantly share code, notes, and snippets.

View lanoxx's full-sized avatar

Sebastian Geiger lanoxx

  • Vienna, Austria
View GitHub Profile
@lanoxx
lanoxx / grpo_demo.py
Created January 31, 2025 06:23 — forked from willccbb/grpo_demo.py
GRPO Llama-1B
# train_grpo.py
import re
import torch
from datasets import load_dataset, Dataset
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import LoraConfig
from trl import GRPOConfig, GRPOTrainer
# Load and prep dataset
PS1='${debian_chroot:+($debian_chroot)}\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w \[\033[01;33m\]$(__git_ps1 "(%s)")\[\033[00m\] \$ '
- name: Kubernetes Master | Create service OVN Kube
blockinfile:
path: /etc/systemd/system/ovn-k8s-watcher.service
create: yes
block: |
[Unit]
Description=OVN watches the Kubernetes API
Documentation=https://github.com/openvswitch/ovn-kubernetes#watchers-on-master-node
[Service]
ExecStart=/usr/bin/ovnkube \
Name: cert-manager-webhook
Namespace: cert-manager
Labels: app=webhook
chart=webhook-v0.6.4
heritage=Tiller
release=cert-manager
Annotations: <none>
Selector: app=webhook,release=cert-manager
Type: ClusterIP
IP: 10.96.0.164
2019-06-10T17:00:24.178Z|00032|bridge|INFO|bridge br-int: added interface k8s-ip-172-35-3 on port 3
2019-06-10T17:00:24.213Z|00033|ofproto_dpif|WARN|Rejecting ct action because datapath does not support nat (your kernel module may be out of date)
2019-06-10T17:00:24.213Z|00034|connmgr|INFO|br-int<->unix#0: sending NXBAC_CT_DATAPATH_SUPPORT error reply to OFPT_FLOW_MOD message
2019-06-10T17:00:24.213Z|00035|ofproto_dpif|WARN|Rejecting ct action because datapath does not support nat (your kernel module may be out of date)
2019-06-10T17:00:24.213Z|00036|connmgr|INFO|br-int<->unix#0: sending NXBAC_CT_DATAPATH_SUPPORT error reply to OFPT_FLOW_MOD message
2019-06-10T17:00:24.213Z|00037|ofproto_dpif|WARN|Rejecting ct action because datapath does not support nat (your kernel module may be out of date)
2019-06-10T17:00:24.213Z|00038|connmgr|INFO|br-int<->unix#0: sending NXBAC_CT_DATAPATH_SUPPORT error reply to OFPT_FLOW_MOD message
2019-06-10T17:00:24.213Z|00039|ofproto_dpif|WARN|Rejecting ct action because datapath d
# Windows Node 1:
Caption CSName Description FixComments HotFixID InstallDate InstalledBy InstalledOn Name ServicePackInEffect Status
http://support.microsoft.com/?kbid=4486553 IP-172-34-35-46 Update KB4486553 NT AUTHORITY\SYSTEM 3/13/2019
http://support.microsoft.com/?kbid=4470502 IP-172-34-35-46 Update KB4470502 NT AUTHORITY\SYSTEM 12/12/2018
http://support.microsoft.com/?kbid=4470788 IP-172-34-35-46 Security Update KB4470788 NT AUTHORITY\SYSTEM 12/12/2018
http://support.microsoft.com/?kbid=4480056 IP-172-34-35-46 Update KB4480056 NT AUTHORITY\SYSTEM 1/10/2019
http://support.microsoft.com/?kbid=4489899 IP-172-34-35-46 Security Update KB4489899 NT AUTHORITY\SYSTEM 3/13/2019
# Windows Node 2:
{"cniVersion":"0.3.1","name":"ovn-kubernetes","type":"ovn-k8s-cni-overlay.exe","ipam":{},"dns":{
"servers": [
"10.96.0.10"
],
"searches": [
"custom.svc.cluster.local",
"default.svc.cluster.local",
"svc.cluster.local",
"cluster.local"
],
Windows IP Configuration
Host Name . . . . . . . . . . . . : ip-172-34-47-179
Primary Dns Suffix . . . . . . . :
Node Type . . . . . . . . . . . . : Hybrid
IP Routing Enabled. . . . . . . . : No
WINS Proxy Enabled. . . . . . . . : No
DNS Suffix Search List. . . . . . : eu-central-1.ec2-utilities.amazonaws.com
us-east-1.ec2-utilities.amazonaws.com
eu-central-1.compute.internal
switch 7b973089-1295-412d-bfaf-f4fafb87d0fa (ext_ip-172-34-34-146.eu-central-1.compute.internal)
port brens5_ip-172-34-34-146.eu-central-1.compute.internal
type: localnet
addresses: ["unknown"]
port etor-GR_ip-172-34-34-146.eu-central-1.compute.internal
type: router
addresses: ["02:66:3d:11:a0:5c"]
router-port: rtoe-GR_ip-172-34-34-146.eu-central-1.compute.internal
switch 22da943a-5ef2-4984-8e2e-4fe0ac7e87d9 (ext_windowsnode)
port etor-GR_windowsnode
/* Mini Calculator */
/* calc.lex */
%{
#include "heading.h"
#include "tok.h"
int yyerror(char *s);
#undef YY_INPUT
#define YY_INPUT(buffer,result,maxsize) \