Skip to content

Instantly share code, notes, and snippets.

View juangon's full-sized avatar

Juan G. juangon

  • Valladolid, Spain.
View GitHub Profile
@juangon
juangon / grpo_demo.py
Created January 31, 2025 10:40 — forked from willccbb/grpo_demo.py
GRPO Llama-1B
# train_grpo.py
import re
import torch
from datasets import load_dataset, Dataset
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import LoraConfig
from trl import GRPOConfig, GRPOTrainer
# Load and prep dataset
2018-02-14 13:31:46,116 INFO [org.wildfly.swarm] (Thread-3) WFSWARM0027: Shutdown requested
2018-02-14 13:31:46,116 INFO [org.jboss.as.server] (Thread-4) WFLYSRV0220: Server shutdown has been requested via an OS signal
2018-02-14 13:31:46,147 INFO [org.wildfly.extension.undertow] (MSC service thread 1-3) WFLYUT0008: Undertow HTTP listener default suspending
2018-02-14 13:31:46,147 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 9) WFLYUT0022: Unregistered web context: '/' from server 'default-server'
2018-02-14 13:31:46,147 INFO [org.wildfly.extension.undertow] (MSC service thread 1-3) WFLYUT0007: Undertow HTTP listener default stopped, was bound to [0:0:0:0:0:0:0:0]:8080
2018-02-14 13:31:46,163 INFO [org.wildfly.extension.undertow] (MSC service thread 1-7) WFLYUT0019: Host default-host stopping
2018-02-14 13:31:46,163 INFO [org.wildfly.extension.undertow] (MSC service thread 1-7) WFLYUT0004: Undertow 1.4.18.Final stopping
2018-02-14 13:31:46,194 INFO [org.jboss.as.server.deploymen
2017-12-22 16:30:08,633 INFO [stdout] (Thread-3) Removing created file:C:\Users\IEUser\AppData\Local\Temp\jackson-jaxrs-base-2.8.97006622116192937769.jar
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3) Exception in thread "Thread-3" java.lang.RuntimeException: java.nio.file.FileSystemException: C:\Users\IEUser\AppData\Local\Temp\jackson-jaxrs-base-2.8.97006622116192937769.jar: The proces
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3)
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3) at org.wildfly.swarm.container.runtime.RuntimeServer.lambda$new$0(RuntimeServer.java:121)
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3) at java.lang.Thread.run(Unknown Source)
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3) Caused by: java.nio.file.FileSystemException: C:\Users\IEUser\AppData\Local\Temp\jackson-jaxrs-base-2.8.97006622116192937769.jar: The process cannot access the file because it is being use
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3)
2017-12-22 16:30:08,633 ERROR [stderr] (Thread-3)
---Stack trace for:wfswarmbean-validation-2018.2.0-SNAPSHOT8913572735094525493.jar
java.lang.Thread.getStackTrace(Unknown Source)
org.wildfly.swarm.bootstrap.modules.UberJarMavenResolver.printStackTrace(UberJarMavenResolver.java:113)
org.wildfly.swarm.bootstrap.modules.UberJarMavenResolver.copyTempJar(UberJarMavenResolver.java:53)
org.wildfly.swarm.bootstrap.modules.UberJarMavenResolver.resolveArtifact(UberJarMavenResolver.java:74)
org.wildfly.swarm.bootstrap.modules.MultiMavenResolver.resolveArtifact(MultiMavenResolver.java:47)
org.jboss.modules.maven.MavenResolver.resolveJarArtifact(MavenResolver.java:40)
org.wildfly.swarm.bootstrap.modules.BootstrapModuleFinder.lambda$buildModule$0(BootstrapModuleFinder.java:69)
java.util.ArrayList.forEach(Unknown Source)
org.wildfly.swarm.bootstrap.modules.BootstrapModuleFinder.buildModule(BootstrapModuleFinder.java:67)