Last active
August 23, 2025 00:40
-
-
Save awni/773e2a12079da40a1cbc566686c84c8f to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
remove the tokenizer from there and use train_dataset=CacheDataset(ds_train),
val_dataset=CacheDataset(ds_valid),