Skip to content

Instantly share code, notes, and snippets.

View chenpx976's full-sized avatar

color chenpx976

35 followers · 170 following
View GitHub Profile
@chenpx976
chenpx976 / README_hfd.md
Last active June 27, 2024 12:28 — forked from padeoe/README_hfd.md
CLI-Tool for download Huggingface models and datasets with aria2/wget+git

🤗Huggingface Model Downloader

Considering the lack of multi-threaded download support in the official huggingface-cli, and the inadequate error handling in hf_transfer, this command-line tool smartly utilizes wget or aria2 for LFS files and git clone for the rest.

Features

  • ⏯️ Resume from breakpoint: You can re-run it or Ctrl+C anytime.
  • 🚀 Multi-threaded Download: Utilize multiple threads to speed up the download process.
  • 🚫 File Exclusion: Use --exclude or --include to skip or specify files, save time for models with duplicate formats (e.g., *.bin or *.safetensors).
  • 🔐 Auth Support: For gated models that require Huggingface login, use --hf_username and --hf_token to authenticate.
  • 🪞 Mirror Site Support: Set up with HF_ENDPOINT environment variable.
@chenpx976
chenpx976 / aseprite_install_m2.sh
Last active October 19, 2023 01:55 — forked from ryancat/aseprite_install.sh
Download and install aseprite
#!/bin/bash
# Must have git, homebrew, and xcode to install
# Make sure to change line 29 and line 30 according to your mac OS and xcode versions
# Install ninja compiler
brew install ninja
# Install CMake for makefile
brew install cmake
@chenpx976
chenpx976 / laravel-5-tweak-login-authcontroller.php
Created February 23, 2017 06:40 — forked from AlexanderPoellmann/laravel-5-tweak-login-authcontroller.php
Log in with Username or Email in Laravel 5 - AuthController->postLogin()
<?php
/**
* This snippet goes into your
* \app\Http\Controllers\Auth\AuthController.php
*
* Make sure to update your login view as well
* (\resources\views\auth\login.blade.php). Just
* change
*/