Skip to content

Instantly share code, notes, and snippets.

@zerotag

zerotag/DownloadFilesFromRepo.ps1

Forked from chrisbrownie/DownloadFilesFromRepo.ps1
Created June 15, 2019 12:45
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save zerotag/cfc7d57eef5df9ae29ef8a56a367e6dc to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save zerotag/cfc7d57eef5df9ae29ef8a56a367e6dc to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. zerotag revised this gist Jun 15, 2019. 1 changed file with 103 additions and 39 deletions.
    142 changes: 103 additions & 39 deletions DownloadFilesFromRepo.ps1
    View file
    Original file line number Diff line number Diff line change
    @@ -1,40 +1,104 @@
    function DownloadFilesFromRepo {
    Param(
    [string]$Owner,
    [string]$Repository,
    [string]$Path,
    [string]$DestinationPath
    )

    $baseUri = "https://api.github.com/"
    $args = "repos/$Owner/$Repository/contents/$Path"
    $wr = Invoke-WebRequest -Uri $($baseuri+$args)
    $objects = $wr.Content | ConvertFrom-Json
    $files = $objects | where {$_.type -eq "file"} | Select -exp download_url
    $directories = $objects | where {$_.type -eq "dir"}

    $directories | ForEach-Object {
    DownloadFilesFromRepo -Owner $Owner -Repository $Repository -Path $_.path -DestinationPath $($DestinationPath+$_.name)
    }


    if (-not (Test-Path $DestinationPath)) {
    # Destination path does not exist, let's create it
    try {
    New-Item -Path $DestinationPath -ItemType Directory -ErrorAction Stop
    } catch {
    throw "Could not create path '$DestinationPath'!"
    }
    }

    foreach ($file in $files) {
    $fileDestination = Join-Path $DestinationPath (Split-Path $file -Leaf)
    try {
    Invoke-WebRequest -Uri $file -OutFile $fileDestination -ErrorAction Stop -Verbose
    "Grabbed '$($file)' to '$fileDestination'"
    } catch {
    throw "Unable to download '$($file.path)'"
    }
    }

    }

    <#
    .SYNOPSIS
    This function retrieves the specified repository on GitHub to a local directory with authentication.
    .DESCRIPTION
    This function retrieves the specified repository on GitHub to a local directory with authentication, being a single file, a complete folder, or the entire repository.
    .PARAMETER User
    Your GitHub username, for using the Authenticated Service. Providing 5000 requests per hour.
    Without this you will be limited to 60 requests per hour.
    See for more information: https://developer.github.com/v3/auth/
    .PARAMETER Token
    The parameter Token is the generated token for authenticated users.
    Create one here (after logging in on your account): https://github.com/settings/tokens
    .PARAMETER Owner
    Owner of the repository you want to download from.
    .PARAMETER Repository
    The repository name you want to download from.
    .PARAMETER Path
    The path inside the repository you want to download from.
    If empty, the function will iterate the whole repository.
    Alternatively you can specify a single file.
    .PARAMETER DestinationPath
    The local folder you want to download the repository to.
    .EXAMPLE
    PS C:\> DownloadFilesFromRepo -User "MyUsername" -Token "My40CharactersLongToken" -Owner "GitHubDeveloper" -Repository "RepositoryName" -Path "InternalFolder" -DestinationPath "C:/MyDownloadedRepository"
    .NOTES
    Author: chrisbrownie | https://gist.github.com/chrisbrownie/f20cb4508975fb7fb5da145d3d38024a
    Modified: zeroTAG | https://gist.github.com/zerotag/78207737bafba0792c98663e81f211bf
    Last Edit: 2019-06-15
    Version 1.0 - initial release of DownloadFilesFromRepo
    #>

    Param(
    [Parameter(Mandatory=$True)]
    [string]$User,

    [Parameter(Mandatory=$True)]
    [string]$Token,

    [Parameter(Mandatory=$True)]
    [string]$Owner,

    [Parameter(Mandatory=$True)]
    [string]$Repository,

    [Parameter(Mandatory=$True)]
    [AllowEmptyString()]
    [string]$Path,

    [Parameter(Mandatory=$True)]
    [string]$DestinationPath
    )

    # Authentication
    $authPair = "$($User):$($Token)";
    $encAuth = [System.Convert]::ToBase64String([System.Text.Encoding]::ASCII.GetBytes($authPair));
    $headers = @{ Authorization = "Basic $encAuth" };

    # REST Building
    $baseUri = "https://api.github.com";
    $argsUri = "repos/$Owner/$Repository/contents/$Path";
    $wr = Invoke-WebRequest -Uri ("$baseUri/$argsUri") -Headers $headers;

    # Data Handler
    $objects = $wr.Content | ConvertFrom-Json
    $files = $objects | where {$_.type -eq "file"} | Select -exp download_url
    $directories = $objects | where {$_.type -eq "dir"}

    # Iterate Directory
    $directories | ForEach-Object {
    DownloadFilesFromRepo -User $User -Token $Token -Owner $Owner -Repository $Repository -Path $_.path -DestinationPath "$($DestinationPath)/$($_.name)"
    }

    # Destination Handler
    if (-not (Test-Path $DestinationPath)) {
    try {
    New-Item -Path $DestinationPath -ItemType Directory -ErrorAction Stop;
    } catch {
    throw "Could not create path '$DestinationPath'!";
    }
    }

    # Iterate Files
    foreach ($file in $files) {
    $fileDestination = Join-Path $DestinationPath (Split-Path $file -Leaf)
    $outputFilename = $fileDestination.Replace("%20", " ");
    try {
    Invoke-WebRequest -Uri "$file" -OutFile "$outputFilename" -ErrorAction Stop -Verbose
    "Grabbed '$($file)' to '$outputFilename'";
    } catch {
    throw "Unable to download '$($file)'";
    }
    }
    }
  2. @chrisbrownie chrisbrownie created this gist Dec 6, 2016.
    40 changes: 40 additions & 0 deletions DownloadFilesFromRepo.ps1
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,40 @@
    function DownloadFilesFromRepo {
    Param(
    [string]$Owner,
    [string]$Repository,
    [string]$Path,
    [string]$DestinationPath
    )

    $baseUri = "https://api.github.com/"
    $args = "repos/$Owner/$Repository/contents/$Path"
    $wr = Invoke-WebRequest -Uri $($baseuri+$args)
    $objects = $wr.Content | ConvertFrom-Json
    $files = $objects | where {$_.type -eq "file"} | Select -exp download_url
    $directories = $objects | where {$_.type -eq "dir"}

    $directories | ForEach-Object {
    DownloadFilesFromRepo -Owner $Owner -Repository $Repository -Path $_.path -DestinationPath $($DestinationPath+$_.name)
    }


    if (-not (Test-Path $DestinationPath)) {
    # Destination path does not exist, let's create it
    try {
    New-Item -Path $DestinationPath -ItemType Directory -ErrorAction Stop
    } catch {
    throw "Could not create path '$DestinationPath'!"
    }
    }

    foreach ($file in $files) {
    $fileDestination = Join-Path $DestinationPath (Split-Path $file -Leaf)
    try {
    Invoke-WebRequest -Uri $file -OutFile $fileDestination -ErrorAction Stop -Verbose
    "Grabbed '$($file)' to '$fileDestination'"
    } catch {
    throw "Unable to download '$($file.path)'"
    }
    }

    }