Skip to content

Instantly share code, notes, and snippets.

View danielOliveira97's full-sized avatar

Daniel Oliveira danielOliveira97

2 followers · 27 following
View GitHub Profile
@danielOliveira97
danielOliveira97 / combineS3Files.py
Created November 8, 2022 20:37 — forked from jasonrdsouza/combineS3Files.py
Python script to efficiently concatenate S3 files
'''
This script performs efficient concatenation of files stored in S3. Given a
folder, output location, and optional suffix, all files with the given suffix
will be concatenated into one file stored in the output location.
Concatenation is performed within S3 when possible, falling back to local
operations when necessary.
Run `python combineS3Files.py -h` for more info.
'''
@danielOliveira97
danielOliveira97 / combineS3Files.py
Created November 8, 2022 20:37 — forked from jasonrdsouza/combineS3Files.py
Python script to efficiently concatenate S3 files
'''
This script performs efficient concatenation of files stored in S3. Given a
folder, output location, and optional suffix, all files with the given suffix
will be concatenated into one file stored in the output location.
Concatenation is performed within S3 when possible, falling back to local
operations when necessary.
Run `python combineS3Files.py -h` for more info.
'''
@danielOliveira97
danielOliveira97 / get-started-with-kind-in-wsl2-installation-instructions.md
Created September 30, 2021 14:47 — forked from alexchiri/get-started-with-kind-in-wsl2-installation-instructions.md
Get started with kind in WSL2 - installation instructions