Skip to content

Instantly share code, notes, and snippets.

@AnilPothula
Forked from mindyyy-hsu/aws-s3-list-objects.py
Created March 14, 2021 21:14
Show Gist options
  • Save AnilPothula/d1f635028d3a62a8a653971da47a97f6 to your computer and use it in GitHub Desktop.
Save AnilPothula/d1f635028d3a62a8a653971da47a97f6 to your computer and use it in GitHub Desktop.
AWS Simple-Storage-Service (S3) objects list and export to csv.
import boto3
import pandas
AWS_ACCESS_KEY_ID = 'YOUR_AWS_ACCESS_KEY_ID'
AWS_SECRET_ACCESS_KEY = 'YOUR_AWS_SECRET_ACCESS_KEY'
# connect to s3
s3 = boto3.client(
's3',
aws_access_key_id=AWS_ACCESS_KEY_ID,
aws_secret_access_key=AWS_SECRET_ACCESS_KEY,
)
listOfObject = []
resp = s3.list_objects_v2(Bucket='your-bucket-name')
for obj in resp['Contents']:
listOfObject.append(obj['Key'])
print(obj['Key'])
#print(listOfObject)
#listDataFrame = pandas.DataFrame(listOfObject)
#listDataFrame.to_csv('list.csv')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment