Skip to content

Instantly share code, notes, and snippets.

@AnilPothula

AnilPothula/aws-s3-list-objects.py

Forked from mindyyy-hsu/aws-s3-list-objects.py
Created March 14, 2021 21:14
Show Gist options
  • Save AnilPothula/d1f635028d3a62a8a653971da47a97f6 to your computer and use it in GitHub Desktop.
Save AnilPothula/d1f635028d3a62a8a653971da47a97f6 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. @mindyyy-hsu mindyyy-hsu revised this gist Jul 26, 2018. 1 changed file with 6 additions and 0 deletions.
    6 changes: 6 additions & 0 deletions aws-s3-list-objects.py
    View file
    Original file line number Diff line number Diff line change
    @@ -10,13 +10,19 @@
    aws_access_key_id=AWS_ACCESS_KEY_ID,
    aws_secret_access_key=AWS_SECRET_ACCESS_KEY,
    )

    listOfObject = []
    resp = s3.list_objects_v2(Bucket='your-bucket-name')

    for obj in resp['Contents']:
    # list key of object
    listOfObject.append(obj['Key'])
    print(obj['Key'])


    print(listOfObject)

    # list to DataFrame
    listDataFrame = pandas.DataFrame(listOfObject)
    # export to csv
    listDataFrame.to_csv('list.csv')
  2. @mindyyy-hsu mindyyy-hsu revised this gist Jul 26, 2018. No changes.
  3. @mindyyy-hsu mindyyy-hsu renamed this gist Jul 26, 2018. 1 changed file with 4 additions and 3 deletions.
    7 changes: 4 additions & 3 deletions aws-s3-list-objects → aws-s3-list-objects.py
    View file
    Original file line number Diff line number Diff line change
    @@ -1,5 +1,6 @@
    import boto3
    import pandas

    AWS_ACCESS_KEY_ID = 'YOUR_AWS_ACCESS_KEY_ID'
    AWS_SECRET_ACCESS_KEY = 'YOUR_AWS_SECRET_ACCESS_KEY'

    @@ -16,6 +17,6 @@
    print(obj['Key'])


    #print(listOfObject)
    #listDataFrame = pandas.DataFrame(listOfObject)
    #listDataFrame.to_csv('list.csv')
    print(listOfObject)
    listDataFrame = pandas.DataFrame(listOfObject)
    listDataFrame.to_csv('list.csv')
  4. @mindyyy-hsu mindyyy-hsu created this gist Jul 26, 2018.
    21 changes: 21 additions & 0 deletions aws-s3-list-objects
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,21 @@
    import boto3
    import pandas
    AWS_ACCESS_KEY_ID = 'YOUR_AWS_ACCESS_KEY_ID'
    AWS_SECRET_ACCESS_KEY = 'YOUR_AWS_SECRET_ACCESS_KEY'

    # connect to s3
    s3 = boto3.client(
    's3',
    aws_access_key_id=AWS_ACCESS_KEY_ID,
    aws_secret_access_key=AWS_SECRET_ACCESS_KEY,
    )
    listOfObject = []
    resp = s3.list_objects_v2(Bucket='your-bucket-name')
    for obj in resp['Contents']:
    listOfObject.append(obj['Key'])
    print(obj['Key'])


    #print(listOfObject)
    #listDataFrame = pandas.DataFrame(listOfObject)
    #listDataFrame.to_csv('list.csv')