Skip to content

Instantly share code, notes, and snippets.

@DmitryevichD

DmitryevichD/aristocrat-java-migrate-to-minio-notes.md

Last active August 15, 2022 08:31
Show Gist options
  • Save DmitryevichD/b3dc30daae44ab1ca3f36c865fa7c1c2 to your computer and use it in GitHub Desktop.
Save DmitryevichD/b3dc30daae44ab1ca3f36c865fa7c1c2 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. DmitryevichD revised this gist Aug 15, 2022. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -16,4 +16,5 @@ concern about infra:

    ~~I guess a more elegant solution is to use the Minio as the a volume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    Looking at the number of stars (6K) this is a popular approach. As an additional plus, if we want to change a storage to something else, we don't have to add any adapter to java code and we can do it transparently for dev the team.~~

    _fusefs is not a great option - its not POSIX compatible and is extremely slow_ -> [Why is s3fs such a bad idea?](https://www.reddit.com/r/aws/comments/dplfoa/why_is_s3fs_such_a_bad_idea/)
  2. DmitryevichD revised this gist Aug 15, 2022. 1 changed file with 3 additions and 2 deletions.
    5 changes: 3 additions & 2 deletions aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -14,5 +14,6 @@ concern about dev process:
    concern about infra:
    + we should create minio backets in the each latyer (dev, test, preprod, prod)

    I guess a more elegant solution is to use the Minio as the a volume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    Looking at the number of stars (6K) this is a popular approach. As an additional plus, if we want to change a storage to something else, we don't have to add any adapter to java code and we can do it transparently for dev the team.
    ~~I guess a more elegant solution is to use the Minio as the a volume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    Looking at the number of stars (6K) this is a popular approach. As an additional plus, if we want to change a storage to something else, we don't have to add any adapter to java code and we can do it transparently for dev the team.~~
    _fusefs is not a great option - its not POSIX compatible and is extremely slow_ -> [Why is s3fs such a bad idea?](https://www.reddit.com/r/aws/comments/dplfoa/why_is_s3fs_such_a_bad_idea/)
  3. DmitryevichD revised this gist Aug 15, 2022. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -14,5 +14,5 @@ concern about dev process:
    concern about infra:
    + we should create minio backets in the each latyer (dev, test, preprod, prod)

    I guess a more elegant solution is to use the Minio as the a valume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    I guess a more elegant solution is to use the Minio as the a volume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    Looking at the number of stars (6K) this is a popular approach. As an additional plus, if we want to change a storage to something else, we don't have to add any adapter to java code and we can do it transparently for dev the team.
  4. DmitryevichD revised this gist Aug 15, 2022. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -14,5 +14,5 @@ concern about dev process:
    concern about infra:
    + we should create minio backets in the each latyer (dev, test, preprod, prod)

    I guess a more elegant sulution it to use the Minio as the a valume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    I guess a more elegant solution is to use the Minio as the a valume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    Looking at the number of stars (6K) this is a popular approach. As an additional plus, if we want to change a storage to something else, we don't have to add any adapter to java code and we can do it transparently for dev the team.
  5. DmitryevichD revised this gist Aug 15, 2022. 1 changed file with 5 additions and 5 deletions.
    10 changes: 5 additions & 5 deletions aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -1,7 +1,8 @@
    export files to minio

    To add minio to service I am going to do (estimate arond 5d):
    + add a spring-boot dependency to work with minio
    To add minio to service I am going to do (estimate arond 10d):
    + add a spring-boot dependency to work with minio (ncube-reporting-batch-processor) 5d
    + add a spring-boot dependency to work with minio (ncube-reporting-configuration-application) 5d
    + create a property flag that can on\off this functional (It's set to off by default)
    + add a logic to the ReportPDFWriter and ReportPDFWriter classes
    + add tests
    @@ -12,7 +13,6 @@ concern about dev process:

    concern about infra:
    + we should create minio backets in the each latyer (dev, test, preprod, prod)
    + we have to find out the all external system that use this files and check how they will work when we go to the minio (global regress of the reportingDB)

    maybe an alternative way is:
    + use rclone utils which can copy files from directory to minio https://docs.min.io/docs/rclone-with-minio-server.html
    I guess a more elegant sulution it to use the Minio as the a valume mount in the pod. I looked the [s3fs-fuse](https://github.com/s3fs-fuse/s3fs-fuse#references) and it can do it.
    Looking at the number of stars (6K) this is a popular approach. As an additional plus, if we want to change a storage to something else, we don't have to add any adapter to java code and we can do it transparently for dev the team.
  6. DmitryevichD revised this gist Aug 10, 2022. No changes.
  7. DmitryevichD revised this gist Aug 10, 2022. 1 changed file with 4 additions and 2 deletions.
    6 changes: 4 additions & 2 deletions aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -5,10 +5,12 @@ To add minio to service I am going to do (estimate arond 5d):
    + create a property flag that can on\off this functional (It's set to off by default)
    + add a logic to the ReportPDFWriter and ReportPDFWriter classes
    + add tests
    + concern about dev process:

    concern about dev process:
    * which branch should be used to merge the minio changes?
    * who will do a code review and tests?
    + concern about infra:

    concern about infra:
    + we should create minio backets in the each latyer (dev, test, preprod, prod)
    + we have to find out the all external system that use this files and check how they will work when we go to the minio (global regress of the reportingDB)

  8. DmitryevichD revised this gist Aug 10, 2022. 1 changed file with 2 additions and 1 deletion.
    3 changes: 2 additions & 1 deletion aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -1,5 +1,6 @@
    export files to minio
    + To add minio to service I am going to do (estimate arond 5d):

    To add minio to service I am going to do (estimate arond 5d):
    + add a spring-boot dependency to work with minio
    + create a property flag that can on\off this functional (It's set to off by default)
    + add a logic to the ReportPDFWriter and ReportPDFWriter classes
  9. DmitryevichD created this gist Aug 10, 2022.
    15 changes: 15 additions & 0 deletions aristocrat-java-migrate-to-minio-notes.md
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,15 @@
    export files to minio
    + To add minio to service I am going to do (estimate arond 5d):
    + add a spring-boot dependency to work with minio
    + create a property flag that can on\off this functional (It's set to off by default)
    + add a logic to the ReportPDFWriter and ReportPDFWriter classes
    + add tests
    + concern about dev process:
    * which branch should be used to merge the minio changes?
    * who will do a code review and tests?
    + concern about infra:
    + we should create minio backets in the each latyer (dev, test, preprod, prod)
    + we have to find out the all external system that use this files and check how they will work when we go to the minio (global regress of the reportingDB)

    maybe an alternative way is:
    + use rclone utils which can copy files from directory to minio https://docs.min.io/docs/rclone-with-minio-server.html