Skip to content

Instantly share code, notes, and snippets.

@0xsimulacra
Forked from yorickdowne/HallOfBlame.md
Created August 21, 2024 17:43
Show Gist options
  • Select an option

  • Save 0xsimulacra/c2073d8085fa62d880be870e76084346 to your computer and use it in GitHub Desktop.

Select an option

Save 0xsimulacra/c2073d8085fa62d880be870e76084346 to your computer and use it in GitHub Desktop.

Revisions

  1. @yorickdowne yorickdowne revised this gist Aug 14, 2024. 1 changed file with 0 additions and 1 deletion.
    1 change: 0 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -25,7 +25,6 @@ Some users have reported that NUC instability with certain drives can be cured b

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.

    - Often on sale: Teamgroup MP34
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only

  2. @yorickdowne yorickdowne revised this gist Aug 14, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -6,7 +6,7 @@ This document aims to snapshot some known good and known bad models.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).
    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. The Portal team aim to make 2TB [last forever with EIP-4444](https://blog.ethportal.net/posts/2024-portal-prague#4444s-and-execution-clients) by late 2024. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  3. @yorickdowne yorickdowne revised this gist Aug 4, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,6 @@
    # Overview

    Syncing an Ethereum node is largely reliant on latency and IOPS, I/O Per Second, of the storage. Budget SSDs will struggle to an extent, and some won't be able to sync at all. For simplicity, this page treats IOPS of a proxy for/predictor of latency.
    Syncing an Ethereum node is largely reliant on latency and IOPS, I/O Per Second, of the storage. Budget SSDs will struggle to an extent, and some won't be able to sync at all. For simplicity, this page treats IOPS as a proxy for/predictor of latency.

    This document aims to snapshot some known good and known bad models.

  4. @yorickdowne yorickdowne revised this gist Aug 4, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,6 @@
    # Overview

    Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs will struggle to an extent, and some won't be able to sync at all.
    Syncing an Ethereum node is largely reliant on latency and IOPS, I/O Per Second, of the storage. Budget SSDs will struggle to an extent, and some won't be able to sync at all. For simplicity, this page treats IOPS of a proxy for/predictor of latency.

    This document aims to snapshot some known good and known bad models.

  5. @yorickdowne yorickdowne revised this gist Jul 24, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -19,7 +19,7 @@ Other than a slow SSD model, these are things that can slow IOPS down:

    If you haven't already, do [turn off atime](https://opensource.com/article/20/6/linux-noatime) on your DB volume, it'll increase SSD lifetime and speed things up a little bit.

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.
    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0 pcie_aspm=off` to their `GRUB_CMDLINE_LINUX_DEFAULT` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    # The Good

  6. @yorickdowne yorickdowne revised this gist Jun 23, 2024. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,6 +4,8 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.
    @@ -19,8 +21,6 @@ If you haven't already, do [turn off atime](https://opensource.com/article/20/6/

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    # The Good

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.
  7. @yorickdowne yorickdowne revised this gist Jun 23, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -122,7 +122,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e

    ## Cloud

    - Netcup RS G11 Servers. Impressively fast; but it still depends on your neighbors in the service.
    - Contabo SSD - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
    - Netcup VPS Servers - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
    - Contabo NVMe - fast enough but not enough space. 800 GiB is not sufficient.
    - Netcup RS Servers. Reportedly fast enough to sync Nethermind or Geth; still no speed demon.
  8. @yorickdowne yorickdowne revised this gist May 7, 2024. 1 changed file with 0 additions and 1 deletion.
    1 change: 0 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -49,7 +49,6 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Kingston Fury Renegade, 211k/70k r/w IOPS
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
  9. @yorickdowne yorickdowne revised this gist May 7, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -46,7 +46,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 138k/46k r/w IOPS
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Kingston Fury Renegade, 211k/70k r/w IOPS
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
  10. @yorickdowne yorickdowne revised this gist May 7, 2024. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -37,7 +37,7 @@ If you have room for it and need an excellent heatsink, consider the "Rocket NVM

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Team MP34, between 94k/31k and 118k/39k r/w IOPS
    - Teamgroup MP34, between 94k/31k and 118k/39k r/w IOPS
    - WD Red SN700, 141k/47k r/w IOPS

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    @@ -53,8 +53,8 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - Transcend 250s, 127k/42k. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS
    - Transcend 250s, 127k/42k r/w IOPS. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 101k/33k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
  11. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  12. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -29,7 +29,7 @@ The drive lists are ordered by interface and then by capacity and alphabetically
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.
    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75; rm test` and give us the read and write IOPS.

    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and may not fit in some miniPC cases.

  13. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 3 deletions.
    4 changes: 1 addition & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -23,9 +23,7 @@ The drive lists are ordered by interface and then by capacity and alphabetically

    # The Good

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time. Use M.2 NVMe if your machine supports it.

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.
    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.

    - Often on sale: Teamgroup MP34
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
  14. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -33,7 +33,7 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and will not fit with all miniPC cases.
    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and may not fit in some miniPC cases.

    ## Hardware

  15. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 3 additions and 1 deletion.
    4 changes: 3 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -33,6 +33,8 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and will not fit with all miniPC cases.

    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    @@ -48,7 +50,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports its heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
  16. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 3 additions and 2 deletions.
    5 changes: 3 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -44,15 +44,16 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT")
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 138k/46k r/w IOPS
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports its heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - Transcend 250s, 127k/42k. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
  17. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -77,7 +77,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 2TB drives
    ## Cloud

    - Any baremetal/dedicated server service
    - AWS i3en.2xlarge
    - AWS i3en.(2)xlarge or is4gen.xlarge
    - AWS gp3 w/ >=10k IOPS provisioned and an m7i/a.xlarge

    # The Bad
  18. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 11 additions and 11 deletions.
    22 changes: 11 additions & 11 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -40,17 +40,6 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    - Team MP34, between 94k/31k and 118k/39k r/w IOPS
    - WD Red SN700, 141k/47k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    @@ -66,6 +55,17 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 2TB drives
    - Any data center/enterprise NVMe SSD
    - Crucial P5 Plus
  19. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 2 deletions.
    3 changes: 1 addition & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -27,10 +27,9 @@ The drive lists are ordered by interface and then by capacity and alphabetically

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.

    - Often on sale: Teamgroup MP34 4TB
    - Often on sale: Teamgroup MP34
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only
    - 4TB available: Noted beside each drive, not an exhaustive list

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

  20. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 4TB comes recommended as of mid 2024. A 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  21. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 25 additions and 19 deletions.
    44 changes: 25 additions & 19 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -19,24 +19,29 @@ If you haven't already, do [turn off atime](https://opensource.com/article/20/6/

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    The drive lists are ordered by interface and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.
    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    # The Good

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time. Use M.2 NVMe if your machine supports it.

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.

    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold, Teamgroup MP34 4TB
    - Often on sale: Teamgroup MP34 4TB
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only
    - 4TB available: Noted beside each drive, not an exhaustive list

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Team MP34, between 94k/31k and 118k/39k r/w IOPS
    - WD Red SN700, 141k/47k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    @@ -45,29 +50,30 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - Team MP34, 2TB/4TB between 94k/31k and 118k/39k r/w IOPS
    - WD Black SN750 (but not SN750 SE)
    - WD Red SN700, 2TB/4TB 141k/47k r/w IOPS

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT")
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 2TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 2TB/4TB, 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 2TB/4TB, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 2TB/4TB/8TB
    - Crucial P5 Plus
    - Kingston KC2000
    - Kingston KC3000, 2TB/4TB, 377k/126k r/w IOPS
    - Kingston Fury Renegade, 2TB/4TB
    - Mushkin Redline Vortex (but not LX), 2TB/4TB
    - Sabrent Rocket 4 Plus, 2TB/4TB/8TB
    - Sabrent Rocket 4 Plus-G, 2TB/4TB
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro, 124k/41k r/w IOPS 2TB/4TB - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 2TB/4TB 218k/73k r/w IOPS
    - SK Hynix P41 Platinum / Solidigm P44 Pro, 99k/33k r/w IOPS
    - Teamgroup MP44, 2TB/4TB/8TB 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850
    - WD Black SN850X, 2TB/4TB 101k/33k r/w IOPS

    ## Cloud

  22. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -51,6 +51,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 2TB/4TB, 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 2TB/4TB, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 2TB/4TB/8TB
    - Crucial P5 Plus
  23. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 4TB or 2TB come recommended as of mid 2024. A 2TB drive should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB comes recommended as of mid 2024. A 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

    @@ -27,7 +27,7 @@ The drive lists are ordered by interface and alphabetically by vendor name, not

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.

    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold, Teamgroup MP34
    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold, Teamgroup MP34 4TB
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices
    - 4TB available: Noted beside each drive, not an exhaustive list
  24. @yorickdowne yorickdowne revised this gist Apr 19, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -107,7 +107,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e
    - Samsung 870 QVO SATA, QLC

    2.5" SATA "Mainstream" - TLC, DRAM
    - These have been moved to "ugly" because there are user reports that only Nimbus/Geth will now sync on SATA, and even that takes 3 days. It looks like after Dencun, NVMe is now squarely the way to go.
    - These have been moved to "ugly" because there are user reports that only Nimbus/Geth will now sync on SATA, and even that takes 3 days. It looks like after Dencun, NVMe is squarely the way to go.
    - Any data center/enterprise SATA SSD
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA, 55k/18k r/w IOPS
  25. @yorickdowne yorickdowne revised this gist Apr 19, 2024. 1 changed file with 8 additions and 11 deletions.
    19 changes: 8 additions & 11 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -49,17 +49,6 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - WD Black SN750 (but not SN750 SE)
    - WD Red SN700, 2TB/4TB 141k/47k r/w IOPS

    2.5" SATA "Mainstream" - TLC, DRAM
    - Any data center/enterprise SATA SSD
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA, 55k/18k r/w IOPS
    - Samsung 870 EVO SATA, 63k/20k r/w IOPS
    - WD Blue 3D NAND SATA

    Honorable Pi4 mention:

    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b) or [FxBlox](https://shop.fx.land/products/fxblox-lite-eth-edition) or [Orange Pi 5+](http://www.orangepi.org/html/hardWare/computerAndMicrocontrollers/details/Orange-Pi-5-plus-32GB.html). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a better ARM64 platform in future.

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Any data center/enterprise NVMe SSD
    - ADATA XPG Gammix S70, 2TB/4TB, 272k/91k r/w IOPS
    @@ -117,6 +106,14 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e
    - WD Black SN770, DRAMless
    - Samsung 870 QVO SATA, QLC

    2.5" SATA "Mainstream" - TLC, DRAM
    - These have been moved to "ugly" because there are user reports that only Nimbus/Geth will now sync on SATA, and even that takes 3 days. It looks like after Dencun, NVMe is now squarely the way to go.
    - Any data center/enterprise SATA SSD
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA, 55k/18k r/w IOPS
    - Samsung 870 EVO SATA, 63k/20k r/w IOPS
    - WD Blue 3D NAND SATA

    ## Cloud

    - Contabo SSD - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
  26. @yorickdowne yorickdowne revised this gist Mar 31, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 2TB or 4TB come recommended as of mid 2024. A 2TB drive should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB or 2TB come recommended as of mid 2024. A 2TB drive should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  27. @yorickdowne yorickdowne revised this gist Mar 31, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 2TB come recommended as of late 2023. This should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.
    For size, 2TB or 4TB come recommended as of mid 2024. A 2TB drive should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  28. @yorickdowne yorickdowne revised this gist Mar 31, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -74,7 +74,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro, 124k/41k r/w IOPS 2TB/4TB - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 2TB/4TB 218k/73k r/w IOPS
    - SK Hynix P41 Platinum / Solidigm P44 Pro
    - SK Hynix P41 Platinum / Solidigm P44 Pro, 99k/33k r/w IOPS
    - Teamgroup MP44, 2TB/4TB/8TB 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850
    - WD Black SN850X, 2TB/4TB 101k/33k r/w IOPS
  29. @yorickdowne yorickdowne revised this gist Mar 31, 2024. 1 changed file with 2 additions and 0 deletions.
    2 changes: 2 additions & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -17,6 +17,8 @@ Other than a slow SSD model, these are things that can slow IOPS down:

    If you haven't already, do [turn off atime](https://opensource.com/article/20/6/linux-noatime) on your DB volume, it'll increase SSD lifetime and speed things up a little bit.

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    The drive lists are ordered by interface and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    # The Good
  30. @yorickdowne yorickdowne revised this gist Mar 25, 2024. 1 changed file with 3 additions and 2 deletions.
    5 changes: 3 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -35,6 +35,7 @@ We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run
    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    @@ -47,6 +48,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - WD Red SN700, 2TB/4TB 141k/47k r/w IOPS

    2.5" SATA "Mainstream" - TLC, DRAM
    - Any data center/enterprise SATA SSD
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA, 55k/18k r/w IOPS
    - Samsung 870 EVO SATA, 63k/20k r/w IOPS
    @@ -57,6 +59,7 @@ Honorable Pi4 mention:
    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b) or [FxBlox](https://shop.fx.land/products/fxblox-lite-eth-edition) or [Orange Pi 5+](http://www.orangepi.org/html/hardWare/computerAndMicrocontrollers/details/Orange-Pi-5-plus-32GB.html). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a better ARM64 platform in future.

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Any data center/enterprise NVMe SSD
    - ADATA XPG Gammix S70, 2TB/4TB, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 2TB/4TB/8TB
    - Crucial P5 Plus
    @@ -74,8 +77,6 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - WD Black SN850
    - WD Black SN850X, 2TB/4TB 101k/33k r/w IOPS

    Data center SSD drives will also work well.

    ## Cloud

    - Any baremetal/dedicated server service