Skip to content

Instantly share code, notes, and snippets.

@myopicOracle
Forked from yorickdowne/HallOfBlame.md
Created March 4, 2025 22:25
Show Gist options
  • Select an option

  • Save myopicOracle/a67b8b4e20a05f7aaa988ad4421f8b1a to your computer and use it in GitHub Desktop.

Select an option

Save myopicOracle/a67b8b4e20a05f7aaa988ad4421f8b1a to your computer and use it in GitHub Desktop.

Revisions

  1. @yorickdowne yorickdowne revised this gist Jan 16, 2025. 1 changed file with 1 addition and 2 deletions.
    3 changes: 1 addition & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -13,8 +13,7 @@ High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lowe
    Other than a slow SSD model, these are things that can slow IOPS down:
    - Heat. Check with `smartctl -x`; the SSD should be below 50C so it does not throttle.
    - TRIM not being allowed. This can happen with some [hardware RAID controllers](https://gist.github.com/yorickdowne/fd36009c19fdbee0337bffc0d5ad8284), as well as on macOS with [non-Apple SSDs](https://www.lifewire.com/enable-trim-for-ssd-in-os-x-yosemite-2260789)
    - ZFS
    - BTRFS
    - ZFS, BTRFS, any CoW file system
    - RAID5/6 - write amplification is no joke
    - On SATA, the controller in UEFI/BIOS set to anything other than [AHCI](https://www.addictivetips.com/windows-tips/enable-ahci-bios/). Set it to AHCI for good performance.

  2. @yorickdowne yorickdowne revised this gist Jan 16, 2025. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -52,7 +52,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - Teamgroup MP44 (but not MP44L or MP44Q), 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - Transcend 250s, 127k/42k r/w IOPS. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 101k/33k r/w IOPS

  3. @yorickdowne yorickdowne revised this gist Jan 16, 2025. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -14,6 +14,7 @@ Other than a slow SSD model, these are things that can slow IOPS down:
    - Heat. Check with `smartctl -x`; the SSD should be below 50C so it does not throttle.
    - TRIM not being allowed. This can happen with some [hardware RAID controllers](https://gist.github.com/yorickdowne/fd36009c19fdbee0337bffc0d5ad8284), as well as on macOS with [non-Apple SSDs](https://www.lifewire.com/enable-trim-for-ssd-in-os-x-yosemite-2260789)
    - ZFS
    - BTRFS
    - RAID5/6 - write amplification is no joke
    - On SATA, the controller in UEFI/BIOS set to anything other than [AHCI](https://www.addictivetips.com/windows-tips/enable-ahci-bios/). Set it to AHCI for good performance.

  4. @yorickdowne yorickdowne revised this gist Jan 16, 2025. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -26,7 +26,7 @@ Some users have reported that NUC instability with certain drives can be cured b
    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.

    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only
    - Lowest power draw: SK Hynix P31 Gold - is a great choice for Rock5 B and other low-power devices, but 2TB only

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75; rm test` and give us the read and write IOPS.

  5. @yorickdowne yorickdowne revised this gist Jan 16, 2025. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -6,7 +6,7 @@ This document aims to snapshot some known good and known bad models.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. The Portal team aim to make 2TB [last forever with EIP-4444](https://blog.ethportal.net/posts/2024-portal-prague#4444s-and-execution-clients) by late 2024. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).
    For size, 4TB is a very conservative choice. The smaller 2TB drive should last an Ethereum full node until at least sometime 2026, with the [pre-merge history expiry](https://hackmd.io/@hBXHLw_9Qq2va4pRtI4bIA/ryzBaf7fJx) scheduled for May 1st 2025. The Portal team aim to make 2TB [last forever with EIP-4444](https://blog.ethportal.net/posts/2024-portal-prague#4444s-and-execution-clients). Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  6. @yorickdowne yorickdowne revised this gist Oct 6, 2024. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -44,6 +44,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 138k/46k r/w IOPS
    - Crucial T700, 215k/71k r/w IOPS
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade, 211k/70k r/w IOPS
    - Mushkin Redline Vortex (but not LX)
  7. @yorickdowne yorickdowne revised this gist Aug 14, 2024. 1 changed file with 0 additions and 1 deletion.
    1 change: 0 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -25,7 +25,6 @@ Some users have reported that NUC instability with certain drives can be cured b

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.

    - Often on sale: Teamgroup MP34
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only

  8. @yorickdowne yorickdowne revised this gist Aug 14, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -6,7 +6,7 @@ This document aims to snapshot some known good and known bad models.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).
    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. The Portal team aim to make 2TB [last forever with EIP-4444](https://blog.ethportal.net/posts/2024-portal-prague#4444s-and-execution-clients) by late 2024. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  9. @yorickdowne yorickdowne revised this gist Aug 4, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,6 @@
    # Overview

    Syncing an Ethereum node is largely reliant on latency and IOPS, I/O Per Second, of the storage. Budget SSDs will struggle to an extent, and some won't be able to sync at all. For simplicity, this page treats IOPS of a proxy for/predictor of latency.
    Syncing an Ethereum node is largely reliant on latency and IOPS, I/O Per Second, of the storage. Budget SSDs will struggle to an extent, and some won't be able to sync at all. For simplicity, this page treats IOPS as a proxy for/predictor of latency.

    This document aims to snapshot some known good and known bad models.

  10. @yorickdowne yorickdowne revised this gist Aug 4, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,6 @@
    # Overview

    Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs will struggle to an extent, and some won't be able to sync at all.
    Syncing an Ethereum node is largely reliant on latency and IOPS, I/O Per Second, of the storage. Budget SSDs will struggle to an extent, and some won't be able to sync at all. For simplicity, this page treats IOPS of a proxy for/predictor of latency.

    This document aims to snapshot some known good and known bad models.

  11. @yorickdowne yorickdowne revised this gist Jul 24, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -19,7 +19,7 @@ Other than a slow SSD model, these are things that can slow IOPS down:

    If you haven't already, do [turn off atime](https://opensource.com/article/20/6/linux-noatime) on your DB volume, it'll increase SSD lifetime and speed things up a little bit.

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.
    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0 pcie_aspm=off` to their `GRUB_CMDLINE_LINUX_DEFAULT` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    # The Good

  12. @yorickdowne yorickdowne revised this gist Jun 23, 2024. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,6 +4,8 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.
    @@ -19,8 +21,6 @@ If you haven't already, do [turn off atime](https://opensource.com/article/20/6/

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    # The Good

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.
  13. @yorickdowne yorickdowne revised this gist Jun 23, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -122,7 +122,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e

    ## Cloud

    - Netcup RS G11 Servers. Impressively fast; but it still depends on your neighbors in the service.
    - Contabo SSD - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
    - Netcup VPS Servers - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
    - Contabo NVMe - fast enough but not enough space. 800 GiB is not sufficient.
    - Netcup RS Servers. Reportedly fast enough to sync Nethermind or Geth; still no speed demon.
  14. @yorickdowne yorickdowne revised this gist May 7, 2024. 1 changed file with 0 additions and 1 deletion.
    1 change: 0 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -49,7 +49,6 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Kingston Fury Renegade, 211k/70k r/w IOPS
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
  15. @yorickdowne yorickdowne revised this gist May 7, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -46,7 +46,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 138k/46k r/w IOPS
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Kingston Fury Renegade, 211k/70k r/w IOPS
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
  16. @yorickdowne yorickdowne revised this gist May 7, 2024. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -37,7 +37,7 @@ If you have room for it and need an excellent heatsink, consider the "Rocket NVM

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Team MP34, between 94k/31k and 118k/39k r/w IOPS
    - Teamgroup MP34, between 94k/31k and 118k/39k r/w IOPS
    - WD Red SN700, 141k/47k r/w IOPS

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    @@ -53,8 +53,8 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - Transcend 250s, 127k/42k. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS
    - Transcend 250s, 127k/42k r/w IOPS. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 101k/33k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
  17. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty. Remy wrote a [migration guide to 4TB](https://github.com/eth-educators/ethstaker-guides/blob/main/migrating-to-a-larger-disk.md).

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  18. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -29,7 +29,7 @@ The drive lists are ordered by interface and then by capacity and alphabetically
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.
    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75; rm test` and give us the read and write IOPS.

    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and may not fit in some miniPC cases.

  19. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 3 deletions.
    4 changes: 1 addition & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -23,9 +23,7 @@ The drive lists are ordered by interface and then by capacity and alphabetically

    # The Good

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time. Use M.2 NVMe if your machine supports it.

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.
    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time.

    - Often on sale: Teamgroup MP34
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
  20. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -33,7 +33,7 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and will not fit with all miniPC cases.
    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and may not fit in some miniPC cases.

    ## Hardware

  21. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 3 additions and 1 deletion.
    4 changes: 3 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -33,6 +33,8 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    If you have room for it and need an excellent heatsink, consider the "Rocket NVMe Heatsink". It is quite high however, and will not fit with all miniPC cases.

    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    @@ -48,7 +50,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports its heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports the Rocket NVMe Heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
  22. @yorickdowne yorickdowne revised this gist May 5, 2024. 1 changed file with 3 additions and 2 deletions.
    5 changes: 3 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -44,15 +44,16 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT")
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 138k/46k r/w IOPS
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus
    - Sabrent Rocket 4 Plus, 149k/49k r/w IOPS. @SnoepNFTs reports its heatsink keeps it very cool.
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - Transcend 250s, 127k/42k. @SnoepNFTs reports it gets very hot, you'd want to add a good heatsink to it.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
  23. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -77,7 +77,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 2TB drives
    ## Cloud

    - Any baremetal/dedicated server service
    - AWS i3en.2xlarge
    - AWS i3en.(2)xlarge or is4gen.xlarge
    - AWS gp3 w/ >=10k IOPS provisioned and an m7i/a.xlarge

    # The Bad
  24. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 11 additions and 11 deletions.
    22 changes: 11 additions & 11 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -40,17 +40,6 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    - Team MP34, between 94k/31k and 118k/39k r/w IOPS
    - WD Red SN700, 141k/47k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    @@ -66,6 +55,17 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 2TB drives
    - Any data center/enterprise NVMe SSD
    - Crucial P5 Plus
  25. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 2 deletions.
    3 changes: 1 addition & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -27,10 +27,9 @@ The drive lists are ordered by interface and then by capacity and alphabetically

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.

    - Often on sale: Teamgroup MP34 4TB
    - Often on sale: Teamgroup MP34
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only
    - 4TB available: Noted beside each drive, not an exhaustive list

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

  26. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 4TB comes recommended as of mid 2024. A 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB comes recommended as of mid 2024. The smaller 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

  27. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 25 additions and 19 deletions.
    44 changes: 25 additions & 19 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -19,24 +19,29 @@ If you haven't already, do [turn off atime](https://opensource.com/article/20/6/

    Some users have reported that NUC instability with certain drives can be cured by adding `nvme_core.default_ps_max_latency_us=0` to their `GRUB_CMDLINE_LINUX` kernel parameters via `sudo nano /etc/default/grub` and `sudo update-grub`. This keeps the drive from entering powersave states by itself.

    The drive lists are ordered by interface and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.
    The drive lists are ordered by interface and then by capacity and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    # The Good

    "Mainstream" and "Performance" drive models that can sync mainnet execution layer clients in a reasonable amount of time. Use M.2 NVMe if your machine supports it.

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.

    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold, Teamgroup MP34 4TB
    - Often on sale: Teamgroup MP34 4TB
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices
    - Lowest power draw: SK Hynix P31 Gold - was a great choice for Rock5 B and other low-power devices, but 2TB only
    - 4TB available: Noted beside each drive, not an exhaustive list

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Team MP34, between 94k/31k and 118k/39k r/w IOPS
    - WD Red SN700, 141k/47k r/w IOPS

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3, 2TB drives
    - Any data center/enterprise NVMe SSD
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    @@ -45,29 +50,30 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - Team MP34, 2TB/4TB between 94k/31k and 118k/39k r/w IOPS
    - WD Black SN750 (but not SN750 SE)
    - WD Red SN700, 2TB/4TB 141k/47k r/w IOPS

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 4TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT")
    - Kingston KC3000, 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus
    - Sabrent Rocket 4 Plus-G
    - Samsung 990 Pro, 124k/41k r/w IOPS - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Teamgroup MP44, 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850X, 4TB 101k/33k r/w IOPS

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5, 2TB drives
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 2TB/4TB, 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 2TB/4TB, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 2TB/4TB/8TB
    - Crucial P5 Plus
    - Kingston KC2000
    - Kingston KC3000, 2TB/4TB, 377k/126k r/w IOPS
    - Kingston Fury Renegade, 2TB/4TB
    - Mushkin Redline Vortex (but not LX), 2TB/4TB
    - Sabrent Rocket 4 Plus, 2TB/4TB/8TB
    - Sabrent Rocket 4 Plus-G, 2TB/4TB
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro, 124k/41k r/w IOPS 2TB/4TB - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 2TB/4TB 218k/73k r/w IOPS
    - SK Hynix P41 Platinum / Solidigm P44 Pro, 99k/33k r/w IOPS
    - Teamgroup MP44, 2TB/4TB/8TB 105k/35k r/w IOPS - caution that this is DRAMless and uses a Host Memory Buffer (HMB), yet appears to perform fine.
    - WD Black SN850
    - WD Black SN850X, 2TB/4TB 101k/33k r/w IOPS

    ## Cloud

  28. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -51,6 +51,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Any data center/enterprise NVMe SSD
    - Acer GM7000 "Predator", 2TB/4TB, 125k/41k r/w IOPS
    - ADATA XPG Gammix S70, 2TB/4TB, 272k/91k r/w IOPS
    - Corsair Force MP600 Pro and variants (but not "MP600 Core XT"), 2TB/4TB/8TB
    - Crucial P5 Plus
  29. @yorickdowne yorickdowne revised this gist May 1, 2024. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,7 +4,7 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 4TB or 2TB come recommended as of mid 2024. A 2TB drive should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.
    For size, 4TB comes recommended as of mid 2024. A 2TB drive should last an Ethereum full node until early 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs. QLC has lower endurance as well. Any savings will be gone when the drive fails early and needs to be replaced.

    @@ -27,7 +27,7 @@ The drive lists are ordered by interface and alphabetically by vendor name, not

    Note that in some cases older "Performance" PCIe 4 drives can be bought at a lower price than a PCIe 3 "Mainstream" drive - shop around.

    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold, Teamgroup MP34
    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold, Teamgroup MP34 4TB
    - Higher endurance (TBW) than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices
    - 4TB available: Noted beside each drive, not an exhaustive list
  30. @yorickdowne yorickdowne revised this gist Apr 19, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -107,7 +107,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e
    - Samsung 870 QVO SATA, QLC

    2.5" SATA "Mainstream" - TLC, DRAM
    - These have been moved to "ugly" because there are user reports that only Nimbus/Geth will now sync on SATA, and even that takes 3 days. It looks like after Dencun, NVMe is now squarely the way to go.
    - These have been moved to "ugly" because there are user reports that only Nimbus/Geth will now sync on SATA, and even that takes 3 days. It looks like after Dencun, NVMe is squarely the way to go.
    - Any data center/enterprise SATA SSD
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA, 55k/18k r/w IOPS