Skip to content

Instantly share code, notes, and snippets.

@zhiming137
Forked from yorickdowne/HallOfBlame.md
Created December 22, 2023 10:13
Show Gist options
  • Save zhiming137/b05a80f3afddfd9ebf45b301e8133a8c to your computer and use it in GitHub Desktop.
Save zhiming137/b05a80f3afddfd9ebf45b301e8133a8c to your computer and use it in GitHub Desktop.

Revisions

  1. @yorickdowne yorickdowne revised this gist Dec 16, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -17,7 +17,7 @@ Other than a slow SSD model, these are things that can slow IOPS down:

    If you haven't already, do [turn off atime](https://opensource.com/article/20/6/linux-noatime) on your DB volume, it'll increase SSD lifetime and speed things up a little bit.

    The drive lists are ordered by interface and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics.
    The drive lists are ordered by interface and alphabetically by vendor name, not by preference. The lists are not exhaustive at all. @mwpastore linked a [filterable spreadsheet](https://docs.google.com/spreadsheets/d/1B27_j9NDPU3cNlj2HKcrfpJKHkOf-Oi1DbuuQva2gT4/edit#gid=0) in comments that has a far greater variety of drives and their characteristics. Filter it by DRAM yes, NAND Type TLC, Form Factor M.2, and desired capacity.

    # The Good

  2. @yorickdowne yorickdowne revised this gist Dec 16, 2023. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -64,6 +64,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Kingston Fury Renegade, 2TB/4TB
    - Mushkin Redline Vortex (but not LX), 2TB/4TB
    - Sabrent Rocket 4 Plus, 2TB/4TB/8TB
    - Sabrent Rocket 4 Plus-G, 2TB/4TB
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro, 2TB/4TB - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 2TB/4TB 218k/73k r/w IOPS
  3. @yorickdowne yorickdowne revised this gist Dec 16, 2023. 1 changed file with 11 additions and 11 deletions.
    22 changes: 11 additions & 11 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -28,7 +28,7 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low
    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold
    - Higher TBW than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices
    - 4TB available: WD Red SN700, WD Black SN850X, Mushkin Vortex, Samsung 990 Pro (not an exhaustive list)
    - 4TB available: Noted beside each drive, not an exhaustive list

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    @@ -43,7 +43,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)
    - WD Red SN700
    - WD Red SN700, 2TB/4TB

    2.5" SATA "Mainstream" - TLC, DRAM
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    @@ -56,20 +56,20 @@ Honorable Pi4 mention:
    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b) or [FxBlox](https://shop.fx.land/products/fxblox-lite-eth-edition). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a Rock5 B in future.

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - ADATA XPG Gammix S70
    - Corsair Force MP600 Pro (but not XT)
    - ADATA XPG Gammix S70, 2TB/4TB
    - Corsair Force MP600 Pro (but not XT), 2TB/4TB
    - Crucial P5 Plus
    - Kingston KC2000
    - Kingston KC3000. 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus
    - Kingston KC3000, 2TB/4TB 377k/126k r/w IOPS
    - Kingston Fury Renegade, 2TB/4TB
    - Mushkin Redline Vortex (but not LX), 2TB/4TB
    - Sabrent Rocket 4 Plus, 2TB/4TB/8TB
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - Samsung 990 Pro, 2TB/4TB - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 2TB/4TB 218k/73k r/w IOPS
    - SK Hynix P41 Platinum / Solidigm P44 Pro
    - WD Black SN850
    - WD Black SN850X, 101k/33k r/w IOPS
    - WD Black SN850X, 2TB/4TB 101k/33k r/w IOPS

    Data center SSD drives will also work well.

  4. @yorickdowne yorickdowne revised this gist Dec 16, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -62,7 +62,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Kingston KC2000
    - Kingston KC3000. 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex
    - Mushkin Redline Vortex (but not LX)
    - Sabrent Rocket 4 Plus
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
  5. @yorickdowne yorickdowne revised this gist Dec 15, 2023. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -28,6 +28,7 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low
    - Often on sale: Samsung 970 EVO Plus, SK Hynix P31 Gold
    - Higher TBW than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices
    - 4TB available: WD Red SN700, WD Black SN850X, Mushkin Vortex, Samsung 990 Pro (not an exhaustive list)

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

  6. @yorickdowne yorickdowne revised this gist Dec 15, 2023. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -4,15 +4,15 @@ Syncing an Ethereum node is largely reliant on IOPS, I/O Per Second. Budget SSDs

    This document aims to snapshot some known good and known bad models.

    For size, 2TB come recommended as of mid-2022. 1TB can work for now but is [getting tight](https://gist.github.com/yorickdowne/e4b271e1cbe8c8873884e08705084362).
    For size, 2TB come recommended as of late 2023. This should last an Ethereum full node until late 2025 or thereabouts, with crystal ball uncertainty.

    High-level, QLC and DRAMless are far slower than "mainstream" SSDs.

    IOPS wise, it's likely Geth, then Besu, then Nethermind in ascending order of IOPS requirements. I am not quite sure where Erigon fits these days.

    Other than a slow SSD model, these are things that can slow IOPS down:
    - Heat. Check with `smartctl -x`; the SSD should be below 50C so it does not throttle.
    - TRIM not being allowed. This can happen with some [hardware RAID controllers](https://gist.github.com/yorickdowne/fd36009c19fdbee0337bffc0d5ad8284), as well as on macOS with [non-Apple SSDs](https://www.lifewire.com/enable-trim-for-ssd-in-os-x-yosemite-2260789)
    - ZFS
    - RAID5/6 - write amplification is no joke
    - On SATA, the controller in UEFI/BIOS set to anything other than [AHCI](https://www.addictivetips.com/windows-tips/enable-ahci-bios/). Set it to AHCI for good performance.

    If you haven't already, do [turn off atime](https://opensource.com/article/20/6/linux-noatime) on your DB volume, it'll increase SSD lifetime and speed things up a little bit.
  7. @yorickdowne yorickdowne revised this gist Dec 3, 2023. 1 changed file with 3 additions and 1 deletion.
    4 changes: 3 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -58,7 +58,9 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - ADATA XPG Gammix S70
    - Corsair Force MP600 Pro (but not XT)
    - Crucial P5 Plus
    - Kingston KC2000 / KC3000 / Fury Renegade
    - Kingston KC2000
    - Kingston KC3000. 377k/126k r/w IOPS
    - Kingston Fury Renegade
    - Mushkin Redline Vortex
    - Sabrent Rocket 4 Plus
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
  8. @yorickdowne yorickdowne revised this gist Oct 19, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -52,7 +52,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    Honorable Pi4 mention:

    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a Rock5 B in future.
    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b) or [FxBlox](https://shop.fx.land/products/fxblox-lite-eth-edition). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a Rock5 B in future.

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - ADATA XPG Gammix S70
  9. @yorickdowne yorickdowne revised this gist Oct 19, 2023. 1 changed file with 2 additions and 5 deletions.
    7 changes: 2 additions & 5 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -93,11 +93,6 @@ These "Budget" drive models are reportedly too slow to sync (all) mainnet execut
    - Samsung 980, DRAMless - unsure, this may belong in "Ugly". If you have one and can say for sure, please come to [ethstaker Discord](https://discord.io/ethstaker).
    - Samsung T7 USB, even with current firmware

    ## Cloud

    - Contabo SSD
    - Netcup VPS Servers - reportedly able to sync Geth but not Nethermind

    # The Ugly

    "Budget" drive models that reportedly can sync mainnet execution layer clients, if slowly.
    @@ -115,5 +110,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e

    ## Cloud

    - Contabo SSD - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
    - Netcup VPS Servers - reportedly able to sync Geth 1.13.0 and Nethermind, if slowly
    - Contabo NVMe - fast enough but not enough space. 800 GiB is not sufficient.
    - Netcup RS Servers. Reportedly fast enough to sync Nethermind or Geth; still no speed demon.
  10. @yorickdowne yorickdowne revised this gist Oct 11, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -63,7 +63,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Sabrent Rocket 4 Plus
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530, 428k/143k r/w IOPS
    - Seagate Firecuda 530, 218k/73k r/w IOPS
    - SK Hynix P41 Platinum / Solidigm P44 Pro
    - WD Black SN850
    - WD Black SN850X, 101k/33k r/w IOPS
  11. @yorickdowne yorickdowne revised this gist Oct 11, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -46,7 +46,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    2.5" SATA "Mainstream" - TLC, DRAM
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA
    - Samsung 860 EVO SATA, 55k/18k r/w IOPS
    - Samsung 870 EVO SATA, 63k/20k r/w IOPS
    - WD Blue 3D NAND SATA

  12. @yorickdowne yorickdowne revised this gist Sep 20, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -52,7 +52,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    Honorable Pi4 mention:

    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b) or [CM4](https://thepihut.com/products/pci-e-to-m-2-adapter-for-raspberry-pi-cm4-io-board). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a Rock5 B in future.
    - Samsung T5 USB - works but is slow, avoid if at all possible and go for M.2 NVMe instead, with [Rock5 B](https://ameridroid.com/products/rock5-model-b). To clarify: If you stay with Pi4, then T5 USB or USB M.2 NVMe adapter should roughly perform the same. Choose either. Maybe consider going for NVMe and a USB adapter so you can upgrade to a Rock5 B in future.

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - ADATA XPG Gammix S70
  13. @yorickdowne yorickdowne revised this gist Sep 20, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -74,7 +74,7 @@ Data center SSD drives will also work well.

    - Any baremetal/dedicated server service
    - AWS i3en.2xlarge
    - AWS gp3 w/ >=10k IOPS provisioned and an m6i/a.xlarge
    - AWS gp3 w/ >=10k IOPS provisioned and an m7i/a.xlarge

    # The Bad

  14. @yorickdowne yorickdowne revised this gist Aug 8, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -56,7 +56,7 @@ Honorable Pi4 mention:

    M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - ADATA XPG Gammix S70
    - Corsair Force MP600
    - Corsair Force MP600 Pro (but not XT)
    - Crucial P5 Plus
    - Kingston KC2000 / KC3000 / Fury Renegade
    - Mushkin Redline Vortex
  15. @yorickdowne yorickdowne revised this gist May 30, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -63,7 +63,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Sabrent Rocket 4 Plus
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530
    - Seagate Firecuda 530, 428k/143k r/w IOPS
    - SK Hynix P41 Platinum / Solidigm P44 Pro
    - WD Black SN850
    - WD Black SN850X, 101k/33k r/w IOPS
  16. @yorickdowne yorickdowne revised this gist May 29, 2023. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -46,8 +46,8 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    2.5" SATA "Mainstream" - TLC, DRAM
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA.
    - Samsung 870 EVO SATA. 63k/20k IOPS
    - Samsung 860 EVO SATA
    - Samsung 870 EVO SATA, 63k/20k r/w IOPS
    - WD Blue 3D NAND SATA

    Honorable Pi4 mention:
    @@ -66,7 +66,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Seagate Firecuda 530
    - SK Hynix P41 Platinum / Solidigm P44 Pro
    - WD Black SN850
    - WD Black SN850X. 101k/33k r/w IOPS
    - WD Black SN850X, 101k/33k r/w IOPS

    Data center SSD drives will also work well.

  17. @yorickdowne yorickdowne revised this gist May 29, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -45,7 +45,7 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - WD Red SN700

    2.5" SATA "Mainstream" - TLC, DRAM
    - Crucial MX500 SATA
    - Crucial MX500 SATA, 46k/15k r/w IOPS
    - Samsung 860 EVO SATA.
    - Samsung 870 EVO SATA. 63k/20k IOPS
    - WD Blue 3D NAND SATA
  18. @yorickdowne yorickdowne revised this gist Apr 24, 2023. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -73,6 +73,7 @@ Data center SSD drives will also work well.
    ## Cloud

    - Any baremetal/dedicated server service
    - AWS i3en.2xlarge
    - AWS gp3 w/ >=10k IOPS provisioned and an m6i/a.xlarge

    # The Bad
  19. @yorickdowne yorickdowne revised this gist Apr 11, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -64,7 +64,7 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Samsung 980 Pro (**not** 980) - a [firmware update](https://www.tomshardware.com/news/samsung-980-pro-ssd-failures-firmware-update) to 5B2QGXA7 is necessary to keep them from dying, if they are firmware 3B2QGXA7. Samsung's boot Linux is a bit broken, you may want to flash [from your own Linux](https://blog.quindorian.org/2021/05/firmware-update-samsung-ssd-in-linux.html/).
    - Samsung 990 Pro - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530
    - SK Hynix P41 Platinum
    - SK Hynix P41 Platinum / Solidigm P44 Pro
    - WD Black SN850
    - WD Black SN850X. 101k/33k r/w IOPS

  20. @yorickdowne yorickdowne revised this gist Apr 10, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -13,7 +13,7 @@ IOPS wise, it's likely Geth, then Besu, then Nethermind in ascending order of IO
    Other than a slow SSD model, these are things that can slow IOPS down:
    - Heat. Check with `smartctl -x`; the SSD should be below 50C so it does not throttle.
    - TRIM not being allowed. This can happen with some [hardware RAID controllers](https://gist.github.com/yorickdowne/fd36009c19fdbee0337bffc0d5ad8284), as well as on macOS with [non-Apple SSDs](https://www.lifewire.com/enable-trim-for-ssd-in-os-x-yosemite-2260789)
    - On SATA, the controller in UEFI/BIOS set to anything other than [AHCI](https://www.addictivetips.com/windows-tips/enable-ahci-bios/)
    - On SATA, the controller in UEFI/BIOS set to anything other than [AHCI](https://www.addictivetips.com/windows-tips/enable-ahci-bios/). Set it to AHCI for good performance.

    If you haven't already, do [turn off atime](https://opensource.com/article/20/6/linux-noatime) on your DB volume, it'll increase SSD lifetime and speed things up a little bit.

  21. @yorickdowne yorickdowne revised this gist Apr 10, 2023. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -82,7 +82,8 @@ These "Budget" drive models are reportedly too slow to sync (all) mainnet execut
    ## Hardware

    - AData S40G/SX8100 4TB, QLC - the 2TB model is TLC and *should* be fine; 4TB is reportedly too slow
    - Crucial P2 and P3 (Plus), QLC and DRAMless - users report that it can sync Geth but cannot stay in sync for Nethermind
    - Crucial P1, QLC - users report it can't sync Nethermind
    - Crucial P2 and P3 (Plus), QLC and DRAMless - users report it can't sync Nethermind
    - Kingston NV1 - [probably](https://www.techpowerup.com/290339/psa-kingston-nv1-ssd-comes-with-a-hardware-spec-lottery-tlc-or-qlc-smi-or-phison) QLC and DRAMless and thus too slow on 2TB, but could be "anything" as Kingston do not guarantee specific components.
    - Kingston NV2 - like NV1 no guaranteed components
    - WD Green SN350, QLC and DRAMless
    @@ -105,7 +106,6 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e
    ## Hardware

    - Corsair MP400, QLC
    - Crucial P1, QLC
    - Inland Professional 3D NAND, QLC
    - Intel 660p, QLC. It's faster than some "mainstream" drives. 98k/33k r/w IOPS
    - Seagata Barracuda Q5, QLC
  22. @yorickdowne yorickdowne revised this gist Apr 10, 2023. 1 changed file with 2 additions and 1 deletion.
    3 changes: 2 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -82,7 +82,7 @@ These "Budget" drive models are reportedly too slow to sync (all) mainnet execut
    ## Hardware

    - AData S40G/SX8100 4TB, QLC - the 2TB model is TLC and *should* be fine; 4TB is reportedly too slow
    - Crucial P3 Plus, QLC and DRAMless - users report that it can sync Geth but cannot stay in sync for Nethermind
    - Crucial P2 and P3 (Plus), QLC and DRAMless - users report that it can sync Geth but cannot stay in sync for Nethermind
    - Kingston NV1 - [probably](https://www.techpowerup.com/290339/psa-kingston-nv1-ssd-comes-with-a-hardware-spec-lottery-tlc-or-qlc-smi-or-phison) QLC and DRAMless and thus too slow on 2TB, but could be "anything" as Kingston do not guarantee specific components.
    - Kingston NV2 - like NV1 no guaranteed components
    - WD Green SN350, QLC and DRAMless
    @@ -105,6 +105,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e
    ## Hardware

    - Corsair MP400, QLC
    - Crucial P1, QLC
    - Inland Professional 3D NAND, QLC
    - Intel 660p, QLC. It's faster than some "mainstream" drives. 98k/33k r/w IOPS
    - Seagata Barracuda Q5, QLC
  23. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 2 additions and 1 deletion.
    3 changes: 2 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -65,7 +65,8 @@ M.2 NVMe "Performance" - TLC, DRAM, PCIe 4 or 5
    - Samsung 990 Pro - there are reports of 990 Pro [rapidly losing health](https://www.tomshardware.com/news/samsung-990-pro-health-dropping-fast). A [firmware update](https://www.tomshardware.com/news/samsung-990-pro-firmware-update-released-ssd-health) to 1B2QJXD7 is meant to stop the rapid degradation, but won't reverse any that happened on earlier firmware.
    - Seagate Firecuda 530
    - SK Hynix P41 Platinum
    - WD Black SN850(X)
    - WD Black SN850
    - WD Black SN850X. 101k/33k r/w IOPS

    Data center SSD drives will also work well.

  24. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 2 additions and 1 deletion.
    3 changes: 2 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -46,7 +46,8 @@ M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3

    2.5" SATA "Mainstream" - TLC, DRAM
    - Crucial MX500 SATA
    - Samsung 860/870 EVO SATA
    - Samsung 860 EVO SATA.
    - Samsung 870 EVO SATA. 63k/20k IOPS
    - WD Blue 3D NAND SATA

    Honorable Pi4 mention:
  25. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -104,7 +104,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e

    - Corsair MP400, QLC
    - Inland Professional 3D NAND, QLC
    - Intel 660p, QLC. 98k/33k r/w IOPS
    - Intel 660p, QLC. It's faster than some "mainstream" drives. 98k/33k r/w IOPS
    - Seagata Barracuda Q5, QLC
    - WD Black SN770, DRAMless
    - Samsung 870 QVO SATA, QLC
  26. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -34,7 +34,7 @@ We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run
    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). 68k/22k r/w IOPS
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). It's slower than some QLC drives. 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
  27. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -81,7 +81,7 @@ These "Budget" drive models are reportedly too slow to sync (all) mainnet execut

    - AData S40G/SX8100 4TB, QLC - the 2TB model is TLC and *should* be fine; 4TB is reportedly too slow
    - Crucial P3 Plus, QLC and DRAMless - users report that it can sync Geth but cannot stay in sync for Nethermind
    - Kingston NV1 - [probably](https://www.techpowerup.com/290339/psa-kingston-nv1-ssd-comes-with-a-hardware-spec-lottery-tlc-or-qlc-smi-or-phison) QLC and DRAMless and thus too slow on 2TB, but could be "anything" as Kingston do not guarantee specific components. 46k/15k r/w IOPS
    - Kingston NV1 - [probably](https://www.techpowerup.com/290339/psa-kingston-nv1-ssd-comes-with-a-hardware-spec-lottery-tlc-or-qlc-smi-or-phison) QLC and DRAMless and thus too slow on 2TB, but could be "anything" as Kingston do not guarantee specific components.
    - Kingston NV2 - like NV1 no guaranteed components
    - WD Green SN350, QLC and DRAMless
    - Anything both QLC and DRAMless will likely not be able to sync at all or not be able to consistently keep up with "chain head"
  28. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -81,7 +81,7 @@ These "Budget" drive models are reportedly too slow to sync (all) mainnet execut

    - AData S40G/SX8100 4TB, QLC - the 2TB model is TLC and *should* be fine; 4TB is reportedly too slow
    - Crucial P3 Plus, QLC and DRAMless - users report that it can sync Geth but cannot stay in sync for Nethermind
    - Kingston NV1 - [probably](https://www.techpowerup.com/290339/psa-kingston-nv1-ssd-comes-with-a-hardware-spec-lottery-tlc-or-qlc-smi-or-phison) QLC and DRAMless and thus too slow on 2TB, but could be "anything" as Kingston do not guarantee specific components
    - Kingston NV1 - [probably](https://www.techpowerup.com/290339/psa-kingston-nv1-ssd-comes-with-a-hardware-spec-lottery-tlc-or-qlc-smi-or-phison) QLC and DRAMless and thus too slow on 2TB, but could be "anything" as Kingston do not guarantee specific components. 46k/15k r/w IOPS
    - Kingston NV2 - like NV1 no guaranteed components
    - WD Green SN350, QLC and DRAMless
    - Anything both QLC and DRAMless will likely not be able to sync at all or not be able to consistently keep up with "chain head"
    @@ -104,7 +104,7 @@ Note that QLC drives usually have a markedly lower TBW than TLC, and will fail e

    - Corsair MP400, QLC
    - Inland Professional 3D NAND, QLC
    - Intel 660p, QLC
    - Intel 660p, QLC. 98k/33k r/w IOPS
    - Seagata Barracuda Q5, QLC
    - WD Black SN770, DRAMless
    - Samsung 870 QVO SATA, QLC
  29. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -34,12 +34,12 @@ We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run
    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). 68k/22k r/w IOPS.
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). 68k/22k r/w IOPS
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7)
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive. 140k/46k r/w IOPS.
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7). 140k/46k r/w IOPS
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)
    - WD Red SN700
  30. @yorickdowne yorickdowne revised this gist Mar 27, 2023. 1 changed file with 4 additions and 1 deletion.
    5 changes: 4 additions & 1 deletion HallOfBlame.md
    Original file line number Diff line number Diff line change
    @@ -29,14 +29,17 @@ Note that in some cases older "Performance" PCIe 4 drives can be bought at a low
    - Higher TBW than most: Seagate Firecuda 530, WD Red SN700
    - Lowest power draw: SK Hynix P31 Gold - great choice for Rock5 B and other low-power devices

    We've started crowd-sourcing some IOPS numbers. If you want to join the fun, run `fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=150G --readwrite=randrw --rwmixread=75` and give us the read and write IOPS. Don't forget to `rm test` after.

    ## Hardware

    M.2 NVMe "Mainstream" - TLC, DRAM, PCIe 3
    - AData XPG Gammix S11/SX8200 Pro. [Several hardware revisions](https://www.tomshardware.com/news/adata-switches-nand-on-sx8200-pro-ssd-performance-impacted). 68k/22k r/w IOPS.
    - AData XPG Gammix S50 Lite
    - HP EX950
    - Mushkin Pilot-E
    - Samsung 970 EVO Plus 2TB, [pre-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 2B2QEXM7)
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive.
    - Samsung 970 EVO Plus 2TB, [post-rework](https://www.tomshardware.com/news/samsung-is-swapping-ssd-parts-too) (firmware 3B2QEXM7 or 4B2QEXM7). In testing this syncs just as quickly as the pre-rework drive. 140k/46k r/w IOPS.
    - SK Hynix P31 Gold
    - WD Black SN750 (but not SN750 SE)
    - WD Red SN700