disk cage(s) including heating

the nice thing about those cages: they come already with big 12V fans 😀 (which are noise wise very okay on full speed!)

• it would (most likely) be a good idea to run the harddisks vertically (like backblaze does it) and not horizontally because vibrations will not make the head crash into the magnetic disks (someone walking by or godzilla dropping a skyscraper)
  • 
    

    https://www.youtube.com/watch?v=IgJ6YolLxYE

• this howto aims to build an energy efficient storage server that can store 1PetaByte reliably
• backblaze.com has an interesting concept: (UNTESTED!)
  • https://vator.tv/news/2016-04-26-backblazes-new-60-storage-pod-can-house-480tb-of-data
  • https://www.backblaze.com/blog/open-source-data-storage-server/
  • https://f001.backblazeb2.com/file/Backblaze_Blog/Storage-Pod-6/Storage+Pod+6.0+Parts+List.pdf
  • backblaze also publishes a years “how many drives in use and how reliable were they” stats (here is for 2024) this is very nice! thanks! 😀
• in this build will try to reuse what is already there and order only what’s absolutely necessary
• so a very old but high quality (almost server hardware?) computer FUJITSU ESPRIMO P9900 (i5-650) (4GB RAM) + Samsung SSD for /root and 16GBytes /swapfile was “there” X-D
  • if this old but solid (?) box refuses to start: change the cmos battery X-D (no kidding!) (Siemens: this is actually a reliability nogo X-D)
  • power efficiency?
    • with 4x WD 2TB in mdadm RAID10 setup + 1x SSD + 1x DVD drive this consumes 80W to 90W, which is pretty efficient
• performance?
  • manged to push 155MBytes/s from SSD to RAID10
    • echo “scale=5; 35*1024/((3*60)+51)”|bc = 155MBytes/s
  • over network rsync managed push
    • 111.39MBytes/sec to ssd
• it is interesting to search ebay
  • like this
  • or like this
    • for some reason it’s way cheaper on amazon

what harddisks?

What are the most reliable harddisks in 2023?

test setup

hostnamectl; # tested on
Static hostname: p9900
Operating System: Debian GNU/Linux 11 (bullseye)
Kernel: Linux 5.10.0-34-amd64
Architecture: x86-64

wget https://dwaves.de/scripts/bench/bench_harddisk.sh
time ./bench/bench_harddisk.sh

=== harddisk sequential write and read bench v1 ===
starting test on the device that holds the current directory the user is in
no need to run it as root

========== writing 3GB of zeroes ==========
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 14.4631 s, 148 MB/s

real    0m14.569s
user    0m0.000s
sys     0m6.391s
========== reading 3GB of zeroes ==========
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 8.1486 s, 264 MB/s

real    0m8.291s
user    0m0.000s
sys     0m3.343s
========== tidy up remove testfile ==========

real    0m22.939s

# benchmark 500GByte Samsung SSD 860
time /scripts/bench/bench_harddisk.sh 
=== harddisk sequential write and read bench v1 ===
starting test on the device that holds the current directory the user is in
no need to run it as root
========== writing 3GB of zeroes ==========
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 8.97333 s, 239 MB/s

real 0m9.170s
user 0m0.006s
sys 0m5.249s
========== reading 3GB of zeroes ==========
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 7.4914 s, 287 MB/s

real 0m7.625s
user 0m0.001s
sys 0m2.786s
========== tidy up remove testfile ==========
real 0m16.878s

# hardware used:
lshw -class tape -class disk -class storage -short
H/W path Device Class Description
======================================================
/0/100/1f.2/0 /dev/sda disk 500GB Samsung SSD 860
/0/100/1c/0/2/0/0 /dev/sdb disk 2TB WDC WD2004FBYZ-0
/0/100/1c/0/2/0/1 /dev/sdc disk 2TB WDC WD2002FYPS-0
/0/100/1c/0/3/0/0 /dev/sdd disk 2TB WDC WD2003FYYS-0
/0/100/1c/0/3/0/1 /dev/sde disk 2TB WDC WD2002FYPS-0
<- these disks are the md0bcde raid10
/0/100/1f.2 scsi0 storage 5 Series/3400 Series Chipset 6 port SATA AHCI Controller

# currently testing this PCIe card with the MASSIVE SATA connectivity :D
# it is called the: PCI-E 16X SATA 24x Port, 6 Gbit/s SATA 3.0 PCIe SATA III PCI-Express Controller card
lspci -v

# it has multiple of these chips:
# ASMedia PCIe product ASM1812, a low latency, low cost and low power 12 lane
# maximum 6 downstream ports packet switch
# With upstream PCIe Gen2x4 bandwidth
# ASM1812 can enable users to build up various high speed IO systems, including server, system storage or communication platforms
# https://www.asmedia.com.tw/product/1e2yQ48sx5HT2pUF/aDcYq0BxZfuH9Nz5

# it could probably go faster X-D if network switches were faster, PC was faster X-D

05:00.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Physical Slot: 1
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 11
Bus: primary=05, secondary=06, subordinate=0c, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3000000-f35fffff [size=6M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Upstream Port, MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>

Kernel driver in use: pcieport
06:00.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 27, IOMMU group 12
Bus: primary=06, secondary=07, subordinate=07, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3000000-f30fffff [size=1M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Downstream Port (Slot+), MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>
Kernel driver in use: pcieport

06:02.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 28, IOMMU group 13
Bus: primary=06, secondary=08, subordinate=08, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3100000-f31fffff [size=1M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Downstream Port (Slot+), MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>
Kernel driver in use: pcieport

06:03.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 29, IOMMU group 14
Bus: primary=06, secondary=09, subordinate=09, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3200000-f32fffff [size=1M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Downstream Port (Slot+), MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>
Kernel driver in use: pcieport

06:08.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 30, IOMMU group 15
Bus: primary=06, secondary=0a, subordinate=0a, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3300000-f33fffff [size=1M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Downstream Port (Slot+), MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>
Kernel driver in use: pcieport

06:0a.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 31, IOMMU group 16
Bus: primary=06, secondary=0b, subordinate=0b, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3400000-f34fffff [size=1M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Downstream Port (Slot+), MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>
Kernel driver in use: pcieport

06:0b.0 PCI bridge: ASMedia Technology Inc. Device 1812 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 32, IOMMU group 17
Bus: primary=06, secondary=0c, subordinate=0c, sec-latency=0
I/O behind bridge: [disabled]
Memory behind bridge: f3500000-f35fffff [size=1M]
Prefetchable memory behind bridge: [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Downstream Port (Slot+), MSI 00
Capabilities: [c0] Subsystem: Device 0000:0000
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Power Budgeting <?>
Capabilities: [160] Latency Tolerance Reporting
Capabilities: [180] Multicast
Capabilities: [1c0] Secondary PCI Express
Capabilities: [200] Vendor Specific Information: ID=001a Rev=0 Len=000 <?>
Kernel driver in use: pcieport

07:00.0 SATA controller: ASMedia Technology Inc. Device 1064 (rev 02) (prog-if 01 [AHCI 1.0])
Subsystem: ZyDAS Technology Corp. Device 2116
Flags: bus master, fast devsel, latency 0, IRQ 35, IOMMU group 12
Memory at f3002000 (32-bit, non-prefetchable) [size=8K]
Memory at f3000000 (32-bit, non-prefetchable) [size=8K]
Expansion ROM at f3080000 [virtual] [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [130] Secondary PCI Express
Kernel driver in use: ahci
Kernel modules: ahci

08:00.0 SATA controller: ASMedia Technology Inc. Device 1064 (rev 02) (prog-if 01 [AHCI 1.0])
Subsystem: ZyDAS Technology Corp. Device 2116
Flags: bus master, fast devsel, latency 0, IRQ 36, IOMMU group 13
Memory at f3102000 (32-bit, non-prefetchable) [size=8K]
Memory at f3100000 (32-bit, non-prefetchable) [size=8K]
Expansion ROM at f3180000 [virtual] [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [130] Secondary PCI Express
Kernel driver in use: ahci
Kernel modules: ahci

09:00.0 SATA controller: ASMedia Technology Inc. Device 1064 (rev 02) (prog-if 01 [AHCI 1.0])
Subsystem: ZyDAS Technology Corp. Device 2116
Flags: bus master, fast devsel, latency 0, IRQ 37, IOMMU group 14
Memory at f3202000 (32-bit, non-prefetchable) [size=8K]
Memory at f3200000 (32-bit, non-prefetchable) [size=8K]
Expansion ROM at f3280000 [virtual] [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [130] Secondary PCI Express
Kernel driver in use: ahci
Kernel modules: ahci

0a:00.0 SATA controller: ASMedia Technology Inc. Device 1064 (rev 02) (prog-if 01 [AHCI 1.0])
Subsystem: ZyDAS Technology Corp. Device 2116
Flags: bus master, fast devsel, latency 0, IRQ 38, IOMMU group 15
Memory at f3302000 (32-bit, non-prefetchable) [size=8K]
Memory at f3300000 (32-bit, non-prefetchable) [size=8K]
Expansion ROM at f3380000 [virtual] [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [130] Secondary PCI Express
Kernel driver in use: ahci
Kernel modules: ahci

0b:00.0 SATA controller: ASMedia Technology Inc. Device 1064 (rev 02) (prog-if 01 [AHCI 1.0])
Subsystem: ZyDAS Technology Corp. Device 2116
Flags: bus master, fast devsel, latency 0, IRQ 39, IOMMU group 16
Memory at f3402000 (32-bit, non-prefetchable) [size=8K]
Memory at f3400000 (32-bit, non-prefetchable) [size=8K]
Expansion ROM at f3480000 [virtual] [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [130] Secondary PCI Express
Kernel driver in use: ahci
Kernel modules: ahci

0c:00.0 SATA controller: ASMedia Technology Inc. Device 1064 (rev 02) (prog-if 01 [AHCI 1.0])
Subsystem: ZyDAS Technology Corp. Device 2116
Flags: bus master, fast devsel, latency 0, IRQ 41, IOMMU group 17
Memory at f3502000 (32-bit, non-prefetchable) [size=8K]
Memory at f3500000 (32-bit, non-prefetchable) [size=8K]
Expansion ROM at f3580000 [virtual] [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [80] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [130] Secondary PCI Express
Kernel driver in use: ahci
Kernel modules: ahci

Links:

when AI get’s basic math wrong: how many MegaBytes are in 1 PetaByte? (binary not decimal)

liked this article?

• only together we can create a truly free world
• plz support dwaves to keep it up & running!
• (yes the info on the internet is (mostly) free but beer is still not free (still have to work on that))
• really really hate advertisement
• contribute: whenever a solution was found, blog about it for others to find!
• talk about, recommend & link to this blog and articles
• thanks to all who contribute!