While the Supermicro X8DT3 CPU: 2x Xeons with 2x Intel Xeon(R) CPU E5504 @ 2.00GHz and RAM: 64GB RAM EEC Dual-Powersupply is a great mainboard with java remote web IPMI console that allows you to access the bios and remote mount CDROM.ISOs!

GREAT!

We have a more recent Siemens Server with Intel S2600CWR Mainboard and i can’t get their BMC Console Screen output working. (also Java based but could not manage to get it working)

Some sort of Java SSL problem:

# under linux you can try to generate a self signed certificate (src)
openssl req -x509 -newkey rsa:4096 -keyout key.pem -out cert.pem -days 9999
# did not accept it: "SSL certificate validation failed.Please try to upload the certificate and key agai

You may need to first upload a SSL certificate to BMC. The steps to do that can be found at http://download.intel.com/support/motherboards/server/sb/intel_rmm4_ibwc_userguide_r2_72.pdf  page 90 section 7.3.7

so this sucks about that intel board.

back to supermicro:

The only thing that sucks about it is the onboard LSI 1068e suck raid.

the linux drivers for 1068e (probably still) suck.

so what you do is disable the controller by pulling off the below circled red jumper (JPS2) and setup software raid with mdadm under linux and let linux do all the RAM harddisk access buffering (which linux does per default tries to use non-used RAM as harddisk buffer).

pull the jumper marked red (JPS2 hard to read, it is labeled below the jumper)

image

JBOD (abbreviated from “just a bunch of disks/drives”) is an architecture using multiple hard drives exposed as individual devices. Hard drives may be treated independently or may be combined into one or more logical volumes using a volume manager like LVM or mdadm; such volumes are usually called “spanned” or “linear | SPAN | BIG”.[2][3][4] A spanned volume provides no redundancy, so failure of a single hard drive amounts to failure of the whole logical volume.[5][6] Redundancy for resilience and/or bandwidth improvement may be provided, in software, at a higher level.

(src)

https://www.servethehome.com/supermicro-x8st3f-motherboard-review/

what is interesting to know:

tell my i am wrong but it seems like the LSI 1068e adapter is simply a little linux embedded PC doing mdadm software raid?

lsblk -fs; # 
NAME FSTYPE LABEL UUID MOUNTPOINT
sr0 
fd0 
ddf1_4c5349202020202010000055000000004711471100001450
 
├─sdf ddf_raid_member LSI \x10 
├─sdd ddf_raid_member LSI \x10 
├─sdb ddf_raid_member LSI \x10 
├─sdg ddf_raid_member LSI \x10 
├─sde ddf_raid_member LSI \x10 
├─sdc ddf_raid_member LSI \x10 
└─sdh ddf_raid_member LSI \x10 

mdadm -E /dev/sd[b-h]; # examine raid info on drives
/dev/sdb:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (0@0K 1@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 0 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K                 active/Online
         1    08026716  1952147456K /dev/sdb        active/Online
         2    75be0468  1952147456K                 active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K                 active/Online
         5    39dd46da  1952147456K                 active/Online
         6    5b105a4e  1952147456K                 active/Online
         7    26bc621c  1952147456K                 active/Online
/dev/sdc:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (2@0K 3@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 1 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K                 active/Online
         1    08026716  1952147456K                 active/Online
         2    75be0468  1952147456K /dev/sdc        active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K                 active/Online
         5    39dd46da  1952147456K                 active/Online
         6    5b105a4e  1952147456K                 active/Online
         7    26bc621c  1952147456K                 active/Online
/dev/sdd:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (0@0K 1@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 0 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K /dev/sdd        active/Online
         1    08026716  1952147456K                 active/Online
         2    75be0468  1952147456K                 active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K                 active/Online
         5    39dd46da  1952147456K                 active/Online
         6    5b105a4e  1952147456K                 active/Online
         7    26bc621c  1952147456K                 active/Online
/dev/sde:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (4@0K 5@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 2 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K                 active/Online
         1    08026716  1952147456K                 active/Online
         2    75be0468  1952147456K                 active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K /dev/sde        active/Online
         5    39dd46da  1952147456K                 active/Online
         6    5b105a4e  1952147456K                 active/Online
         7    26bc621c  1952147456K                 active/Online
/dev/sdf:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (4@0K 5@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 2 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K                 active/Online
         1    08026716  1952147456K                 active/Online
         2    75be0468  1952147456K                 active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K                 active/Online
         5    39dd46da  1952147456K /dev/sdf        active/Online
         6    5b105a4e  1952147456K                 active/Online
         7    26bc621c  1952147456K                 active/Online
/dev/sdg:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (6@0K 7@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 3 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K                 active/Online
         1    08026716  1952147456K                 active/Online
         2    75be0468  1952147456K                 active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K                 active/Online
         5    39dd46da  1952147456K                 active/Online
         6    5b105a4e  1952147456K /dev/sdg        active/Online
         7    26bc621c  1952147456K                 active/Online
/dev/sdh:
          Magic : de11de11
        Version : 01.00.00
Controller GUID : 4C534920:20202020:FFFFFFFF:FFFFFFFF:FFFFFFFF:FFFFFFFF
                  (LSI     )
 Container GUID : 4C534920:20202020:10000055:00000000:4784A643:4784BA66
                  (LSI      01/08/18 11:47:31)
            Seq : 00000023
  Redundant hdr : yes
  Virtual Disks : 1

      VD GUID[0] : 4C534920:20202020:10000055:00000000:478CE8EE:00001450
                  (LSI      01/14/18 18:10:06)
         unit[0] : 0
        state[0] : Degraded, Consistent
   init state[0] : Not Initialised
       access[0] : Read/Write
         Name[0] : 
 Raid Devices[0] : 2 (6@0K 7@0K)
   Chunk Size[0] : 128 sectors
   Raid Level[0] : RAID1
  Secondary Position[0] : 3 of 4
  Secondary Level[0] : Spanned
  Device Size[0] : 1952147456
   Array Size[0] : 1952147456

 Physical Disks : 8
      Number    RefNo      Size       Device      Type/State
         0    7070da01  1952147456K                 active/Online
         1    08026716  1952147456K                 active/Online
         2    75be0468  1952147456K                 active/Online
         3    e4da0b7c  1952147456K                 active/Offline, Rebuilding
         4    c33590e3  1952147456K                 active/Online
         5    39dd46da  1952147456K                 active/Online
         6    5b105a4e  1952147456K                 active/Online
         7    26bc621c  1952147456K /dev/sdh        active/Online

you might want to delete this raid info before building your own mdadm softwar raid array:

mdadm --zero-superblock /dev/sdb1

liked this article?

  • only together we can create a truly free world
  • plz support dwaves to keep it up & running!
  • (yes the info on the internet is (mostly) free but beer is still not free (still have to work on that))
  • really really hate advertisement
  • contribute: whenever a solution was found, blog about it for others to find!
  • talk about, recommend & link to this blog and articles
  • thanks to all who contribute!
admin