one lucky day i got prompted „enter root passwort“ or Control+D to continue. (not recommended)

… the root filsystem reported UNEXPECTED INCONSISTENCIES.

so you go

fsck -y /dev/sda

you see that your disk makes errors when you check

less /var/log/kern.log

THAN IT’S TIME TO REPLACE YOUR HARDDISK!!!!! (HARDDISK FAILURE IMMANENT)

YOU SHOULD NEVER EVER EVER INSTALL CITRIX XENSERVER ON A NON-RAID HARDDISK!

HAVE FUN FINDING A PROPER (HARDWARE) RAID CONTROLER FOR CITRIX XEN (WHICH IS RED HAT 4/5) (the HCL WILL NOT ALWAYS HELP)

OR:

COMPILE HAVE FUN YOUR OWN RAID CONTROLER DRIVER FROM SOURCE!

… JUST SAY „HEY CITRIX…. WHERE DO YOU GO? WITHOUT A RAID CONTROLER SUPPORT TODAY?“ … nowhere.

HOW TO MOVE TO VIRTUALBOX -> http://dwaver.wordpress.com/2012/11/11/citrix-xen-to-virtualbox-how-to-move-windows-and-linux-vms/

Nov  6 08:18:46 localhost kernel: ata1.00: cmd 60/00:00:f0:7f:16/01:00:00:00:00/40 tag 0 ncq 131072 in

Nov  6 08:18:46 localhost kernel:          res 41/44:00:f0:7f:16/37:00:00:00:00/40 Emask 0x409 (media error) <F>

Nov  6 08:18:46 localhost kernel: ata1.00: status: { DRDY ERR }

Nov  6 08:18:46 localhost kernel: ata1.00: error: { UNC ABRT }

Nov  6 08:18:46 localhost kernel: ata1.00: configured for UDMA/133

Nov  6 08:18:46 localhost kernel: ata1: EH complete

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Write Protect is off

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] 125045424 512-byte hardware sectors: (64.0 GB/59.6 GiB)

Nov  6 08:18:46 localhost kernel: ata1.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0

Nov  6 08:18:46 localhost kernel: ata1.00: irq_stat 0x40000008

Nov  6 08:18:46 localhost kernel: ata1.00: cmd 60/00:08:f0:7f:16/01:00:00:00:00/40 tag 1 ncq 131072 in

Nov  6 08:18:46 localhost kernel:          res 41/44:00:f0:7f:16/37:00:00:00:00/40 Emask 0x409 (media error) <F>

Nov  6 08:18:46 localhost kernel: ata1.00: status: { DRDY ERR }

Nov  6 08:18:46 localhost kernel: ata1.00: error: { UNC ABRT }

Nov  6 08:18:46 localhost kernel: ata1.00: configured for UDMA/133

Nov  6 08:18:46 localhost kernel: ata1: EH complete

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Write Protect is off

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00

Nov  6 08:18:46 localhost kernel: ata1.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0

Nov  6 08:18:46 localhost kernel: ata1.00: irq_stat 0x40000008

Nov  6 08:18:46 localhost kernel: ata1.00: cmd 60/00:00:f0:7f:16/01:00:00:00:00/40 tag 0 ncq 131072 in

Nov  6 08:18:46 localhost kernel:          res 41/44:00:f0:7f:16/37:00:00:00:00/40 Emask 0x409 (media error) <F>

Nov  6 08:18:46 localhost kernel: ata1.00: status: { DRDY ERR }

Nov  6 08:18:46 localhost kernel: ata1.00: error: { UNC ABRT }

Nov  6 08:18:46 localhost kernel: ata1.00: configured for UDMA/133

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE,SUGGEST_OK

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Sense Key : Aborted Command [current] [descriptor]

Nov  6 08:18:46 localhost kernel: Descriptor sense data with sense descriptors (in hex):

Nov  6 08:18:46 localhost kernel:         72 0b 00 00 00 00 00 0c 00 0a 80 00 00 00 00 00

Nov  6 08:18:46 localhost kernel:         00 16 7f f0

Nov  6 08:18:46 localhost kernel: sd 0:0:0:0: [sda] Add. Sense: No additional sense information

Nov  6 08:18:46 localhost kernel: end_request: I/O error, dev sda, sector 1474544

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184318

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184319

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184320

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184321

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184322

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184323

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184324

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184325

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184326

Nov  6 08:18:46 localhost kernel: Buffer I/O error on device sda, logical block 184327

Nov  6 08:18:46 localhost kernel: ata1: EH complete
you can check your disk for defects with testdisk-6.13for linux kernel 2.6 (there is also a binary for 2.4 kernels)
wget http://dwaver.files.wordpress.com/2012/11/testdisk-6-13.pdf
(rename to .zip and unzip like this
unzip testdisk-6-13.zip
you can rm -rf the __MAC_OSX directory (f*** OSX)
then start it like this
[root@localhost testdisk-6.13]# ./testdisk_static

TestDisk 6.13, Data Recovery Utility, November 2011
Christophe GRENIER <grenier@cgsecurity.org>
http://www.cgsecurity.org

TestDisk 6.13, Data Recovery Utility, November 2011
Christophe GRENIER <grenier@cgsecurity.org>
http://www.cgsecurity.org

TestDisk is free software, and
comes with ABSOLUTELY NO WARRANTY.

Select a media (use Arrow keys, then press Enter):
Disk /dev/sda - 64 GB / 59 GiB - OCZ-AGILITY
>Disk /dev/sdb - 2000 GB / 1863 GiB - WDC WD2003FYYS-02W0B1
...
proceed....
... analyse

TestDisk 6.13, Data Recovery Utility, November 2011
Christophe GRENIER
http://www.cgsecurity.org

Disk /dev/sdb - 2000 GB / 1863 GiB - CHS 243201 255 63
Current partition structure:
     Partition                  Start        End    Size in sectors

 1 * Linux                    0   1  1   522  43 32    8388608 [root-uyrzwjjz]
No ext2, JFS, Reiser, cramfs or XFS marker
 2 P Linux                  522  43 33  1044  86  1    8388608
 2 P Linux                  522  43 33  1044  86  1    8388608
No LVM or LVM2 structure
 3 P Linux LVM             1044  86  2  7782 254 63  108256616
 3 P Linux LVM             1044  86  2  7782 254 63  108256616

i am pretty shure filesystem type of sda1 is ext3

[root@localhost testdisk-6.13]# mount
/dev/sda1 on / type ext3 (rw)

with smart you can monitor the health of your harddisk:

SMART check

wget http://vault.centos.org/5.4/os/i386/CentOS/smartmontools-5.38-2.el5.i386.rpm
wget http://vault.centos.org/5.4/os/i386/CentOS/mailx-8.1.1-44.2.2.i386.rpm
rpm -hiv smartmontools-5.38-2.el5.i386.rpm mailx-8.1.1-44.2.2.i386.rpm

smartctl -d ata -a /dev/sda
admin