Raid 5 failed on 5big1

[fvdw]

try to add these

[fvdw]

maybe this one is also needed to make insert of raid456.ko module possible

[totorweb]

One module seems to be missing for async_xor.ko

Code: Select all

root@(none):/lib/modules/2.6.39.4 # insmod async_xor.ko
insmod: can't insert 'async_xor.ko': unknown symbol in module or invalid parameter
root@(none):/lib/modules/2.6.39.4 # dmesg
async_xor: Unknown symbol xor_blocks (err 0)


Most loads successfuly

Code: Select all

root@(none):/lib/modules/2.6.39.4 # lsmod
async_raid6_recov 983 0 - Live 0xbf26d000
raid6_pq 75269 1 async_raid6_recov, Live 0xbf249000
async_memcpy 932 0 - Live 0xbf23d000
async_tx 1912 2 async_raid6_recov,async_memcpy, Live 0xbf237000
md_mod 92232 0 - Live 0xbf1e6000


[fvdw]

I think you need this one xor.ko

[totorweb]

Code: Select all

root@(none):/lib/modules/2.6.39.4 # mdadm --verbose --create --assume-clean --metadata=0.90 --chunk=64 --level=raid5 --layout=left-symmetric --raid-devices=5 /dev/md4 /dev/sde2  missing /dev/sdc2 /dev/sdb2 /dev/sda2
mdadm: /dev/sde2 appears to be part of a raid array:
    level=raid5 devices=5 ctime=Thu Jan  1 02:11:29 1970
mdadm: /dev/sdc2 appears to be part of a raid array:
    level=raid5 devices=5 ctime=Thu Jan  1 02:11:29 1970
mdadm: /dev/sdb2 appears to be part of a raid array:
    level=raid5 devices=5 ctime=Thu Jan  1 02:11:29 1970
mdadm: /dev/sda2 appears to be part of a raid array:
    level=raid5 devices=5 ctime=Thu Jan  1 02:11:29 1970
mdadm: size set to 1464131904K
Continue creating array? y
mdadm: array /dev/md4 started.


Code: Select all

root@(none):/lib/modules/2.6.39.4 # mdadm --detail /dev/md4
/dev/md4:
        Version : 0.90
  Creation Time : Thu Jan  1 02:11:29 1970
     Raid Level : raid5
     Array Size : 5856527616 (5585.22 GiB 5997.08 GB)
  Used Dev Size : 1464131904 (1396.31 GiB 1499.27 GB)
   Raid Devices : 5
  Total Devices : 4
Preferred Minor : 4
    Persistence : Superblock is persistent

    Update Time : Thu Jan  1 02:16:29 1970
          State : clean, degraded
 Active Devices : 4
Working Devices : 4
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           UUID : 7f0c2fbd:da0b31a0:3d186b3c:53958f34 (local to host (none))
         Events : 0.3

    Number   Major   Minor   RaidDevice State
       0       8        2        0      active sync   /dev/sde2
       1       0        0        1      removed
       2       8       34        2      active sync   /dev/sdc2
       3       8       50        3      active sync   /dev/sdb2
       4       8       66        4      active sync   /dev/sda2


Code: Select all

root@(none):/lib/modules/2.6.39.4 # dmesg
md: bind<sde2>
md: bind<sdc2>
md: bind<sdb2>
md: bind<sda2>
md/raid:md4: device sda2 operational as raid disk 4
md/raid:md4: device sdb2 operational as raid disk 3
md/raid:md4: device sdc2 operational as raid disk 2
md/raid:md4: device sde2 operational as raid disk 0
md/raid:md4: allocated 5260kB
md/raid:md4: raid level 5 active with 4 out of 5 devices, algorithm 2
RAID conf printout:
 --- level:5 rd:5 wd:4
 disk 0, o:1, dev:sde2
 disk 2, o:1, dev:sdc2
 disk 3, o:1, dev:sdb2
 disk 4, o:1, dev:sda2
md4: detected capacity change from 0 to 5997084278784
 md4: unknown partition table


Code: Select all

root@(none):/ # mkdir /RAID5_MNT
root@(none):/ # mount -o ro /dev/md4 /RAID5_MNT/
mount: mounting /dev/md4 on /RAID5_MNT/ failed: Invalid argument


Code: Select all

root@(none):/lib/modules/2.6.39.4 # fdisk -l /dev/md4
fdisk: device has more than 2^32 sectors, can't use all of them

Disk /dev/md4: 2199.0 GB, 2199023255040 bytes
2 heads, 4 sectors/track, 536870911 cylinders
Units = cylinders of 8 * 512 = 4096 bytes

Disk /dev/md4 doesn't contain a valid partition table


Code: Select all

root@(none):/ # cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4]
md4 : active raid5 sda2[4] sdb2[3] sdc2[2] sde2[0]
      5856527616 blocks level 5, 64k chunk, algorithm 2 [5/4] [U_UUU]

unused devices: <none>


Does the parition table corrupted ?

[fvdw]

No I don't think so only fdisk can not dtect size bigger then 2.2TB because of the 2^32 max number of sector limit.
fdisk is suitable for ms-dos based partition tables (max size of disk it can handle is 2.2TB)
You could try to use gdisk that can detect bigger ones.
Attach a static compiled version, now I need to go to bed, see you tomorrow

[Mijzelf]

/dev/md4 is not supposed to have a partition table, only a filesystem. I guess xfs, so you can try to specify it:

Code: Select all

mount -t xfs -o ro /dev/md4 /RAID5_MNT

/Edit: Does the kernel support xfs? Else another kernel module is needed.

[totorweb]

Code: Select all

root@(none):/ # mkdir /RAID5_MNT
root@(none):/sbin # mount -t xfs -o ro /dev/md4 /RAID5_MNT
mount: mounting /dev/md4 on /RAID5_MNT failed: No such device


Code: Select all

root@(none):/sbin # gdisk /dev/md4
GPT fdisk (gdisk) version 0.8.5

Partition table scan:
  MBR: not present
  BSD: not present
  APM: not present
  GPT: not present




Code: Select all

root@(none):/ # mdadm --detail /dev/md4
/dev/md4:
        Version : 0.90
  Creation Time : Thu Jan  1 00:08:53 1970
     Raid Level : raid5
     Array Size : 5856527616 (5585.22 GiB 5997.08 GB)
  Used Dev Size : 1464131904 (1396.31 GiB 1499.27 GB)
   Raid Devices : 5
  Total Devices : 4
Preferred Minor : 4
    Persistence : Superblock is persistent

    Update Time : Thu Jan  1 00:15:19 1970
          State : clean, degraded
 Active Devices : 4
Working Devices : 4
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           UUID : 3a48c45c:38774375:3d186b3c:53958f34 (local to host (none))
         Events : 0.3

    Number   Major   Minor   RaidDevice State
       0       8        2        0      active sync   /dev/sde2
       1       0        0        1      removed
       2       8       34        2      active sync   /dev/sdc2
       3       8       50        3      active sync   /dev/sdb2
       4       8       66        4      active sync   /dev/sda2


Code: Select all

root@(none):/ # mdadm --examine /dev/md4
mdadm: No md superblock detected on /dev/md4.


[fvdw]

/dev/md4 is not supposed to have a partition table, only a filesystem. I guess xfs, so you can try to specify it:

Code: Select all

mount -t xfs -o ro /dev/md4 /RAID5_MNT

/Edit: Does the kernel support xfs? Else another kernel module is needed.

no xfs support is not included, consequence of the actions to bring size below 2 MB

[fvdw]

attached the xfs kernel module