Raid 5 failed on 5big1

[totorweb]

Code: Select all

root@(none):/dev # mkdir /sdb1
root@(none):/dev # mount /dev/sdb1 /sdb1
mount: mounting /dev/sdb1 on /sdb1 failed: Invalid argument

root@(none):/dev # mkdir /sda7
root@(none):/dev # mount /dev/sda7 /sda7

root@(none):/dev # mkdir /sdd1
root@(none):/dev # mount /dev/sdd1 /sdd1
mount: mounting /dev/sdd1 on /sdd1 failed: Invalid argument

root@(none):/dev # dmesg
attempt to access beyond end of device
sdb1: rw=0, want=4, limit=2
EXT3-fs (sdb1): error: unable to read superblock
EXT3-fs: barriers not enabled
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sda7): using internal journal
EXT3-fs (sda7): mounted filesystem with ordered data mode



nothing about sdd or sdd1 in dmesg.

cat /proc/partitions seems to be good

Code: Select all

root@(none):/dev # cat /proc/partitions
major minor  #blocks  name

   8        0 1465138584 sde
   8        1          1 sde1
   8        2 1464131970 sde2
   8        5     128457 sde5
   8        6       8001 sde6
   8        7       8001 sde7
   8        8     176683 sde8
   8        9     674698 sde9
   8       10       8001 sde10
   8       16 1465138584 sdd
   8       17 1465132000 sdd1
   8       32 1465138584 sdc
   8       33          1 sdc1
   8       34 1464131970 sdc2
   8       37     128457 sdc5
   8       38       8001 sdc6
   8       39       8001 sdc7
   8       40     176683 sdc8
   8       41     674698 sdc9
   8       42       8001 sdc10
   8       48 1465138584 sdb
   8       49          1 sdb1
   8       50 1464131970 sdb2
   8       53     128457 sdb5
   8       54       8001 sdb6
   8       55       8001 sdb7
   8       56     176683 sdb8
   8       57     674698 sdb9
   8       58       8001 sdb10
   8       64 1465138584 sda
   8       65          1 sda1
   8       66 1464131970 sda2
   8       69     128457 sda5
   8       70       8001 sda6
   8       71       8001 sda7
   8       72     176683 sda8
   8       73     674698 sda9
   8       74       8001 sda10


[Mijzelf]

Fuzzy. Maybe mount can tell us more?

Code: Select all

mount -vv /dev/sdd1 /sdd1

[fvdw]

that sdb1 fails to mount using ext3 is correct as probably is a xfs file system
so it seems the dev node for sdd1 is correct

why can this thing not be mounted
:scratch

did you try the mke2fs-64 binary I have sent you as alternative to format it.?
maybe the downsized busybox is making troubles with the mke2fs applet

[Mijzelf]

that sdb1 fails to mount using ext3 is correct as probably is a xfs file system

sdb1 is an extended partition. It doesn't contain a filesystem. Basically it's just an extra partititon table.

[fvdw]

you are right I only looked at the nr of blocks
my test was just to check if the dev nodes used are the right one for the device, it remains confusing :-D
But it seems to be correct. I think toterweb has a good chance if he uses the mfe2fs-64 binary to solve this issue
Busybox static with ulibc has given other strange behaviors as well

[totorweb]

hop ! formatting /dev/sdd1 with mke2fs-64 -j -m 1 /dev/sdd1

juste waiting ...

Code: Select all

Writing inode tables:  2382/11179

:please

[totorweb]

Code: Select all

root@(none):/ # mkdir /MNT_sdd1
root@(none):/ # mount /dev/sdd1 /MNT_sdd1/
root@(none):/ # cd /MNT_sdd1/
root@(none):/MNT_sdd1 # cd /
root@(none):/ # df -h
Filesystem                Size      Used Available Use% Mounted on
/dev/sdd1                 1.3T    197.6M      1.3T   0% /MNT_sdd1


:woohoo

Now i have to go to see Gravity movie !
I will start copying files later this evening !

Thx again fvwd and Mijzelf .

I will back more later to tell you if it's all good :thumbup

And i will tell to my friend to give a donation :punk

[fvdw]

:mrgreen: nice so you can proceed

[totorweb]

All the importants datas have been copied.
Copy was very slow, maybe because of the degraded state of the raid (cpu was at 50%).

Again thank you Fvdw, Mijzelf and taetae too.

In case someone is in the same case here all the command used

Code: Select all

setenv ipaddr ${ipaddr};setenv serverip ${serverip};setenv bootargs console=ttyS0,115200 netconsole=6666@${ipaddr}/,6666@${serverip}/;tftpboot 0x800000 UIMAGE-26394-NWSP2CL-5BIG1-32-standalone;bootm

mkdir /lib/modules
mkdir /lib/modules/2.6.39.4

tftp -l /lib/modules/2.6.39.4/raid6_pq.ko -r raid6_pq.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/async_memcpy.ko -r async_memcpy.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/async_pq.ko -r async_pq.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/async_raid6_recov.ko -r async_raid6_recov.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/async_tx.ko -r async_tx.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/async_xor.ko -r async_xor.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/xor.ko -r xor.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/raid456.ko -r raid456.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/md-mod.ko -r md-mod.ko -g 192.168.0.12
tftp -l /lib/modules/2.6.39.4/xfs.ko -r xfs.ko -g 192.168.0.12

cd /lib/modules/2.6.39.4

insmod xor.ko
insmod xfs.ko
insmod raid6_pq.ko
insmod md-mod.ko
insmod async_tx.ko
insmod async_xor.ko
insmod async_pq.ko
insmod async_memcpy.ko
insmod async_raid6_recov.ko
insmod raid456.ko

tftp -l /sbin/mdadm -r mdadm -g 192.168.0.12
chmod 755 /sbin/mdadm

mdadm --verbose --create --assume-clean --metadata=0.90 --chunk=64 --level=raid5 --layout=left-symmetric --raid-devices=5 /dev/md4 /dev/sde2 missing /dev/sdc2 /dev/sdb2 /dev/sda2
mdadm --detail /dev/md4
mdadm --examine /dev/md4

mkdir /RAID5_MNT
mount -t xfs -o ro /dev/md4 /RAID5_MNT