Trouble with mdadm RAID 5

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

sonicz

Member
May 21, 2013
44
4
8
Hi There

I am having some issues with my raid and I will try to explain the situation.

I had 4x3TB in my RAID 5. I then added another 3TB and the resize seemed to go as it should. But after a quick reboot my RAID was messed up.

The new disk stands as S (spare) and one of the old ones stands with (F). I have checked that disk and smart data says it has 40 bad sectors, but It should still be okay according to smart data.

I then tried to rebuild the raid, I was able to bring the bad disk online againg and start a full rebuild. But at around 75-80% it stopped and put the bad disk into F again and the new one into S.

So I'm going kinda desperate now, and can't really find anything on google regarding my issues.

Any who has any ideas?

Would be greately appriciated.
 
Last edited:

Mike

Member
May 29, 2012
482
16
18
EU
Can you assemble without the bad disk? I believe you have to exec; mdadm -a /dev/md0 /dev/sdabce MISSING
Or something along those lines.

I think we can agree on the fact that the disk is bad. You didn't notice till now because the part with the corruptions wasn't read or written to in a while, till you had to rebuild the array... ?
 

sonicz

Member
May 21, 2013
44
4
8
Well it seems the recovery I made worked... sort of.

Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [ra
id10]
md0 : active raid5 sdc1[5] sdg1[2] sdd1[0] sde1[1] sdf[3]
11720534016 blocks super 1.2 level 5, 512k chunk, algorithm 2 [5/5] [UUUUU
]

unused devices: <none>

But the filesystem seems to be gone?

Here is the examine:

/dev/sdg1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : b15519ba:5519bbfb:3220a6d8:0a95903c

Update Time : Tue May 21 23:47:13 2013
Checksum : e1cf3068 - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 2
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sdc1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 2c2a2036:b319d51c:af203b09:b7bd2e5d

Update Time : Tue May 21 23:47:13 2013
Checksum : d0232e6c - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 4
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sdd1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : bdec3cea:c86c3dd3:877d7de0:a3fdac9e

Update Time : Tue May 21 23:47:13 2013
Checksum : 5368e0d4 - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 0
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sde1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 97760fb3:8abce147:1f22456f:f9ce47d0

Update Time : Tue May 21 23:47:13 2013
Checksum : 5142305e - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 1
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sdf:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 79fdb09e:529cfd0a:2302337b:44450ced

Update Time : Tue May 21 23:47:13 2013
Checksum : 28b1f909 - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 3
Array State : AAAAA ('A' == active, '.' == missing)


sudo mdadm --detail
mdadm: No devices given.
 

Mike

Member
May 29, 2012
482
16
18
EU
Well it seems the recovery I made worked... sort of.

Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [ra
id10]
md0 : active raid5 sdc1[5] sdg1[2] sdd1[0] sde1[1] sdf[3]
11720534016 blocks super 1.2 level 5, 512k chunk, algorithm 2 [5/5] [UUUUU
]

unused devices: <none>

But the filesystem seems to be gone?

Here is the examine:

/dev/sdg1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : b15519ba:5519bbfb:3220a6d8:0a95903c

Update Time : Tue May 21 23:47:13 2013
Checksum : e1cf3068 - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 2
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sdc1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 2c2a2036:b319d51c:af203b09:b7bd2e5d

Update Time : Tue May 21 23:47:13 2013
Checksum : d0232e6c - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 4
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sdd1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : bdec3cea:c86c3dd3:877d7de0:a3fdac9e

Update Time : Tue May 21 23:47:13 2013
Checksum : 5368e0d4 - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 0
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sde1:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 97760fb3:8abce147:1f22456f:f9ce47d0

Update Time : Tue May 21 23:47:13 2013
Checksum : 5142305e - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 1
Array State : AAAAA ('A' == active, '.' == missing)

/dev/sdf:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x0
Array UUID : 177b9582:09bfa016:4b5cbb51:d8df5c86
Name : (none):0
Creation Time : Tue May 21 17:32:21 2013
Raid Level : raid5
Raid Devices : 5

Avail Dev Size : 5860271024 (2794.40 GiB 3000.46 GB)
Array Size : 11720534016 (11177.57 GiB 12001.83 GB)
Used Dev Size : 5860267008 (2794.39 GiB 3000.46 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 79fdb09e:529cfd0a:2302337b:44450ced

Update Time : Tue May 21 23:47:13 2013
Checksum : 28b1f909 - correct
Events : 18

Layout : left-symmetric
Chunk Size : 512K

Device Role : Active device 3
Array State : AAAAA ('A' == active, '.' == missing)


sudo mdadm --detail
mdadm: No devices given.
What FS used to be on there? No LVM? pv, vg, lv?