Comments on: Help me ext2 Software RAID experts

By: thomas.apestaart.org » Nerd Night part 2

thomas.apestaart.org » Nerd Night part 2 — Fri, 23 May 2008 16:20:33 +0000

[...] you ask ? Well, Remember my previous problem. I never followed up on that post, because it was just too embarassing. Here’s what happened [...]

By: Thomas Stewart

Thomas Stewart — Fri, 18 Apr 2008 12:51:39 +0000

Make a new 400G partition of type fd (linux raid auto) on the 500G drive, make sure it will be the same size or smaller at the largest possible partition on the 400G drive. Something like 1000 blocks shorter that the total size of the unpartitioned block device.

Then make a new raid1 mirror device using the new 400G partition on the new 500G drive.
Tell mdadm that the other half of the mirror is missing. Make a filesystem on it and copy the data from the original raid1 md device to the new one.

Once you are certain the data is copied, stop the original md device and make a new partition on the 400G disk covering the entire disk. Add a partition on the 400G drive covering the entire drive. Then just add that partition to the new md device, and let is sync.

By: Peter

Peter — Fri, 18 Apr 2008 12:42:22 +0000

Create a new Raid-1 with one disk on the new 500G disk to the amount of the old disk, partition it, mount it, copy files over, remove 400G from old Raid, add it to new Raid, let it sync and be done.

By: C.Lee Taylor

C.Lee Taylor — Fri, 18 Apr 2008 07:35:47 +0000

Just my R0.02 worth of noise …

Not sure how much space one saves by not partitioning a drive, but I use it as a minor security feature … If somebody loans/steals a drive that is part of one of my raids, they will not have an idea that it’s part of my raid by the partition table … But that is just me … (Greetings Dag!)

You should be able mount the drive without the partition table, something like mount /dev/hdd /mnt/tmp -o ro … Or even do an e2fsck -n /dev/hdd for read-only to see if the filesystem is intact …

You could also check if the raid member is also recognized with something like mdamd -E /dev/hdd … If so,. I would then start an md with mdadm -A /dev/md1 –force and then add then new member to the array, using something like mdamd /dev/md1 -a /dev/hdc1 …

These are just guide lines and your mileage might vary …

Best of luck!

Mailed
LeeT

By: Wouter Verhelst

Wouter Verhelst — Fri, 18 Apr 2008 02:13:18 +0000

You can’t. the Linux Software RAID subsystem doesn’t support shrinking devices, which would be required for your setup. However, the subsystem *does* support having two mirrors of a RAID-1 array being completely strange and different things. You can have a partition on one disk, and the full disk on the other. You can run NBD for one mirror, and a local disk for the other. I guess if you’re creative with losetup, you probably could use a local file as a mirror, too (would have to check that).

Given all of that, the RAID system has to support two mirrors that are not equally sized. Just create a partition on the 500G disk that is slightly larger than the 400G disk; Linux will use the space it needs, and ignore the leftover.

By: Dag Wieers

Dag Wieers — Fri, 18 Apr 2008 00:08:29 +0000

You may also want to look at testdisk, which is a much more mature product than gpart. Although I hope you never need it :-)

You discovered exactly why I always tell companies to partition their disks, even if it is just to use the disk as a physical volume or a RAW device. At least the partition type can give information to what the disk is being used for. Without it your future colleagues are at a loss.

By: Andrew

Andrew — Fri, 18 Apr 2008 00:05:56 +0000

You should be able to do this, the DOS style partition table only lives in a single sector (inside the MBR) and even if the partition table is empty, that sector probably still lives outside of the filesystem. Notice it found the ext2 magic in sector 2…what is in sector 0 and sector 1? I suggest:

dd if=/dev/hdd bs=512 count=2 | hexdump -c

Read up on the MBR (http://en.wikipedia.org/wiki/Master_boot_record) and see if what you have there is an empty one, that can be safely changed with gparted, if so, creating a primary partition across the span of the filesystem and you’re rolling.

By: Kevin Kofler

Kevin Kofler — Thu, 17 Apr 2008 23:16:36 +0000

Maybe you can partition only the 500 GB disk, set up a partition exactly as large as the entire 400 GB /dev/hdd disk and then use /dev/hdc1 and /dev/hdd for your RAID?

By: tuXXX

tuXXX — Thu, 17 Apr 2008 22:16:30 +0000

I’d say :
Partition the 500G with two partitions : one of 400GB (a little more than the size of the full 400G disk), and one of the remaining capacity.
Now you have, /dev/hdd (the 400G) and /dev/hdc1 + /dev/hdc2 (the partitionned 500G).
Now let’s copy the data with “dd if=/dev/hdd of=/dev/hdc1″
And that’s it!

Now if you want to partition hdd into hdd1, I think that you’ll have to use resize2fs, do the above procedure, and then partition /dev/hdd, and use dd the other way (“dd if=/dev/hdc1 of=/dev/hdd1″), but I don’t really know if this is really useful :p.

By: Mike McGrath

Mike McGrath — Thu, 17 Apr 2008 21:28:37 +0000

Can’t do it. The old 400G drive is using all of its space for the md0 array. By creating a partition table of any kind on it, you’re going to end up with usable space smaller then the original drive. So even if you add the 500G drive to the mix and disable the old 400G drive. When you create the partition on it you’ll be unable to add it properly because you won’t have enough space to mirror to it.

I don’t think there’s any way to grow / shrink raid arrays at the RAID level as far as partiton size goes (you can always add / remove drives though) So here’s what I think your best bet is… MAKE A BACKUP.

Boot via rescue disk.

Shrink the filesystem using resize2fs on your 400G drive. Just a few M would be fine.

create a /dev/hdc1 thats less then 400G on your 500G drive.

# hdd = 400G hdc = 500G hdc1 = <400G
dd if=/dev/hdd of=/dev/hdc1

This will fail but, in theory, the parts that fail you don’t need because you resized below it.

Then run a chkfs on /dev/hdc1.

Next fdisk /dev/hdd and create a new partition of the same size that you created for the hdc1 partition.

Then re-assemble the array with just the hdc1 partition (hdc == the new drive)

mount /dev/md0 and make sure everything’s there.

Then add /dev/hdd1

monitor /proc/mdstat make sure it comes back up.

alter your /etc/mdstat.conf

reboot.

Alternatively you can use the old 400G /dev/hdd and just create a 400G /dev/hdc1 and add it.

I’m not totally sure if this will actually work or not, it’d be an interesting lab though, I might try it tonight when I go home.