Corrupted drive recovery

[Bestatella]

Hi,

I am not how I have managed this but I have corrupted two volumes on my instance “Newest_3_species”. Is there a backup of these that can be restored? It is hosted on Warwick.
The drives appear like this when i do “ls -tnh” from the home directory.

d?????????  ? ?    ?       ?            ? Extra_storage
d?????????  ? ?    ?       ?            ? More_extra_storage

running “sudo e2fsck -nf /dev/sdc” gave me:

sudo: unable to resolve host newest-3-species
e2fsck 1.42.13 (17-May-2015)
ext2fs_check_if_mount: Input/output error while determining whether /dev/sdc is mounted.
ext2fs_open2: Bad magic number in super-block
e2fsck: Superblock invalid, trying backup blocks...
e2fsck: Bad magic number in super-block while trying to open /dev/sdc

The superblock could not be read or does not describe a valid ext2/ext3/ext4
filesystem.  If the device is valid and it really contains an ext2/ext3/ext4
filesystem (and not swap or ufs or something else), then the superblock
is corrupt, and you might try running e2fsck with an alternate superblock:
    e2fsck -b 8193 <device>
 or
    e2fsck -b 32768 <device>

When I try to do anything in that drive I get an “input/output” error!

Running dmesg says there is an I/O error and that error -5 is returned: for both sdb and sdc:

[1448154.372768] XFS (sdb): xfs_log_force: error -5 returned.
[1448171.652655] XFS (sdc): xfs_log_force: error -5 returned.

This is really concerning and I hope there is a way to recover these drives!

[SBayliss]

Hi Jonathan,

Your first step should be to reboot your instance via Bryn.

All the best
Sion

[Bestatella]

Hi Sion,

Rebooting it has failed, unfortunately…

Looking at the console on Bryn, it says there is no bootable device. Although I am pretty sure the drive it boots to was working fine.

[SBayliss]

Hi Jonathan,

Can you access the instance after rebooting?

Sion

[Bestatella]

No. After rebooting i wasnt able to log in. Logging into Horizon/Bryn, clicking on the instance and then viewing the console output, it said the server was unable to boot!

Is there any backups made on CLIMB? Or should I follow the generic online advice for trying to recover data from a disk?

[SBayliss]

Hi Jonathan,

There are no periodic backups on CLIMB, that is the responsibility of the user.

It seems as if your instance was launched via Horizon, not Bryn. This interfered with the boot order of the attached volumes. The other volumes have been detached and you should be able to access the instance again. You will need to remount the volumes. If you are still having problems after remounting drives let us know and we will see what we can do.

All the best,
Sion