External USB Drive for Backup

[hvymetal86]

I just bought an external hard drive for use with my 5big vs2 NAS as backup. The web interface detected it and I selected just that drive to format. The NAS went into setup mode and I haven't gotten any errors but it seems like it'll take eternity to format the external drive for its use at the current speed. Current status after running for about 19-20 hours is:

Code: Select all

NAS server in Setup Mode

(re-)Start the setup task :   Reset internal disk(s)

Started on:   05 April 2021, 01:20:29
Ended at:   ...
Setup task reset.sh is now running
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED)
Delete the partiton table on sek: OK
Create a new partiton gpt table on sek:
=>Creating gpt partition table succeeded
Format partition sek1 with file system ext4:
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: 2717b400-d212-43f0-8336-263eb48bd3f8
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
2560000000, 3855122432
Allocating group tables: done
Writing inode tables: 161/119216

About 30 minutes ago it was at 27/119216 which if I recall correctly was what it said within 5 minutes of starting the process over 19 hours ago. I'm glad it seems to be progressing after initially looking stuck, but I'm hoping there might be a way to speed it up much the same as I manually adjusted the RAID rebuild speed in the past using Jocko's advice here (obviously the exact same commands won't work since its not a RAID operation): http://plugout.net/viewtopic.php?f=26&t=2700&start=30#p25462

Thanks in advance for any help!

[Jocko]

Hi

Ok I go to deepen this point. Maybe there is an issue with a pipe which breaks the progress canal (but I believe the job is really done)

Can you post

Code: Select all

ls -al /etc/.setup.fs
cat /etc/.setup.fs/setupjob.log
cat /etc/.setup.fs/setupjob.ini


and what browser did you use ?

[hvymetal86]

Thanks for the quick response!

Current status as per web interface:

Code: Select all

NAS server in Setup Mode

(re-)Start the setup task :   Reset internal disk(s)

Started on:   05 April 2021, 01:20:29
Ended at:   ...
Setup task reset.sh is now running
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED)
Delete the partiton table on sek: OK
Create a new partiton gpt table on sek:
=>Creating gpt partition table succeeded
Format partition sek1 with file system ext4:
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: 2717b400-d212-43f0-8336-263eb48bd3f8
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
2560000000, 3855122432
Allocating group tables: done
Writing inode tables: 364/119216

ls -al /etc/.setup.fs

Code: Select all

root@HvyMtlNAS:/ # ls -al /etc/.setup.fs
total 40
drwxrwxrwx   2 root   root   4096 2021-04-05 01:20 .
drwxrwxr-x  20 root   sys    4096 2021-04-06 15:14 ..
-rw-r--r--   1 root   root    939 2017-01-28 09:47 check_disk
lrwxrwxrwx   1 root   root     37 2021-04-05 01:20 dic_setup.ini -> /usr/htdocs/includes/dic_setup_en.ini
-rw-r--r--   1 root   root   1843 2021-04-05 01:19 reset.sh
-rw-r--r--   1 root   root   4679 2018-12-30 07:12 set_fs.0
-rw-r--r--   1 root   root   2942 2018-12-30 07:12 set_partid.0
-rw-r--r--   1 nobody nobody   93 2021-04-05 01:20 setupjob.ini
-rw-r--r--   1 nobody nobody   82 2021-04-05 01:19 setupjob.inie
-rw-r--r--   1 nobody nobody 3939 2021-04-06 06:34 setupjob.log


cat /etc/.setup.fs/setupjob.log

Code: Select all

root@HvyMtlNAS:/ # cat /etc/.setup.fs/setupjob.log
<b>Setup task reset.sh is now running</b><br>
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED) <br>
Delete the partiton table on sek: OK<br>
Create a new partiton gpt table on sek: <br>
=>Creating gpt partition table succeeded<br>
Format partition sek1 with file system ext4: <br>
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: 2717b400-d212-43f0-8336-263eb48bd3f8
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
        102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
        2560000000, 3855122432

Allocating group tables: done


cat /etc/.setup.fs/setupjob.ini

Code: Select all

root@HvyMtlNAS:/ # cat /etc/.setup.fs/setupjob.ini
title="Reset internal disk(s)"
status=0
start=1617600029
scriptname="reset.sh"
stop=
error=""root@HvyMtlNAS:/ #


I'm using Google Chrome Version 89.0.4389.114 (Official Build) (64-bit)

[Jocko]

Hi

Thank you for your posting Now we can be sure the issue is not on the progress channel (not broken) and not related with a browser behaviour. It seems it is really an issue with e2fsprogs (make fs is hanged)

Your nas, is it still in setup mode ?

[hvymetal86]

Yes, its still in setup mode.

[Jocko]

Hi,

So try to reboot the nas (power switch) without using the command from the web-interface and reload the web-interface after waiting 1-2 min. The setup job should restart.

Then post again

Code: Select all

cat /etc/.setup.fs/setupjob.log

[hvymetal86]

I followed your steps, only change was I had to click the restart task button to on the web interface after the restart instead of it beginning automatically. Output from "cat /etc/.setup.fs/setupjob.log"

Code: Select all

root@HvyMtlNAS:/ # cat /etc/.setup.fs/setupjob.log
<b>Setup task reset.sh is now running</b><br>
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED) <br>
Delete the partiton table on sek: OK<br>
Create a new partiton gpt table on sek: <br>
=>Creating gpt partition table succeeded<br>
Format partition sek1 with file system ext4: <br>
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: 2717b400-d212-43f0-8336-263eb48bd3f8
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
        102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
        2560000000, 3855122432

Allocating group tables: done
Writing inode tables: <br><b>Setup task reset.sh is restarting</b><br>
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED) <br>
Format partition sek1 with file system ext4: <br>
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: cc780700-ff92-49ff-b6e1-bd2cf226905c
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
        102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
        2560000000, 3855122432

Allocating group tables: done


From the web interface the inode tables progress is MUCH faster now, current status:

Code: Select all

Setup task reset.sh is now running
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED)
Delete the partiton table on sek: OK
Create a new partiton gpt table on sek:
=>Creating gpt partition table succeeded
Format partition sek1 with file system ext4:
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: 2717b400-d212-43f0-8336-263eb48bd3f8
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
2560000000, 3855122432
Allocating group tables: done
Writing inode tables:
Setup task reset.sh is restarting
Found disk: sek(324348373844564A-0:0_WD_My_Book_25ED)
Format partition sek1 with file system ext4:
=>mke2fs 1.43.4 (31-Jan-2017)
Creating filesystem with 3906469371 4k blocks and 488308736 inodes
Filesystem UUID: cc780700-ff92-49ff-b6e1-bd2cf226905c
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
102400000, 214990848, 512000000, 550731776, 644972544, 1934917632,
2560000000, 3855122432
Allocating group tables: done
Writing inode tables: 4159/119216

Its increasing by about 20-40 every second. I'll check back on it tomorrow and update here again.

[hvymetal86]

It finished and the drive is now usable, but I'm not sure I understand the backup settings. What I want to do is backup all shares to duplicate named ones with the incremental backup method several times daily. But I can't seem to select any more than a single pair of folders and obviously have to exclude the external volume so can't just use \ as the source. The "Add scheduled backup in CRON" button also stays greyed out no matter what options I seem to select.

[Jocko]

Hi

So the issue is fixed. Maybe it was a power supply problem of your usb disk which hanged the e2fsprogs command (micro problem supply)

Now about backup settings. Yes you can not backup all internal shares as source but only one share (or a subfolder). This because the backup will take too much time with a 5big2 (and you won't be able to run it several times by day). But what you may do. Set a backup with one share and plan it with cron. then post here your script and I can patch it so that it backups all internal shares

[hvymetal86]

I tried to do that with just one share, but the cron button is greyed out.

Screenshot
https://drive.google.com/file/d/1orrq49r0vpaQSfNitEy1wBuDP194mZSs/view?usp=sharing