Hi
just testing out my echomail config....
hoping this works...

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 14 Jan 2021, 09:18p, gcubebuddy said the following...

Hi
just testing out my echomail config....
hoping this works...

Looks like it's working now! ;)


---

Black Panther(RCS)
aka Dan Richter
Castle Rock BBS
telnet://bbs.castlerockbbs.com
http://www.castlerockbbs.com
http://github.com/DRPanther
The sparrows are flying again...

--- Mystic BBS v1.12 A47 2021/01/05 (Linux/64)
* Origin: Castle Rock BBS - bbs.castlerockbbs.com (21:1/186)

Awesome! woot woot! thanks so much for helping me out with this.
i am going to take a tar.7z back of the directory right now, so that way if something goes wrong i can revert it to a working state. lol

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 14 Jan 2021, 10:30p, gcubebuddy said the following...

Awesome! woot woot! thanks so much for helping me out with this.
i am going to take a tar.7z back of the directory right now, so that way ifsomething goes wrong i can revert it to a working state. lol

You're very welcome.

It's always a good idea to have a backup of your system. I have a nightly backup going to an external drive, and a weekly backup going to a cloud server. :)


---

Black Panther(RCS)
aka Dan Richter
Castle Rock BBS
telnet://bbs.castlerockbbs.com
http://www.castlerockbbs.com
http://github.com/DRPanther
The sparrows are flying again...

--- Mystic BBS v1.12 A47 2021/01/05 (Linux/64)
* Origin: Castle Rock BBS - bbs.castlerockbbs.com (21:1/186)

wow cool! ya that is a good idea. i might create some kind of a
script / cronjob that saves at least 10 revisions of the mystic dir.
what i did, in order to reduce backup file size, i moved the uploads
folder to outside of the mystic directory. i have up to 40 gigs of
eBook and opensource software downloads in the directory.
i then added a softlink in the mystic files directory where the uploads
folder came from. that way mystic can still find the folder, and i can take snapshots of the mystic directory:

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

i also upload the file to my nas system and also i need to back up a copy to dvd so i have a permenate copy. i might also stash a backup on my google
drive, just to be safe lol. i do live in tornado alley - so having backups in multipal places is a good idea.

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 15 Jan 2021, gcubebuddy said the following...

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

i also upload the file to my nas system and also i need to back up a
copy todvd so i have a permenate copy.

I do something similar, I take nightly backups via a cron job:

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

And then move that file (nrbbs-2021-01-15.tar.7z) to my NAS. I've been meaning to also script deleting older versions of those backup files (there are currently 52 of them), but I have plenty of space on there, so I'm not too worried.

I like the idea of keeping some copies on Google Drive, I'll have to set that up as well.


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

Wow cool, i think i might borrow your snipit of code, for my own backup lol.

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 15 Jan 2021, Warpslide said the following...

I like the idea of keeping some copies on Google Drive, I'll have to set that up as well.

Got that setup this afternoon. The old tool I used to use "gdrive" no longer works, but I did find this one that still works:

https://github.com/labbots/google-drive-upload

Now that I have that installed, I just added this line to my backup script:

gupload -q /tmp/nrbbs-`date +%F`.tar.7z

And it uploads that file to my Google Drive before it's then moved to my NAS.

Thanks for the tip!


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

i also upload the file to my nas system and also i need to back up a copy todvd so i have a permenate copy.

I do something similar, I take nightly backups via a cron job:

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

And then move that file (nrbbs-2021-01-15.tar.7z) to my NAS. I've been meaningto also script deleting older versions of those backup files
(there arecurrently 52 of them), but I have plenty of space on there, so I'm not tooworried.

Jay

Both of you gave me a couple ideas; lol, I have a cronjob that just rsync -aG (i think)'s the /mystic directory. However, I don't .tar it up currently. I suppose I probably should; I like the Rsync because I *do* backup all my files, and this way it only copies any NEW or changed files/permissions/etc...

Currently I just backup to an external HD, but... maybe I'll set it up to send a TAR+ZIP over twice a week, to my NAS box too. And I liked the OPs idea of having one DVD or USBstick idea. The cloud is even better...

Thanks for more ideas about backups. :P w00t w00t!



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (21:2/150)

gcubebuddy wrote to Black Panther <=-

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

If you add a z option to your tar command it'll use gzip to compress your archive in one step. You'd want to use a .tar.gz suffix. You could probably
do bzip2 from the tar command line these days, it's been a while since I've done this.


... alphabetise the alphabet (it's all wrong. will explain later)
--- MultiMail/DOS v0.52
* Origin: realitycheckBBS.org -- information is power. (21:4/122)

Warpslide wrote to gcubebuddy <=-

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

Is 7zip really that much more compressy than gzip? Asking for a friend with
a lot of text files.


... alphabetise the alphabet (it's all wrong. will explain later)
--- MultiMail/DOS v0.52
* Origin: realitycheckBBS.org -- information is power. (21:4/122)

On 16 Jan 2021, poindexter FORTRAN said the following...

Is 7zip really that much more compressy than gzip? Asking for a friend with a lot of text files.

~ $ tar cf - /home/pi/mystic | 7z a -si test.tar.7z
~ $ ll test.tar.7z

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z


~ $ tar -czvf test.tar.gz /home/pi/mystic
~ $ ll test.tar.gz

-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

On 01-16-21 09:46, poindexter FORTRAN wrote to gcubebuddy <=-

gcubebuddy wrote to Black Panther <=-

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

If you add a z option to your tar command it'll use gzip to compress
your archive in one step. You'd want to use a .tar.gz suffix. You could probably do bzip2 from the tar command line these days, it's been a
while since I've done this.

Use j instead of z for bzip2. :)


... "Hello, World!" 17 Errors, 31 Warnings....
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

On 01-16-21 17:01, Warpslide wrote to poindexter FORTRAN <=-

On 16 Jan 2021, poindexter FORTRAN said the following...

Is 7zip really that much more compressy than gzip? Asking for a friend with a lot of text files.

~ $ tar cf - /home/pi/mystic | 7z a -si test.tar.7z
~ $ ll test.tar.7z

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z

~ $ tar -czvf test.tar.gz /home/pi/mystic
~ $ ll test.tar.gz

-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz

What about tar -jcvf test.tar.bzip2 ?


... Chopped cabbage-it's not just a good idea...it's THE SLAW
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

Re: Re: Woot Woot!
By: poindexter FORTRAN to Warpslide on Sat Jan 16 2021 09:46 am

Warpslide wrote to gcubebuddy <=-

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

Is 7zip really that much more compressy than gzip? Asking for a friend with a lot of text files.

... alphabetise the alphabet (it's all wrong. will explain later)

Yes, you are going to notice a difference, specially if you pass aggressive compression options.

ZPAQ is even more aggressive. Usually lrzip with the ZPAQ algorythm wil get you the best compression for text (which is brutal)
at the expense of insana lengths of time.

--
gopher://gopher.richardfalken.com/1/richardfalken
--- SBBSecho 3.12-Linux
* Origin: Palantir * palantirbbs.ddns.net * Pensacola, FL * (21:2/138)

On 17 Jan 2021, Vk3jed said the following...

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z
-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz

What about tar -jcvf test.tar.bzip2 ?

~ $ tar -jcvf test.tar.bzip2 /home/pi/mystic
~ $ ll test.tar.bzip2

-rw-r--r-- 1 pi pi 61M Jan 17 09:03 test.tar.bzip2

And because there would be more messages received since yesterday, and the logs are bigger, I decided to run the other two again just for a fair comparison:

-rw-r--r-- 1 pi pi 96M Jan 17 09:09 test.tar.gz
-rw-r--r-- 1 pi pi 49M Jan 17 09:19 test.tar.7z

And the size of the uncompressed .tar:

-rw-r--r-- 1 pi pi 503M Jan 17 09:16 test.tar


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

Am 17.01.21 schrieb Vk3jed@21:1/109 in FSX_GEN:

Hallo Vk3jed,

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

If you add a z option to your tar command it'll use gzip to compress
your archive in one step. You'd want to use a .tar.gz suffix. You could pF>> probably do bzip2 from the tar command line these days, it's been a
while since I've done this.

Use j instead of z for bzip2. :)

In recent versions, you can also use J for xz compression. :)

Regards,
Anna

--- OpenXP 5.0.48
* Origin: Imzadi Box Point (21:3/127.1)

On 17 Jan 2021, acn said the following...

In recent versions, you can also use J for xz compression. :)

Hmm, looks like xz gives 7zip a run for its money, though it did seem to take longer:

~ $ tar -Jcvf test.tar.xz /home/pi/mystic
~ $ ll test.tar.xz

-rw-r--r-- 1 pi pi 47M Jan 17 12:55 test.tar.xz


Jay

--- Mystic BBS v1.12 A47 2021/01/16 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

I do something similar, I take nightly backups via a cron job:

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

Thanks for this, by the way (and the earlier commenter, I imagine), as it led me to setup something similar on my BBS. But I got to be lazy and not figure out the tar command.

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Storm BBS (21:2/108)

Wow cool! I think i will try that out myself :-) thanks for the info on that.

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

Hello Warpslide!

** On Friday 15.01.21 - 20:20, Warpslide wrote to gcubebuddy:

gupload -q /tmp/nrbbs-`date +%F`.tar.7z

And it uploads that file to my Google Drive before it's then moved to my NAS.

Can't you run them (the upload to GD and the copy to NAS) both simultaneously?


--- OpenXP 5.0.48
* Origin: (} Pointy McPointFace (21:4/106.21)

On 01-17-21 09:23, Warpslide wrote to Vk3jed <=-

On 17 Jan 2021, Vk3jed said the following...

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z
-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz

What about tar -jcvf test.tar.bzip2 ?

~ $ tar -jcvf test.tar.bzip2 /home/pi/mystic
~ $ ll test.tar.bzip2

-rw-r--r-- 1 pi pi 61M Jan 17 09:03 test.tar.bzip2

And because there would be more messages received since yesterday, and
the logs are bigger, I decided to run the other two again just for a
fair comparison:

-rw-r--r-- 1 pi pi 96M Jan 17 09:09 test.tar.gz
-rw-r--r-- 1 pi pi 49M Jan 17 09:19 test.tar.7z

And the size of the uncompressed .tar:

-rw-r--r-- 1 pi pi 503M Jan 17 09:16 test.tar

Interesting, 7Zip does seem to be particularly efficient with the data you have. I expected better from bzip2, quite frankly, it's usually quite good. And gzip is less effective, as your tests showed.


... Ancient custom has the force of law.
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

On 01-17-21 18:24, acn wrote to Vk3jed <=-

Use j instead of z for bzip2. :)

In recent versions, you can also use J for xz compression. :)

That's one I didn't know. Thanks. :)


... A jury -- twelve persons chosen to decide who has the better lawyer.
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

On 19 Jan 2021, Ogg said the following...

Can't you run them (the upload to GD and the copy to NAS) both simultaneously?

There's probably a way to do that. It only takes ~14 seconds to upload to Google Drive and nearly instant to move the file to the NAS afterwards.

By far the longest part of nightly maintenance is packing the messages bases and creating the actual .7z file. g00r00 recently said over on SciNet that I don't need to pack my message bases every night & that he only does it every couple of months, so I may re-visit that practice.


Jay

--- Mystic BBS v1.12 A47 2021/01/16 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

Warpslide wrote (2021-01-20):

By far the longest part of nightly maintenance is packing the messages bases and creating the actual .7z file. g00r00 recently said over on SciNet that I don't need to pack my message bases every night & that he only does it every couple of months, so I may re-visit that practice.

If you don't delete messages from the JAM base, there is nothing to pack. Because message traffic is low and echomail storage space is negligible, I never delete anything. I only pack my NETMAIL area from time to time, because Golded still shows deleted messages in the message list until the message is packed.

---
* Origin: this message must NOT be gated to Telegram (21:3/102)

WARPSLIDE(21:3/110) wrote to Ogg <=-

By far the longest part of nightly maintenance is packing the messages bases and creating the actual .7z file. g00r00 recently said over on SciNet that I don't need to pack my message bases every night & that he only does it every couple of months, so I may re-visit that practice.

I usually like to pack the message bases daily. Clean out deleted messages, and make sure the msg base does not get
too clogged.

... "...[God] created lipstick and rollers for our hair." -Destinty's Child
--- MultiMail/Win v0.52


--- WWIV 5.6.1.3405
* Origin: inland utopia * socal usa * iutopia.duckdns.org:2023 (21:4/108)

Hi
just testing out my echomail config....
hoping this works...

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 14 Jan 2021, 09:18p, gcubebuddy said the following...

Hi
just testing out my echomail config....
hoping this works...

Looks like it's working now! ;)


---

Black Panther(RCS)
aka Dan Richter
Castle Rock BBS
telnet://bbs.castlerockbbs.com
http://www.castlerockbbs.com
http://github.com/DRPanther
The sparrows are flying again...

--- Mystic BBS v1.12 A47 2021/01/05 (Linux/64)
* Origin: Castle Rock BBS - bbs.castlerockbbs.com (21:1/186)

Awesome! woot woot! thanks so much for helping me out with this.
i am going to take a tar.7z back of the directory right now, so that way if something goes wrong i can revert it to a working state. lol

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 14 Jan 2021, 10:30p, gcubebuddy said the following...

Awesome! woot woot! thanks so much for helping me out with this.
i am going to take a tar.7z back of the directory right now, so that way ifsomething goes wrong i can revert it to a working state. lol

You're very welcome.

It's always a good idea to have a backup of your system. I have a nightly backup going to an external drive, and a weekly backup going to a cloud server. :)


---

Black Panther(RCS)
aka Dan Richter
Castle Rock BBS
telnet://bbs.castlerockbbs.com
http://www.castlerockbbs.com
http://github.com/DRPanther
The sparrows are flying again...

--- Mystic BBS v1.12 A47 2021/01/05 (Linux/64)
* Origin: Castle Rock BBS - bbs.castlerockbbs.com (21:1/186)

wow cool! ya that is a good idea. i might create some kind of a
script / cronjob that saves at least 10 revisions of the mystic dir.
what i did, in order to reduce backup file size, i moved the uploads
folder to outside of the mystic directory. i have up to 40 gigs of
eBook and opensource software downloads in the directory.
i then added a softlink in the mystic files directory where the uploads
folder came from. that way mystic can still find the folder, and i can take snapshots of the mystic directory:

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

i also upload the file to my nas system and also i need to back up a copy to dvd so i have a permenate copy. i might also stash a backup on my google
drive, just to be safe lol. i do live in tornado alley - so having backups in multipal places is a good idea.

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 15 Jan 2021, gcubebuddy said the following...

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

i also upload the file to my nas system and also i need to back up a
copy todvd so i have a permenate copy.

I do something similar, I take nightly backups via a cron job:

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

And then move that file (nrbbs-2021-01-15.tar.7z) to my NAS. I've been meaning to also script deleting older versions of those backup files (there are currently 52 of them), but I have plenty of space on there, so I'm not too worried.

I like the idea of keeping some copies on Google Drive, I'll have to set that up as well.


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

Wow cool, i think i might borrow your snipit of code, for my own backup lol.

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

On 15 Jan 2021, Warpslide said the following...

I like the idea of keeping some copies on Google Drive, I'll have to set that up as well.

Got that setup this afternoon. The old tool I used to use "gdrive" no longer works, but I did find this one that still works:

https://github.com/labbots/google-drive-upload

Now that I have that installed, I just added this line to my backup script:

gupload -q /tmp/nrbbs-`date +%F`.tar.7z

And it uploads that file to my Google Drive before it's then moved to my NAS.

Thanks for the tip!


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

i also upload the file to my nas system and also i need to back up a copy todvd so i have a permenate copy.

I do something similar, I take nightly backups via a cron job:

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

And then move that file (nrbbs-2021-01-15.tar.7z) to my NAS. I've been meaningto also script deleting older versions of those backup files
(there arecurrently 52 of them), but I have plenty of space on there, so I'm not tooworried.

Jay

Both of you gave me a couple ideas; lol, I have a cronjob that just rsync -aG (i think)'s the /mystic directory. However, I don't .tar it up currently. I suppose I probably should; I like the Rsync because I *do* backup all my files, and this way it only copies any NEW or changed files/permissions/etc...

Currently I just backup to an external HD, but... maybe I'll set it up to send a TAR+ZIP over twice a week, to my NAS box too. And I liked the OPs idea of having one DVD or USBstick idea. The cloud is even better...

Thanks for more ideas about backups. :P w00t w00t!



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (21:2/150)

gcubebuddy wrote to Black Panther <=-

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

If you add a z option to your tar command it'll use gzip to compress your archive in one step. You'd want to use a .tar.gz suffix. You could probably
do bzip2 from the tar command line these days, it's been a while since I've done this.


... alphabetise the alphabet (it's all wrong. will explain later)
--- MultiMail/DOS v0.52
* Origin: realitycheckBBS.org -- information is power. (21:4/122)

Warpslide wrote to gcubebuddy <=-

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

Is 7zip really that much more compressy than gzip? Asking for a friend with
a lot of text files.


... alphabetise the alphabet (it's all wrong. will explain later)
--- MultiMail/DOS v0.52
* Origin: realitycheckBBS.org -- information is power. (21:4/122)

On 16 Jan 2021, poindexter FORTRAN said the following...

Is 7zip really that much more compressy than gzip? Asking for a friend with a lot of text files.

~ $ tar cf - /home/pi/mystic | 7z a -si test.tar.7z
~ $ ll test.tar.7z

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z


~ $ tar -czvf test.tar.gz /home/pi/mystic
~ $ ll test.tar.gz

-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

On 01-16-21 09:46, poindexter FORTRAN wrote to gcubebuddy <=-

gcubebuddy wrote to Black Panther <=-

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

If you add a z option to your tar command it'll use gzip to compress
your archive in one step. You'd want to use a .tar.gz suffix. You could probably do bzip2 from the tar command line these days, it's been a
while since I've done this.

Use j instead of z for bzip2. :)


... "Hello, World!" 17 Errors, 31 Warnings....
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

On 01-16-21 17:01, Warpslide wrote to poindexter FORTRAN <=-

On 16 Jan 2021, poindexter FORTRAN said the following...

Is 7zip really that much more compressy than gzip? Asking for a friend with a lot of text files.

~ $ tar cf - /home/pi/mystic | 7z a -si test.tar.7z
~ $ ll test.tar.7z

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z

~ $ tar -czvf test.tar.gz /home/pi/mystic
~ $ ll test.tar.gz

-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz

What about tar -jcvf test.tar.bzip2 ?


... Chopped cabbage-it's not just a good idea...it's THE SLAW
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

Re: Re: Woot Woot!
By: poindexter FORTRAN to Warpslide on Sat Jan 16 2021 09:46 am

Warpslide wrote to gcubebuddy <=-

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

Is 7zip really that much more compressy than gzip? Asking for a friend with a lot of text files.

... alphabetise the alphabet (it's all wrong. will explain later)

Yes, you are going to notice a difference, specially if you pass aggressive compression options.

ZPAQ is even more aggressive. Usually lrzip with the ZPAQ algorythm wil get you the best compression for text (which is brutal)
at the expense of insana lengths of time.

--
gopher://gopher.richardfalken.com/1/richardfalken
--- SBBSecho 3.12-Linux
* Origin: Palantir * palantirbbs.ddns.net * Pensacola, FL * (21:2/138)

On 17 Jan 2021, Vk3jed said the following...

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z
-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz

What about tar -jcvf test.tar.bzip2 ?

~ $ tar -jcvf test.tar.bzip2 /home/pi/mystic
~ $ ll test.tar.bzip2

-rw-r--r-- 1 pi pi 61M Jan 17 09:03 test.tar.bzip2

And because there would be more messages received since yesterday, and the logs are bigger, I decided to run the other two again just for a fair comparison:

-rw-r--r-- 1 pi pi 96M Jan 17 09:09 test.tar.gz
-rw-r--r-- 1 pi pi 49M Jan 17 09:19 test.tar.7z

And the size of the uncompressed .tar:

-rw-r--r-- 1 pi pi 503M Jan 17 09:16 test.tar


Jay

--- Mystic BBS v1.12 A47 2021/01/05 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

Am 17.01.21 schrieb Vk3jed@21:1/109 in FSX_GEN:

Hallo Vk3jed,

tar cfv mystic-BACKUP-20210114.tar mystic
7z a mystic-BACKUP-20210114.tar.7z mystic-BACKUP-20210114.tar

If you add a z option to your tar command it'll use gzip to compress
your archive in one step. You'd want to use a .tar.gz suffix. You could pF>> probably do bzip2 from the tar command line these days, it's been a
while since I've done this.

Use j instead of z for bzip2. :)

In recent versions, you can also use J for xz compression. :)

Regards,
Anna

--- OpenXP 5.0.48
* Origin: Imzadi Box Point (21:3/127.1)

On 17 Jan 2021, acn said the following...

In recent versions, you can also use J for xz compression. :)

Hmm, looks like xz gives 7zip a run for its money, though it did seem to take longer:

~ $ tar -Jcvf test.tar.xz /home/pi/mystic
~ $ ll test.tar.xz

-rw-r--r-- 1 pi pi 47M Jan 17 12:55 test.tar.xz


Jay

--- Mystic BBS v1.12 A47 2021/01/16 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

I do something similar, I take nightly backups via a cron job:

tar cf - /home/pi/mystic | 7z a -si /tmp/nrbbs-`date +%F`.tar.7z

Thanks for this, by the way (and the earlier commenter, I imagine), as it led me to setup something similar on my BBS. But I got to be lazy and not figure out the tar command.

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Storm BBS (21:2/108)

Wow cool! I think i will try that out myself :-) thanks for the info on that.

Thanks
- Gamecube Buddy

telnet --<{bbs.hive32.com:23333}>--

--- Mystic BBS v1.12 A46 2020/08/26 (Linux/64)
* Origin: Hive32 (21:4/129)

Hello Warpslide!

** On Friday 15.01.21 - 20:20, Warpslide wrote to gcubebuddy:

gupload -q /tmp/nrbbs-`date +%F`.tar.7z

And it uploads that file to my Google Drive before it's then moved to my NAS.

Can't you run them (the upload to GD and the copy to NAS) both simultaneously?


--- OpenXP 5.0.48
* Origin: (} Pointy McPointFace (21:4/106.21)

On 01-17-21 09:23, Warpslide wrote to Vk3jed <=-

On 17 Jan 2021, Vk3jed said the following...

-rw-r--r-- 1 pi pi 49M Jan 16 16:54 test.tar.7z
-rw-r--r-- 1 pi pi 95M Jan 16 16:49 test.tar.gz

What about tar -jcvf test.tar.bzip2 ?

~ $ tar -jcvf test.tar.bzip2 /home/pi/mystic
~ $ ll test.tar.bzip2

-rw-r--r-- 1 pi pi 61M Jan 17 09:03 test.tar.bzip2

And because there would be more messages received since yesterday, and
the logs are bigger, I decided to run the other two again just for a
fair comparison:

-rw-r--r-- 1 pi pi 96M Jan 17 09:09 test.tar.gz
-rw-r--r-- 1 pi pi 49M Jan 17 09:19 test.tar.7z

And the size of the uncompressed .tar:

-rw-r--r-- 1 pi pi 503M Jan 17 09:16 test.tar

Interesting, 7Zip does seem to be particularly efficient with the data you have. I expected better from bzip2, quite frankly, it's usually quite good. And gzip is less effective, as your tests showed.


... Ancient custom has the force of law.
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

On 01-17-21 18:24, acn wrote to Vk3jed <=-

Use j instead of z for bzip2. :)

In recent versions, you can also use J for xz compression. :)

That's one I didn't know. Thanks. :)


... A jury -- twelve persons chosen to decide who has the better lawyer.
=== MultiMail/Win v0.52
--- SBBSecho 3.10-Linux
* Origin: Freeway BBS Bendigo,Australia freeway.apana.org.au (21:1/109)

On 19 Jan 2021, Ogg said the following...

Can't you run them (the upload to GD and the copy to NAS) both simultaneously?

There's probably a way to do that. It only takes ~14 seconds to upload to Google Drive and nearly instant to move the file to the NAS afterwards.

By far the longest part of nightly maintenance is packing the messages bases and creating the actual .7z file. g00r00 recently said over on SciNet that I don't need to pack my message bases every night & that he only does it every couple of months, so I may re-visit that practice.


Jay

--- Mystic BBS v1.12 A47 2021/01/16 (Raspberry Pi/32)
* Origin: Northern Realms (21:3/110)

Warpslide wrote (2021-01-20):

By far the longest part of nightly maintenance is packing the messages bases and creating the actual .7z file. g00r00 recently said over on SciNet that I don't need to pack my message bases every night & that he only does it every couple of months, so I may re-visit that practice.

If you don't delete messages from the JAM base, there is nothing to pack. Because message traffic is low and echomail storage space is negligible, I never delete anything. I only pack my NETMAIL area from time to time, because Golded still shows deleted messages in the message list until the message is packed.

---
* Origin: this message must NOT be gated to Telegram (21:3/102)

WARPSLIDE(21:3/110) wrote to Ogg <=-

By far the longest part of nightly maintenance is packing the messages bases and creating the actual .7z file. g00r00 recently said over on SciNet that I don't need to pack my message bases every night & that he only does it every couple of months, so I may re-visit that practice.

I usually like to pack the message bases daily. Clean out deleted messages, and make sure the msg base does not get
too clogged.

... "...[God] created lipstick and rollers for our hair." -Destinty's Child
--- MultiMail/Win v0.52


--- WWIV 5.6.1.3405
* Origin: inland utopia * socal usa * iutopia.duckdns.org:2023 (21:4/108)