Do you have a dedicated system drive, and data drive separate from each other?
Posts by dbhosttexas
-
-
Not me. Costs only electricity and additional costs for the hard drive. I have time-shifted backups. Raid doesn't interest me. Whether the NAS is not available for a few hours is not so important. Backups of the system are also more important.
You do you I guess. Yes I could certainly get more available storage but would suffer from downtime should a drive fail. Mind you, RAID is no backup, it is a component to a downtime mitigation strategy.
Backups are well worth the time and effort, but offsite backup services, especially if you have a LOT of data, can be expensive to have...
-
No redundancy personally gives me the heebie jeebies...
Most if not all of this is going to depend on how much you want to spend and how much storage you need.
-
-
Okay going through the documentation on the github for the docker image, looks like crashplan hid / removed headless function from the app. So what I was trying via the older documentation was never going to work...
I have a LOT of legacy junk files that need to go away. (Going shopping with my late wive she always wanted me to snap pics of home decor items she wanted to check out later, that got backed up to my Google drive, never going to do those projects, no need for the images...)
-
Part of my purpose behind doing OMV and setting up the homelab again, is to learn Docker... It is why I have the Raspberry Pi cluster hardware at the ready. I have no clue how to set up storage or network to make a docker container happy and available.. (yet).
-
The most recent writeup I have found is from 2016 or so... So a very old version of both Crashplan and OMV.
How to Install Crashplan on Your Headless NAS – Rick GouinI tried this And it appeared to be backing up my Windows laptop and not my OMV server...
Is there a way to get Crashplan working natively on OMV 7?
I want it to grab everything under /DATA/ not just /DATA/hostname blah blah blah...
-
So how exactly does Crashplan work? Does it have an agent? Pricing says by user, but let's say my Linux share is owned by root, and my SMB share is owned by user rsmith, but root can access it, do I use root or how does that work?
-
Crashplan pro offers unlimited storage for $88 per year and, contrary to Backblaze, has support for Linux systems for the non-enterprise plan.
I thought Crashplan went the way of the dodo bird years ago... Shows you what I know I guess...
-
Looking at pricing, up to 5TB I am best off just bumping up my Google Drive storage... $15.00 / month for 5TB non ingress / egress fees for personal / home accounts...
-
I see it now. ZFS is consuming 15.6G. the rest of the mostly idle system I expect, This does explain the memory stats I am seeing for sure...
-
Not seeing any difference at all between active file system activity and just idle... That is what caught my attention...
-
Just wondering, with ZFS samba, clamav and NFS running but idle, is 20GB out of 32 available normal memory usage? I know Linux likes to keep things active in RAM if possible to speed things up but this seems highish to me...
-
Display More
I run a duplicati container, backing up specific folders to my mega.nz 8Tb account.
Only permissions to take care is the owner of the container having r/w access to those folders.
Although I don't do it, it can even be a encrypted backup but not the best to do on a Pi.
On a amd64, it will run without hogging resources, depending of the hardware.
Yeah, the Pi are clients, the NAS is AMD64, old, but AMD64 none the less, and wicked fast for its time, over a decade ago...
-
I know this thread got off topic, but I like where this is going...
Onto the status of the setup. I might have abandoned borgbackup in favor of rsync scripts on the Linux hosts / Raspberry Pi devices and File History / mounted drives on the Windows devices.
So far 2 Pis are backed up, the Pi 5 16GB workstation with the 4TB NVME, and the Pi 4B 8G box running Jellyfin. Plus and this won't make much sense until I explain it, but my Windows 11 desktop, and 2 Windows 11 laptops. (Asus ROG Strix G17 and Lenovo V15 G46-ABP I believe) My Asus had a mainboard catastrophe and went back for warranty repair so I bought the Lenovo as a stopgap so I could keep working mobile...
In some ways, mostly power consumption since when I am working mobile I am working out of my RV on solar power, I prefer the Lenovo...
All told, 2.5TB.
Since the important data from the Pi5 cluster is going to be on the NAS box anyway shared out via NFS, no need to back them up directly. Now I need to figure out offsite cloud backups that I can script / automate...
-
LOL... I remember when 3.5 GB seemed HUGE...
-
Given my budget right now, I am just kind of running what I can lay my hands on free or cheap....
BUT, given a budget boost, I would likely want to replace my RAID5 of 2TB Seagate Constellation I believe is the model, drives... They are if I recall Dell OEM and were basically NOS drives that were bought by a company as spares, the company failed, I bought them for next to free and failed to use them for anything for a long time...
If I wasn't concerned about being conservative with storage via deduplication, I would be less concerned about RAM and CPU... like ZFS has me doing. So lets assume I can buy and use whatever drives I wanted. Probably go with 8 16TB Ironwolf Pro NAS disks in a RAID6 array. WAY more space than I need, but absolutely zero chance of running out of disk space!
-
Given the amount of data I have NOW and am likely to have in the next year or so, it looks like bumping up my capacity in Google Drive and using rclone is what i want to do...
Found this video tutorial on the subject. Looks good so far...
https://scottenock.com/videos/sync-omv-to-google-drive-rclone
-
I am not doing great with the documentation and it could easily be me not looking in the right place so I am just going to ask outright.
Is there a dummy proof guide to setting up the S3 plugin and backing up to S3 glacier storage?
Are there other cheap cloud storage providers we can basically for lack of a better term, mount, so we can do archival offsite backups?
I've got 2G internet, my NAS connects via 10 gig, to the switch, switch to router 5 gig, router to ONT to internet 2.5 gig (allegedly provisioned 2 gig but getting constant 2.5 on it, and not going to complain)... Yes full backup will take a while, but incrementals should be okay...
-
I still have a Maxtor drive. A 120Gb SATA disk. Sitting in a pile of old drives...
Yeah first computer, was a Timex Sinclair ZX81, that really wasn't around long. My Dad did some wheeling and dealing and came home with an Atari 800xl with a floppy drive, I believe an Okidata dot matrix printer, and a modem. He got a similarly equipped 1200xl for himself. I taught myself BASIC on that thing, and played a LOT of Bruce Lee. My first PC was a 486DX2-66 that I got from a friend in college back in around 97. I took forever getting through college as I got one degree, decided I hated it and went back, but I digress. That PC I learned how to build and upgrade PCs because when I got it, it was literally a pile of parts. We sat down at his kitchen table and put it together and made it come to life with Windows 3.1... Not long after my oldest brother introduced me to Linux, which got me hooked, and it has been a spiral ever since... But I have always concentrated on the platform, not things like storage, databases, etc... until lately. I was the guy the storage admin would present the LUN for, not the one managing the storage and presenting the LUN...
So back to my NAS project...
So I ran an rsync from my Pi 4B, and a file history backup from my Win 11 client last night to the NAS with ZFS, the results?
Combined on client total of 2.0TB, after ZFS compression / deduplication 1.7TB, which is what I was aiming for.
Got my file and folder counts from each, ran an ls -alhr | wc -l against the respective directories, and it matches up, so in theory without actually doing a restore, looks like it is all there...
The Pi 5 16Gb is next on the list, Don't recall what I had in there data volume wise.
I am DEFINATELY going to need cloud backup, sooner rather than later. Not having much luck with any HOWTO in the docs but... I am more of a visual learner so I could EASILY be missing something in the docs...