Thanks for the TLER tip. I had read about the drive setting but not that WD Black could have a problem.
I agree with your point about time having real value and I don’t mind changing plans. Let’s me share more of the situation background so that everyone can better understand my needs.
I built a NAS before they were readily available for SOHO use. This worked fine for everything except photo processing. The combined throughput of the NICs, network, drives etc. was fairly poor and I discovered somewhat late that it was dramatically reducing working speeds with larger photo files when I was processing on my workstation and saving to the NAS.
I asked for advice on upgrading my machine and several photo experts suggested first moving the image storage, at least for working files, back to the workstation itself before looking at CPU/MOBO upgrades. They also suggested an SSD for OS, page file, etc.
They were right! I made both changes some time ago and it provided a huge improvement for opening files, working on files (due to paging), and saving files.
To your point about RAM and a RAM disk, I will shortly be setting up a new workstation with 32gb ram which should provide more than enough space to fully process the largest files in memory w/o any Photoshop disk paging.
Because of my previous experience with the NAS, I have felt that moving my images back to a NAS would be step backwards in terms of working time. Now, if my work style was one image at a time, it would probably not be a big deal to work on it on the workstation and final save to the NAS.
However, on a given shoot/trip, I might come back with several thousand images. In the past, that has been somewhere between 40-80GB for each image set.
By the way, that’s in compressed raw format of about 14MB per image. As soon as an image is opened in Photoshop and resaved, it will hit at least 40MB. It’s not uncommon though for a file to be 100-300MB and in some cases over a GB for large stitched panorama files. Fortunately, I typically will only process about 5% of the images in a given set with Photoshop; so, most will stay around 14MB. The size of the files and the size of the entire sets will at least triple if I upgrade my camera to one of the larger sensor cameras that are currently available.
I tend to work on the entire set of images for a period of time. Because of that, I want those images on a fast read/write storage platform, with data redundancy. I have assumed this means working on the set on HDDs or SSDs directly attached to the Mobo. If that assumption is correct, then midterm storage is definitely workstation based.
The next question is one of long term storage. Do I just keep the images in a large Raid 1 on the workstation or migrate an entire image set to a NAS after processing?
I’m not sure though that a second machine solves the single point of failure question as the NAS also has a single point of failure with its MOBO.
Or is the suggestion to use Raid 1 in the workstation AND back up everything to a Raid on the NAS?
As mentioned in one of my first posts at the top of the thread, I’m also doing some offsite backup as well. In addition to that, I’m considering starting with a cloud storage company for a better offsite backup program.
So, I now have more questions than I started with. This is really raising questions about the best working storage strategy, longer term storage and backup strategy, AND which Raid level to use for the workstation and/or for the NAS.
Again, any advice will be appreciated!