October 24, 2011

photography workflow – back-up plans for the main computer

The photograph above was shot with my iPhone while I was waiting for a corporate photo shoot to commence. The sky over lower Manhattan was grim and rainy. You can see the reflection of the fluorescent lights inside the room. This gave the city scene a Blade-Runner-esque feel. And with that, this image is perhaps suitably Apocalyptic for this topic – what are your plans for catastrophic failure of your main computer?

The idea for this article comes from a discussion with another photographer – she cringed every time I mentioned, “so what happens to your business if your house burns down and your computer is gone?” My other remark that her computer’s hard drive most likely will fail at some point, didn’t seem to lift her spirits either.

So with that, let’s look at those two points:
1. Safe-guarding yourself against catastrophic loss of your computer.
2. Preparing yourself for when your hard drive crashes.

The solutions are fortunately quite simple and elegant …

Before we start, I have to offer these disclaimers:
– I can find my way around a computer to do my work as a photographer in the digital age. However, I’m not very computer savvy, and I’m not a computer geek with incredible detailed knowledge about the latest in computer hardware and software. So there might well be more sophisticated ways of doing what I’m doing. And there definitely are other ways of doing what I am doing. But I also feel that any digital photographer that strays from these basic ideas, will inevitably face very costly, if not insurmountable problems.
–  We’re just going to discuss your actual main computer – not your external hard drives or RAID arrays that hold your photographs. That’s another discussion.

 

1. Safe-guarding yourself against catastrophic loss of your computer

This year we saw the unbelievable way that Japan was hit with earthquakes and tsunamis. Devastating! And across the world, the global climate changes seem to affect the frequency and severity of the weather, such as tornados. The Mid-West of the USA saw tornado after tornado this year. And with no warning houses are shredded. Therefore it isn’t just scare-mongering to consider the likelihood of your computer being completely destroyed. Then there is always the lurking problem of theft of your computer.

solution: create an on-line / off-site version of your computer files. 

The idea here is that your computer files – your Word documents, spreadsheets, PDFs .. everything .. is stored as an immediate copy on a website. This is done automatically. You don’t have to think about it. Just pay your monthly or annual fee. Simple as that.

I use Dropbox.
There are other options out there as well on the internet. Lots of them.
Here is *what* I like about Dropbox … which is also explained in *how* I use Dropbox.

I keep *everything* of importance that resides on my main hard-drive, in the dropbox folder – contracts, receipts, reference files, presets .. everything. All my work files and documents. Instead of using the Dropbox folder on my computer as a single folder to stuff a bunch of documents in, I created a sensible folder structure within the Dropbox. Here is a screen-grab of part of it to give you an idea. Folders within folders.

Now, should my house burn down and I lose my computer and data … I can go to the Apple Store and buy a new MacBook Pro again. After setting it up, I would sign into my Dropbox account, and let the on-line version of my computer files sync to my new computer. Barely a day’s hiccup compared to what would’ve been a catastrophe if I had lost all my documents and files.

Another example of the beauty of using a solution like DropBox:
I might be in London on a trip, and a client emails me and needs a file. I can email or text my assistant-with-an-attitude to place the file in a Dropbox folder for me on the main computer in the office. A minute later (or less) it is synced on my laptop in my hotel room in London. I can then retouch the photo / make changes to a document / whatever-it-is-I-needed-to-do. Once I am done and have saved the file, it will automatically sync that file with the same file on my main office computer’s dropbox folder. (Same folder structure!) And then my assistant can print it and mail it or whatever-it-is-that-needs-to-be-done.

Elegant!

While I am recommending must-do stuff, here are two programs that I’d highly recommend. They will make your life easier:

1Password 

You keep all your passwords in one place with a single super-strong password. But before you shrug this off, let me explain that you also keep note of your registered username, and registered email address and any pertinent data. Even better, you can store your software keys here. (And again, also your registered username and registered email address and any pertinent data associated with a specific piece of software.)

Best part – it can sync via Dropbox.

 

Evernote

With Evernote, you keep documents and photos and any clippings, all in one place. You can create folders, and you can tag various items. I keep note of everything via Evernote. It may not sound so impressive when described like that, but I am sure that anyone who uses Evernote would agree with me that it quickly becomes an indispensable part of how you work on a computer on the internet, keeping track of stuff you like and want to refer to again.

Here’s the best part about Dropbox and 1Password and Evernote – it syncs across devices. So I have the same info on my laptop and main computer and iPad and iPhone. Anything from bus schedules to airplane flight details to client contracts.

 

2. Preparing yourself for when your hard drive crashes.

You absolutely *have* to have a rock-solid system in place here, for your hard drive is … well, I don’t want to be as dramatically emphatic as saying your hard drive *will* crash at some point, but you know it is quite likely to. And it is easy to be prepared for this.

My choice: Super-Duper!  and an external hard drive. 

I like their tagline: Heroic System Recovery For Mere Mortals.

And that is exactly the best part about Super-Duper. I’m a photographer.  I have *other* stuff to do than figure out software programs and set them up. Super-Duper is very easy to use.

With Super-Duper you set it up to make a bootable clone of your main hard drive. The “bootable” means that if your main hard drive should crash, you could boot your computer off the cloned drive … and you continue to work. You can take your computer in for repairs a day or so later. You know … when you have time, because *right now* have stuff you have to do and finish up. That it is a bootable clone is extremely important. It isn’t just a copy of my files. It is an actual copy of my hard drive as it existed at a specific time the previous day. And I can work on it, just as if it is my actual computer hard drive. (Any difference in the documents that I may have been working on that day, are easily fixed by finding the most current file on Time Machine or Dropbox.)

I have Super-Duper set up to make a cloned copy of my hard drive at 3am every night. And I can sleep safe and sound. It’s done for me.

 

Then of course, because I’m paranoid, I also have Time Machine set up to run and keep copies of my files on another hard drive. Redundancy is a good thing!

 

summary

As I mentioned at the start of this article – there are other ways of doing this, and other software options. These are what I am using right now to safeguard me from that heart-stopping moment when I realize my computer is gone, or my hard drive is just clicking away, not responding. Right now, these are minor annoyances compared to what could be – devastating loss. I can cope and recover without much drama.

It don’t think it is often that I am prescriptive in my advice … well, except when it comes to shooting in RAW, and shooting in manual exposure mode. Aside from that, I know there are many ways of working. Tastes vary. Intended results vary. Artistic intent varies. However …

… I  strongly feel that if you haven’t set up something similar to what is described in this article, you are courting disaster. You *have to* do something about this where there is no possible gap where computer failure or loss of a computer is devastating to you as a digital photographer. And you have to do it now. The options are so easy to use, and so seamless, that there is no excuse. You have to.

 

related articles

  1. photography workflow – back-up plans for your computer
  2. back-up plans (update)
  3. workflow and back-up plans for disaster

 

 

help support this website

{ 25 comments. } Add a Comment

1 Pasquier October 25, 2011 at 12:47 am

Thanks Neil for that informative post – I do make back-ups (not frequently enough), but a web-based solution like DropBox sounds like a really good idea – will give it a try!
Love the title pic – Blade Runner remains my favourite Sci-Fi flick.

Reply

2 William Ng October 25, 2011 at 3:54 am

I also use all the methods you listed except for Time Machine and SuperDuper. My photos and important data are kept on a Drobo and those files are uploaded automatically to CrashPlan in the Cloud.

I also have my data in Dropbox, but not photos.

You must have quite a few TB of photos files? Do you keep them on hard drives offsite?

With SuperDuper, you need to back up your hard drive to a Firewire drive in order to boot off it in an emergency, right?

Reply

3 fotografii aniversari October 25, 2011 at 5:18 am

I see SuperDruper is for Macintosh users, only. If you’d have PC only, what it would be your choices?
Thanks for reminding about this subject, since your last post about it, I had 2 crashes.

Reply

4 Toby October 25, 2011 at 6:42 am

Dropbox is great, but very limited in terms of its filespace. Even when paid for you can only have up to 100Gb.
That said, its syncing system IS fantastic – my wife uses it extensively to sync her machines when she’s away on business.
I keep all my important business information (accounts, taxes, invoices, website back up etc. etc. in my Dropbox which allows me access to that data whereever I am. For my photos though, I’m using Carbonite. I’m still in the process of my initial upload (408Gb) but for less than £3.50 per month I get UNLIMITED storage. The interface is simple to use too. There are some caveats with Carbonite(it doesn’t automatically upload ALL files in designated folders, and video files have to be manually added every time) but that’s ok for me as I don’t shoot video. It also won’t back up off external (USB/FW drives), so I appreciate that may be a deal breaker for some. Nonetheless, with all my photos on a 2TB internal drive, I just right-click my LR Catalogue (within which I also store my RAW files) and say ‘back up’ – no muss, no fuss. Oh, and it backs up my outlook PST file too :)
The combination of Dropbox AND Carbonite has removed a lot of worry for me (well, it will when my upload has finished in about a month’s time!)

Reply

5 Bob October 25, 2011 at 8:37 am

Great article Neil. I tell everyone I know my version of the same story.

For those PC people, I use Acronis for backing up my programs and Windows configuration. It sounds like it’s roughly the same as super duper.

Also, I use 5 external USB drives and copy all my data files (notes, pictures, etc.) every week or so. Every couple of months I leave one at my sister’s house. This is another way to do drop box yourself.

Get different makes of hard drive. Batches of hard drives tend to fail around the same time.

Reply

6 Belinda McCarthy October 25, 2011 at 9:17 am

I used to use (or, at least try to use) a combination of an external hard drive and an online backup. However, I found that the amount of uploading I needed to do was way in excess of what my area could cope with in terms of bandwidth and broadband speed. Weeks and weeks later, it was still struggling to get anywhere near uploaded, everything else was running slowly as it tried to upload, and I was getting evil messages from my ISP.

So, what I do now is have my JPEGs uploaded to an online backup (which is actually Zenfolio, so I can use it for backup AND to proof images to clients – double win) and JPEGs plus everything else, the big stuff like RAW and TIFF files, is on two identical external hard drives. One should really be kept offsite for extra security, but I haven’t figured out a simple solution for this yet. I guess I need to find myself a friendly neighbour who isn’t going to run off with my hardware!

Reply

7 Belinda McCarthy October 25, 2011 at 9:19 am

Forgot to mention – yes, I have had a hard drive fail on me, and it was a brand new one. This was before I ran two hard drives. Baaaad mistake, the data was unrecoverable. Getting a decent backup solution is absolutely ESSENTIAL.

Reply

8 Stephen October 25, 2011 at 11:30 am

Neil,
For your photos, do you back up JPGs or the RAW files? I don’t have a lot of bandwidth, so uploading gigabytes of RAW images to a cloud storage provider would take a long time.

The Super Duper recommendation is a good idea.

Reply

9 Corey Schwartz October 25, 2011 at 12:34 pm

What Neil has described is the most basic backup solution. You can do alot more to protect yourself from data loss, but, if you’re not doing the equivalent of what he’s described you could consider yourself a ticking time bomb.

A few weeks ago my desktop computer, with ALL my personal and business records for the last 26 years (no exaggeration, the records are all scanned, indexed and archived since the mid 1980’s), came down with a virus. This wasn’t your run of the mill virus. If we compared computer viri to human viri, you would have the common cold, herpes, polio, HIV. This was freaking mutated Ebola virus! Melt your blood vessels and you’re dead in 24 hours and everyone you know is dead the next day. I run virus protection, it’s updated every day. All my drives are backed up and critical information is occasionally burned to DVD.

I leave update checking on for most of my software. Windows, Adobe products and some others all check for and install updates daily. I got a standard looking adobe alert that acrobat updates had been downloaded and were ready to install. Kewl, clicked ok and all hell broke loose. Powered the machine down, but, it was already too late. The virus got into the system installer software, infected all the drives and prevented the computer from booting. My main work machine was effectively bricked.

After a little horsing around (3-4 hours) with trying to boot from CD and rescue disks, I gave up, disconnected all the drives and bought a new SSD and WD Caviar Black 2TB application/data drive. I installed the SSD, brought up Win7 64 bit (it was my last machine of 5 to be converted from vista 32 bit), installed virus protection and updated it. Installed the infected disk as a secondary drive and it instantly infected the new SSD. Crap. Reformatted the SSD, brought up the operating system, installed virus protection and updated it, again. This isn’t going to be easy.

Downloaded a free Linux utility disk called TRK ) and built a Linux boot disk with antivirus software loaded on it. Recovered my entire photography drive. Excellent. Now for the main drive. After 12 hours of running scans using multiple anti virus programs (each one works a little differently and finds different stuff), the drive was clean and ready to transfer to the new SSD/Data drive. Shut the computer down, disconnected the drive, picked it up and dropped it because it was burning hot after 12 hours of intensive running. Plugged it in and nothing. Powered it off and cried.

There’s a company in Novato California called DriveSavers (www.drivesaversdatarecovery.com) that specializes in drive recovery. They can get data off even severely damaged drives and CF cards. Prices run $700-3,000. They pay for FX shipping to their facility, analyze the drive, tell you what they can recover (everything in many cases), give you an estimate and if you don’t go forward they FX it back to you free of charge. No cost or obligation whatsoever to find out what’s recoverable and what it will cost.

Unfortunately, my backup system (external USB drives & Norton Ghost) isn’t playing nicely with the new 64bit windows 7 system. Older (just a couple of years) firmware on the drives and older versions of Ghost aren’t compatible with windows 7. I later figured out that the backup drive had some kind of hardware failure and was unusable.

This is the first time since I’ve started using computers (think TRS-80) that I’ve had my ass kicked by a virus. I’ve thought about using a cloud solution for backup, but, don’t see how it’s practical for recovering anything but an accidental deleted directory. Moving 500G between two SATA drives can take several hours. Moving a few TB of data over an Ethernet connection doesn’t make sense, does it?

In the end, DriveSavers recovered a portion of the lost system drive. I am still missing several thousand important documents.

Here’s a fascinating TED presentation on Internet viruses:
http://www.ted.com/talks/mikko_hypponen_fighting_viruses_defending_the_net.html

Reply

10 Sheldon October 25, 2011 at 1:06 pm

This is a great solution for backing up your “computer”, but in reality it’s only about protecting yourself from the work of having to reinstall your operating system and programs, a small inconvenience.

The two bigger questions are:
How do you back up your entire library of photography (life’s work)?
How do you protect yourself in the short term from hard drive failure?

For the first issue, I use large multi TB external drives stored off site in a safe place. If my house burns down or the computer is stolen, I haven’t lost my library of RAW files. I’ll update those drives every couple of months.

For the second issue, I use a multiple drive setup in my computer. Whenever images are downloaded from a card to the computer, they go onto two different hard drives before the card is reformatted. This way, if a hard drive crashes I don’t lose the photo shoot from last weekend.

Reply

11 Vlad October 25, 2011 at 2:34 pm

For those who have PCs I can recommend this software for creating bootable images:
http://www.terabyteunlimited.com/index.htm

I use “Image for Linux” version, but it creates images of windows partitions as well:
http://www.terabyteunlimited.com/image-for-linux.htm

Reply

12 Vincent Kember October 25, 2011 at 3:18 pm

And then there’s this: http://iosafe.com/products-soloG3-overview
Fireproof, Waterproof, Lockable, and comes with insurance for data recovery.

Reply

13 Paul Bohman October 25, 2011 at 7:58 pm

Thanks for posting this. Even though you (Niel) didn’t mention Carbonite, thanks to Toby, I’ve now found exactly what I’ve been looking for! I will still use an on-site-backup system also, but Carbonite appears to be the magic bullet for, well, pretty much everything.

Reply

14 photomatte October 25, 2011 at 8:39 pm

I back up all my images onto external hard drives, DVDs, and I put them online as well. None of my Macs has ever had a hard drive crash (or freeze up, or get a virus, etc), but I still like to back things up, just in case. My most anxious time occurs when I have weddings on back to back days: I download and backup all the files but don’t have time to get them online before having to format the CF cards and be ready for the next day. Scary

Reply

15 Bogdan October 25, 2011 at 10:17 pm

I know this is all about backups and such but can I say I really like the shot at the beginning? :)
Another nod to SuperDuper and for off site backup Crash Plan.

Reply

16 Andy October 26, 2011 at 2:52 am

Neil,
One important point you forgot to mention was to check your backup system actually works. There’s no point going to all the trouble if when the day comes you either don’t know how to recover your system/files or it just doesn’t work. Windows comes with system backup and restore functions built-in.

Reply

17 fotografii aniversari October 26, 2011 at 6:12 am

I remember Neil did mention Carbonite in a previous post, but long time ago.
Thank you, Vlad, I’ll try that one.

Reply

18 Lance October 26, 2011 at 12:54 pm

I’ve been using Carbonite since I lost a HDD with all my sister’s wedding photos, and several friends’ engagement photos on it, along with many personal favorites from random walk-a-bout shoots.

I was also using Windows 7’s built in functionality to schedule a robocopy script that created a clone of my data to an external Western Digital NAS for a while, until the cheap NAS died. (I don’t recommend those, by the way. No active cooling, the thing overheated severely.) I sent it back to newegg for a refund and have just been using Carbonite since then.

Sometime I’ll get another HDD and start using the robocopy script again just for a little redundancy, but for now Carbonite works like a charm.

Reply

19 Lance October 26, 2011 at 12:55 pm

I forgot to mention, all the data is on a completely separate physical HDD from the OS disk, thus if the OS disk dies all I need is a new HDD and an OS / software re-install. My Lightroom libraries and RAW files are all on the data storage HDD, and the Carbonite backup is… wherever Carbonite’s servers are, I suppose.

Reply

20 Mary-Claire October 26, 2011 at 4:46 pm

A couple of years ago, my PC starting having “issues.” Inconvenient at first, getting worse as time went on. So we backed up everything on an external hard drive, double checked on another computer to make sure all my files were there. Then we wiped out the PC and reinstalled factory settings.

Imagine my dismay when I discoved the power to the BACK UP drive failed. Non repairable, according to the computer nerds. No way to retrieve my data. Years worth of photos, spreadsheets, receipts, etc. gone.

We now use Carbonite. Thanks, Neil, for putting the word out there for those of us who don’t learn until it’s too late.

Reply

21 Marcel October 27, 2011 at 10:15 pm

The storage limits and costs of Dropbox made me look elewhere.

myPc Backup.com looks interesting to me as it supports multiple PC’s and File versions.
http://www.mypcbackup.com/plans-and-pricing

Reply

22 Marcel October 27, 2011 at 11:05 pm

Here is another website which compare online backup providers:

” What Do Our Online Backup Reviews Include?

In short, our online backup service reviews everything YOU want to know – and need to know – to decide what service will meet your needs at the best price. ”

http://onlinebackupspot.com/reviews/

Reply

23 Ruben October 28, 2011 at 5:21 pm

I’m using BackBlaze as an online back-up service, only $5 a month for unlimited space!
I use dropbox as well, but only for (temporary) cross-computer documents, not really as a back-up… :)

Super Duper looks like a good option, I’ll look into that!
I have to buy a new hard drive anyway because my Time Machine complains the disc is full…

Reply

24 Martin October 28, 2011 at 5:49 pm

The PC equivalent of Super-Duper is Acronis TrueImage. If you have a Windows PC just buy it. I am not affiliated to them, just a very satisfied customer.

As for Carbonite, it doesn’t work well past 200Gb, they restrict the upload speed once you have that much data.

Reply

25 Kim Angelo October 29, 2011 at 10:43 pm

OK already, that’s my next step:) Thanks Neil, your the best!!

Reply

Leave a Comment

Previous post:

Next post: