User Tag List

Thanks useful information Thanks useful information:  9
Results 1 to 16 of 16

Thread: Back it up !!!!!!!

  1. #1
    Ausphotography Veteran
    Join Date
    31 Jul 2010
    Location
    Perth Northern Suburbs
    Posts
    3,724
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Back it up !!!!!!!

    After my previous post of a bloody USB cord causing me so much grief, and heart trouble (Tell me it's all not lost)

    I'd love to hear what you recommend as the best/safest/most recommended back up procedure around, and why you use it?

    With so many Op platforms out there, could you please state Op platform, system requirements, I.E Win7-8-9, Mac 6-7-8, Firefox, Google, and so on.

    It's no use rating a Mac compatable system for us Windows users, and vis versa.

    My limited knowledge of Op Sys out there is on dispaly, I used to have a program that would burn cd's/dvd's, but is that the way ahead, degradation of information and so forth.

    Love to hear/read what you have to say on the matter.

    Site Sponsors could plug here I spose (Rick?????)

    Cheers,,,,,,
    They call me "Blue" it's a red head thing.
    "My Flickr Site"
    Canon Bodies - 1DMk2N + 50D - Lenses - 17-35mm F2.8 L - 24-70mm F2.8 L - 70-200mm F2.8 L - 300mm F4 IS L - Sigma 18-50mm F2.8 - Sigma 10-20mm - DJI Mavic Pro Platinum
    " I Never get tired of looking at our diverse country, even if its through the lens of someone else".
    CC is always appreciated.


  2. #2
    A royal pain in the bum! arthurking83's Avatar
    Join Date
    04 Jun 2006
    Location
    the worst house, in the best street
    Posts
    8,777
    Mentioned
    4 Post(s)
    Tagged
    0 Thread(s)
    Having an offsite backup plan is ideal, but not always workable.

    That is, what invariably happens, unless you have a very solid and unwavering level of sticking to a routine. You may find yourself thinking that .. Oh! I can let it slide this time, and then again, doing the offsite turn around or update and bang! before you know it, that million dollar image that you had on the backup that you didn't copy to the offsite backup was the one that got lost in the melee.

    So, with that not counting an offsite backup routine, I reckon having two external drives as your backup destinations as a 99% failsafe solution. The important thing to keep in mind is to never let the drives fill up.. always below about 80-90%(lower is better!).
    As the drive fills, it slows down for starters and as I've found, probably more prone to errors.

    I have tons of drives(for a non tech type person.. ie. just a simple plain home user), and my only two drive error issues(not failures!! just issues) were on two fairly full drives.
    My problems were that in addition to keeping other backup files, I used to place them on the external drives too.
    File types such as home video capture @ 11G a pop for a single raw hour of footage, which I can't bring myself to delete

    So I deleted it all as I found my first 1Tb drive simply wasn't enough, as I had a couple of hundred Gigs of 'other files'.
    But then I had to put the other files somewhere(else).

    in the end I got me a new 2Tb drive for all the files and then it fileld to just over 1Tb of photos, and close to 1.5T of files alltogether!

    Not good! so I got another 2Tb drive, deleted all the other files again and never added them to my saved photo drives ever again.

    Now I have 2x 2Tb drives for photos only! all the other files(that is any file that is not photo related) is placed on the original 1Tb drive that started to cause me trouble.

    Scanned and fixed that drive and now running smoothly again.

    One thing I hated about external drives(and no names in particular, but I have access to two different brands) is their inane backup software.
    The software works ok for those that don't know what a backup should be, but the software is generally more of an annoyance.

    RichCopy4!!
    for home users, I doubt anything better exists.

    Some folks like to do backups at the time of downloading the images to the PC(from camera) but I find this to be an incorrect manner of doing it.
    It seems to make sense, and I've offered this advice to other folks on a personal level too, but to make a backup of an entire directory before you edit the images inthat directory is nto relaly a backup of the images on the other(edited) directory.
    You need to update the mirrored folder every time you make a backup anyhow.

    Did I say Richcopy4!!

    this program has enough ease of use to allow even the least knowledgeable person a fighting chance to making backups.

    Set it copy a folder, folder within a folder, or whatever you like.

    once setup, you open it and click the 'play' button and it does it's business.
    The beauty of configuring the software is that you kind of tune it to run at the fastest backup speed possible(which is usually limited to the speed of your PC).
    You can set it to copy as many files as possible at any one time, or as few as possible. It gives you a visual indicator of how quickly your speeds are(but never an estimated time of completion)
    it only ever copies a file if the file on the destination is older(by default), or you can change this option if you want(but is not advisable).
    So it;s not stuck there asking you if you want to over write the older file with a newer file.
    That is, an edited file with an unedited file.
    I work with raw files, so the older unedited raw file is of no use to me. Your image editing software will determine if the raw file has been 'edited' or not so this aspect is going to vary from user to user anyhow.

    RichCopy4 is free. It's a modern user hacked and improved version of the MS RoboCopy, which is an advanced type of copy and paste routine.

    If you want to try it, it's downloadable from a website with the name Spotlight Utility Hoffman or something similar.
    The program install folder may be called Spolight/Hoffman of whatever and the actual Start menu link is under the name Microsoft Rich Tools.

    Set it to copy an entire folder/drive of content to another and that's it.
    It'll just churn away without using up 'any resources' compared to some other software I've used .. even the good ol copy/paste routine.

    hard drives still remain responsive and there is barely a blip in the CPU usage, so you just let it copy an entire 2tb of junk in the background as you solider on.

    if there is an interruption to the power in a drive or any other potentially data destroying situation like this, it has erroir checking and data integrity checking.

    Never lost a single kilobyte of data in the Terabytes of data I've transferred, almost always using RichCopy.
    For simple few hundred megs of any data(not just photos), I just use copy/paste, but when I'm transferring hundred of gigs of data, RichCopy is always the program of choice.

    As for what media type. My experience is that I've lost zero files on hard drives in the past few years, whereas I've lost close to every old CD/DVD based file I've ever had.
    I can explain to you that every DVD I've ever backed up for the kids to watch, has been destroyed or degraded to the point where it's no longer a DVD of entertainment .. unless you like playing quoits with them.

    hard drives are the cheapest solution anyhow.
    Nikon D800E, D300, D70s
    {Nikon}; -> 50/1.2 : 500/8 : 105/2.8VR Micro : 180/2.8 ais : 105mm f/1.8 ais : 24mm/2 ais
    {Sigma}; ->10-20/4-5.6 : 50/1.4 : 12-24/4.5-5.6II : 150-600mm|S
    {Tamron}; -> 17-50/2.8 : 28-75/2.8 : 70-200/2.8 : 300/2.8 SP MF : 24-70/2.8VC

    {Yongnuo}; -> YN35/2N : YN50/1.8N


  3. #3
    Member Roo's Avatar
    Join Date
    08 Feb 2011
    Location
    Melbourne
    Posts
    49
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I use external HDD's and I have 2 on board dedicated back up drives. So I back up to the on boards regularly and then over to the externals every couple of weeks.

  4. #4
    Account Closed
    Join Date
    04 Mar 2010
    Location
    Townsville
    Posts
    889
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    The most important part of a good back up plan is to have a copy off site.

  5. #5
    Member CapnBloodbeard's Avatar
    Join Date
    24 Apr 2008
    Location
    Melbourne
    Posts
    334
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Unfortunately it looks like a fairly big chunk of my images have recently become corrupt. Mostly sports images, but I've lost some good work, sadly.

    My fault for not backing up really. Still not happy about it.

    Just thought I'd mention it as a 'for Pete's sake, back it up!!' post.

    Not just your photos either, but don't forget to back up the Lightroom Catalogue file!!

    Also, if off-site backup isn't an option, then I'd consider storing the backup in the car (out of sight, of course). If the worst happens and your house burns down or somebody breaks in and steals everything, then your car is most likely still going to be safe.

    Just don't leave your backup plugged into the power point, otherwise you're asking for a power spike to take out everything.

  6. #6
    Member
    Join Date
    17 May 2010
    Location
    Perth
    Posts
    1,756
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Backup to HDD and then backup to DVD (I store the DVDs at work).
    I'm not as vigilant as I should be though...particualrly with the DVDs......
    Shirl
    Gear - 7D, Canon 100mm macro f2.8L, Sigma 10-20, Sigma 24-70 f2.8, nifty fifty, tripod, hitech filters, lowepro versapack and a long wishlist!
    http://www.shirleymilburn.com/
    https://www.facebook.com/ShirleyMilburnPhotography


  7. #7
    Member CapnBloodbeard's Avatar
    Join Date
    24 Apr 2008
    Location
    Melbourne
    Posts
    334
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    How big is your photo library? Surely it'd be a lot faster and cheaper just to back up to another external HDD?

  8. #8
    Account Closed
    Join Date
    16 May 2010
    Location
    Melbourne
    Posts
    1,712
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    In my case, 2 x Windows Media Centre Pc's, 2 desktops Pc's (multiple OS) and 1 laptop (Vista) are backed up to a machine running WHS (Windows Home Server).

    All partitions with pictured, documents and music are also backed up to the server.

    You can easily use an older Pc to build your own WHS. The software is extremely cheap and is very easy to use. It comes with a graphical UI. Back ups can be set to run automatically. Besided that my WHS is set to back up all pics etc... to a second drive in case something happens to the first drive.

    All import family pics and videos are also backed up to an external drive and kept outside my house (we have a seperate bungalow now owned by our cat).
    Last edited by Meumerke; 21-10-2011 at 12:38pm.

  9. #9
    Ausphotography Regular Brian500au's Avatar
    Join Date
    03 May 2010
    Location
    Melbourne
    Posts
    1,547
    Mentioned
    4 Post(s)
    Tagged
    0 Thread(s)
    I am just wondering now with internet back space becoming so cheap it might be worth buying 100gb and using something like dropbox to automatically backup all your photos. I am going to look into this myself.

    At the moment I use a couple of external hard disks to back up - always keeping one in a fireproof safe, but I suffer the same as everybody else in not changing over the disks as often as I should.
    www.kjbphotography.com.au

    1DxII, EOS R, 200-400 f4L Ext, 100-400 f4.5-5.6L II, 70-200 F4IS, 24-70 F2.8 II, 16-35 F4IS


  10. #10
    Member martz8's Avatar
    Join Date
    15 Jan 2007
    Location
    South Morang
    Posts
    133
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    At this stage 2 external HDD for me but with my music also this is fast filling up.
    Do you like ...... Stuff?

    www.youtube.com/martzgq

  11. #11
    Ausphotography Veteran
    Join Date
    08 Nov 2009
    Location
    Sydney
    Posts
    3,303
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    My Approach to Backups

    I take backing up quite seriously, and I have adopted an approach that provides disk-based and geographical redundancy.

    My PC is a Apple MacBook Pro (17") with a 500GB hard disk. All of my image (and other) data is stored on it. In my home office I keep two LaCie d2 Quadra 1TB external hard disks, which have a FireWire 800 port offering faster data transfer rates.

    I keep a third external hard disk off-site to ensure geographical redundancy in case my local external disks suffer loss, theft or damage. My off-site disk is a 500GB Western Digital My Passport Essential, and I use Apple Time Machine to back up my entire system to this disk on a weekly basis.

    (A Mac can be restored from scratch from a Time Machine backup -- handy when your disk crashes, or when you upgrade the capacity of the disk in your existing Mac.)

    My approach is to manually back up my data to my local drives, generally every week or two. This method might sound cumbersome, but it works for me, and I employ a very structured filing system.

    The end result is that I have four copies of all of my data, some of which goes back 17 years. (The current value of that 17-year-old data is questionable, but I am sentimental.)

    In the past I used CD media, and later DVD media, but as my volume of data increased, and as image file sizes and the byte count of individual photoshoots also increased, optical media quickly became cumbersome and insufficient, and that was when I invested in external hard disks.

    The other issue is that I don't trust optical media. Sure, hard disks can fail, too, but the key is not to rely on one disk. Hard disks are much more convenient to use, a lot faster, and they store a lot more data.

    To conclude, my key advice on data backups is:

    1. back up regularly (weekly or fortnightly is good);
    2. back up to multiple storage devices, never relying on one alone;
    3. keep your data in at least two geographically separate locations; and
    4. use the most effective and reliable storage media of the day, and update when needed.
    Last edited by Xenedis; 21-10-2011 at 9:02pm.

  12. #12
    Member Roo's Avatar
    Join Date
    08 Feb 2011
    Location
    Melbourne
    Posts
    49
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by Art Vandelay View Post
    The most important part of a good back up plan is to have a copy off site.
    this is spot on advice but how many people actually do this would be pretty low imho. I know my circle of friends as a straw pole don't even myself I know I should but don't, it's just not practical I guess.

  13. #13
    Member
    Join Date
    16 Sep 2011
    Location
    Canberra
    Posts
    1,217
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I use SyncExp to keep the directory on my laptop and on my desktop identical. That way any new pics on either, get added to the other, and vice versa. At least that way two computers have to die at the same time to lose all my data. I then use an external harddrive to backup the My Pictures folder from the desktop, which gives me a third copy.
    None are ideal solutions, and in a fire if I fail to grab at least one of the portable items (laptop or External drive) then I still lose it all.
    I think a Blu-Ray burner might be a good solution. Throw the whole lot onto a couple of Blu Rays and keep them at your work/in your car/at a family member's house, and that way you have an off-site backup. I just haven't bought a blu-ray burner yet, and probably won't for a while. So for me I just have to hope the external harddrive is in easy reach in an emergency.
    Last edited by Ezookiel; 22-10-2011 at 1:23am.
    Canon EOS 60D ..... EFS 18-200mm f/3.5 - 5.6 IS - 430 EXII Speedlite - "eBay special" Remote Control Unit - Manfrotto 190XPROB w 804RC2 head.

  14. #14
    Member CapnBloodbeard's Avatar
    Join Date
    24 Apr 2008
    Location
    Melbourne
    Posts
    334
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by Brian500au View Post
    I am just wondering now with internet back space becoming so cheap it might be worth buying 100gb and using something like dropbox to automatically backup all your photos. I am going to look into this myself.

    At the moment I use a couple of external hard disks to back up - always keeping one in a fireproof safe, but I suffer the same as everybody else in not changing over the disks as often as I should.
    I've never understood the benefit of uploading to the cloud (aside from being able to access your files anywhere in the world) - uploading is damn slow, and a lot of ISPs meter uploads as well.

  15. #15
    Ausphotography Regular Brian500au's Avatar
    Join Date
    03 May 2010
    Location
    Melbourne
    Posts
    1,547
    Mentioned
    4 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by CapnBloodbeard View Post
    I've never understood the benefit of uploading to the cloud (aside from being able to access your files anywhere in the world) - uploading is damn slow, and a lot of ISPs meter uploads as well.
    You only have to upload the bulk of your photos once - and from there it is a matter of incremental back ups. If you set it up a folder to back up daily then you never have to worry about doing weekly backups and keeping storage offsite. Speed should not be a concern as most backup is done in the background anyway.

    A lot of ISP's now allow offpeak data increase so I still think it could be a viable option. I have a feeling this cloud thing is just the start of something big.

    More and more companies are moving their own backups to offshore servers.
    Last edited by Brian500au; 22-10-2011 at 6:15pm.

  16. #16
    dieselpower
    Guest
    I work in IT and deal with backups all day every day, and I know that my current approach isn't good. To date it hasn't really bothered me but the quality of my image library is steadily improving and I need to update it. I'll list my current plan and my ideal approach. I'd like to point out too that budget constraints can unfortunately dictate what happens with backups - for my mind the best backup is the best you can afford.

    What I think:
    - Get something that is relatively easy (otherwise you're likely to let it slip every now and then)
    - Get the best solution you can afford
    - Stick to a routine, set reminders if necessary!
    - Test the backups regularly to ensure the data is consistent and can be resotored.
    - Don't just back up your images, back up the operating system and software as well!

    My current approach (which is about to be retired as it's not adequate)
    - Mirrored internal drives as primary data store
    - Backup important shoots (eg. paid clients) to DVD before editing (so originals are retained) and another DVD with copies of the edited RAW files and jpegs once complete
    - Weekly backup to 1TB hard disk, taken offsite the morning after it completes (this is done using the 'backup and restore' software included in Windows 7, stored offsite in my wife's locker at work)

    My intended approach
    - Internal drives to remain as primary data store (ample storage)
    - Backup to DVD original RAW files once transferred, and edited RAW files and jpegs once complete, for important shoots
    - Backup to DVD the 'regular' photos I take (do this once a month)
    - Relatively cheap, but large, NAS device (Eg. Seagate 2TB BlackArmor)
    - Use Windows Backup software to back up the entire computer to the NAS on a daily basis
    - At least two rotating USB hard drives, stored offsite, updated on alternate weeks (eg. Drive 1 this week, drive 2 next week, then repeat). Unsure on software I'll use to complete this but may write a custom script. Drives to have the same capacity as the NAS
    - Test offsite and in house backups monthly by restoring data.

    Regarding offsite/cloud/internet backups - most broadband connections in Australia don't have the throughput to do this efficiently. An initial backup for me of my photos only (around 250GB), assuming my ADSL2+ connection was able to upload at full speed for the entire time, would take 3.5 weeks. Depending on changes, all work done in a day may not be able to replicate before the next day backup starts. Also note, that ADSL connections are asynchronous - if you upload constantly at full speed, your download speed will suffer. My current recommendation with this sort of backup is it's not worth it, unless you have a 10Mbps or greater upstream to the backup service - which, lets face it, virtually no home users will have.

    If you want to work out how long it will take for you to backup to an offsite location, head to this page: http://www.calctool.org/CALC/prof/co.../transfer_time and enter in the amount of data you have, and what your upstream speed is (you should be able to get this information from your router). It will give you the best case scenario transfer time based on no outside influence (such as ISP throttling, exchange/RIM congestion, TCP overheads, pausing the upload etc).
    Last edited by dieselpower; 23-10-2011 at 9:42am.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •