Welcome to the Invelos forums. Please read the forum rules before posting.

Read access to our public forums is open to everyone. To post messages, a free registration is required.

If you have an Invelos account, sign in to post.

    Invelos Forums->DVD Profiler: Desktop Technical Support Page: 1 2 3  Previous   Next
How long does your database backup take?
Author Message
DVD Profiler Unlimited Registrantlasitter
Registered: May 30, 2008
Posts: 445
Posted:
PM this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
This will of course be determined by MANY factors, including the speed of your computer, the number of profiles in your database, and other complexities like how detailed / large your local profiles are, cover scans, etc.

My database contains profiles for all the titles I now own (3,087) plus all the titles I have owned in the past (1,439). There are plenty of people with larger collections, but this is a fair number of items for Profiler to be tracking for me. I don't know how many years of my life I've got in manipulating, tagging, documenting in notes, etc., but I'm pretty worried about the loss of data, and I back it up frequently.

I have a pretty robust server type system running Win7 Pro 64-bit on an eight core processor, with 32G of RAM, eight 2.2TB drives in a RAID60 with five hot spares all run off of an LSI Megaraid 9260-16i, including the fancy performance enhancing CacheCade Pro option using three SSD drives as additional cache to the 512MB on the controller itself.

I think the system is pretty fast at most anything it does.

Even so, my backups are taking just over four (4) minutes to complete.

I guess I'm happy about that, but would still like to hear from other people as to their experiences with backup speeds for their collections on their systems.
DVD Profiler Unlimited RegistrantStar Contributorbbbbb
on steroids
Registered: March 14, 2007
Posts: 5,734
Posted:
PM this userDirect link to this postReply with quote
Quoting lasitter:
Quote:
would still like to hear from other people as to their experiences with backup speeds for their collections on their systems.

Can't say, I select "Backup Database", and when I come back from working, socialising, cooking, running, relaxing, sleeping... the backup is complete.
Don't confuse while the film is playing with when the film is played. [Ken Cole, DVD Profiler Architect]
DVD Profiler Unlimited RegistrantStar ContributorMithi
Sushi Annihilator
Registered: March 13, 2007
Reputation: Superior Rating
Germany Posts: 2,217
Posted:
PM this userEmail this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
Quoting lasitter:
Quote:
I guess I'm happy about that, but would still like to hear from other people as to their experiences with backup speeds for their collections on their systems.

0:01:25 for a backup of all 1422 profiles without covers and cast&crewDB. This includes the time to start DVD Profiler because it is done by a batch-file so I don't have to rename the files.
Mithi's little XSLT tinkering - the power of XML --- DVD-Profiler Mini-Wiki
DVD Profiler Desktop and Mobile RegistrantStar ContributorDJ Doena
Registered: May 1, 2002
Registered: March 14, 2007
Reputation: Highest Rating
Germany Posts: 6,744
Posted:
PM this userEmail this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed.

I use Beyond Compare but any file comparison tool will do (e.g. WinMerge).
Karsten
DVD Collectors Online

DVD Profiler Unlimited Registrantlasitter
Registered: May 30, 2008
Posts: 445
Posted:
PM this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
Quoting DJ Doena:
Quote:
I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed.

So this is basically a file copy operation rather than the File -> Backup Database/
DVD Profiler Unlimited Registrantlasitter
Registered: May 30, 2008
Posts: 445
Posted:
PM this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
Quoting Mithi:
Quote:
0:01:25 for a backup of all 1422 profiles without covers and cast&crewDB.

So doing it your way (limited backup) I got it under 2:30 for 4,526. That makes a difference for sure.
DVD Profiler Desktop and Mobile RegistrantStar ContributorDJ Doena
Registered: May 1, 2002
Registered: March 14, 2007
Reputation: Highest Rating
Germany Posts: 6,744
Posted:
PM this userEmail this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
Quoting lasitter:
Quote:
Quoting DJ Doena:
Quote:
I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed.

So this is basically a file copy operation rather than the File -> Backup Database/


Yes, but it fulfills the same basic purpose. I have a backup of all my data on a different drive which I can restore if I made a major mistake or if my HDD crashed.
Karsten
DVD Collectors Online

DVD Profiler Unlimited RegistrantStaNDarD
Registered: March 31, 2007
Germany Posts: 662
Posted:
PM this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
Quoting DJ Doena:
Quote:
Quoting lasitter:
Quote:
Quoting DJ Doena:
Quote:
I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed.

So this is basically a file copy operation rather than the File -> Backup Database/


Yes, but it fulfills the same basic purpose. I have a backup of all my data on a different drive which I can restore if I made a major mistake or if my HDD crashed.

I do this in a similar way. I use Duplicati to do daily backups of my documents folder. Duplicati automatically creates a full backup once a month. All other backups are incremental. Two full backups are stored, older ones are removed.
DVD Profiler Unlimited RegistrantStar ContributorKatatonia
Retired Profiler
Registered: March 13, 2007
Reputation: Highest Rating
United States Posts: 20,111
Posted:
PM this userDirect link to this postReply with quote
Backing up everything, with coverscans, headshots, etc... usually only takes me a little under 5 minutes for 5,731 profiles.

3.8gb total size of backup file.
Corey
 Last edited: by Katatonia
DVD Profiler Desktop and Mobile RegistrantStar ContributorDJ Doena
Registered: May 1, 2002
Registered: March 14, 2007
Reputation: Highest Rating
Germany Posts: 6,744
Posted:
PM this userEmail this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
I just tried the regular way:

4429 profiles resulting in a 1.06 GB backup file

Source: built-in SSD drive
Target: built-in SATA drive

time elapsed: 3 minutes 20 seconds
Karsten
DVD Collectors Online

DVD Profiler Unlimited RegistrantStar ContributorMithi
Sushi Annihilator
Registered: March 13, 2007
Reputation: Superior Rating
Germany Posts: 2,217
Posted:
PM this userEmail this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
Quoting lasitter:
Quote:
Quoting Mithi:
Quote:
0:01:25 for a backup of all 1422 profiles without covers and cast&crewDB.

So doing it your way (limited backup) I got it under 2:30 for 4,526. That makes a difference for sure.

But be careful, the cast&crewDB-exclusion might bite you in the posterior if you use Cast & Crew pictures. If not this thing is quite irrelevant, c&c is of course present in the profiles itself.

For the covers I do make a manual backup every once in a long time, because as a phpDVDProfiler-User I have those covers online as a quasi-backup anyways.
Mithi's little XSLT tinkering - the power of XML --- DVD-Profiler Mini-Wiki
DVD Profiler Unlimited RegistrantStar ContributorAddicted2DVD
Registered: March 13, 2007
Reputation: Highest Rating
United States Posts: 17,334
Posted:
PM this userEmail this userView this user's DVD collectionDirect link to this postReply with quote
Thanks for the reminder... forgot to back up here recently.

Full back-up... 7,142 total profiles... 13 minutes.

Size of Back-up: 1.68gb
Pete
DVD Profiler Unlimited RegistrantStar Contributorsurfeur51
Since July 3, 2003
Registered: March 29, 2007
Reputation: Great Rating
France Posts: 4,479
Posted:
PM this userView this user's DVD collectionDirect link to this postReply with quote
I have a rather small collection of 1550 movies.

Backup takes about 3 minutes, and is 1.2 Gb. Most of size and time is taken by gallery images (15500) and headshots (~95% of crew and ~60% of cast have headshots). For covers I use rather small images (540x375) since I don't really care about what is on covers.
Images from movies
 Last edited: by surfeur51
DVD Profiler Unlimited RegistrantStar ContributorKulju
Registered: March 14, 2007
Finland Posts: 2,337
Posted:
PM this userView this user's DVD collectionDirect link to this postReply with quote
Quoting lasitter:
Quote:

I have a pretty robust server type system running Win7 Pro 64-bit on an eight core processor, with 32G of RAM, eight 2.2TB drives in a RAID60 with five hot spares all run off of an LSI Megaraid 9260-16i, including the fancy performance enhancing CacheCade Pro option using three SSD drives as additional cache to the 512MB on the controller itself.

Your backup time sounds to be quite normal, so no worries.

A bit off-topic, but out of professional curiosity, why such a RAID configuration? Why RAID60, and why 5 Spares!? You have 28,6TB of disc space and with that configuration you are only able to use 8,8TB for your actual data storage. Don't you think it's a bit overkill? You also have to remember that RAID60 write performance isn't the best possible compared to other RAID configurations. That can also effect your backup time. I understood that you have DVDP installed on this same computer and you are using same discs as a source and target for your backup. Since RAID isn't a backup of any kind, how do you backup that disc space? Do you have a tape library or another set of discs?
DVD Profiler Desktop and Mobile RegistrantStar ContributorVoltaire53
Missed again!
Registered: March 13, 2007
Reputation: High Rating
United Kingdom Posts: 2,293
Posted:
PM this userEmail this userVisit this user's homepageView this user's DVD collectionDirect link to this postReply with quote
You guys are so lucky having these nice fast machines... I have about 4,500 titles and I normally do backups without images to speed things up but tried a full back-up today just to see... so

WITHOUT cover scans: 8 minutes.
WITH cover scans: 23 minutes.

Which is why I, like bbbbb, set it going and then leave it!
It is dangerous to be right in matters where established men are wrong
DVD Profiler Unlimited RegistrantStar ContributorLithurge
Paralysis by analysis
Registered: March 13, 2007
Posts: 1,279
Posted:
PM this userView this user's DVD collectionDirect link to this postReply with quote
Similar size collection to Voltaires, no cast & crew pics, the full backup takes 3 mins 15 seconds if I do it directly to my external drive, or 1 min 30 seconds to my C (SSD) drive, plus 50 seconds to copy across to the external. File sizeis 1.05gb so guess the cast & crew pics take a lot of space for those that have them.
IVS Registered: January 2, 2002
 Last edited: by Lithurge
    Invelos Forums->DVD Profiler: Desktop Technical Support Page: 1 2 3  Previous   Next