Unoffical empeg BBS

Quick Links: Empeg FAQ | RioCar.Org | Hijack | BigDisk Builder | jEmplode | emphatic
Repairs: Repairs

Page 1 of 2 1 2 >
Topic Options
#147106 - 05/03/2003 22:13 Better system for backing up/cloning Empegs.
fink08
journeyman

Registered: 15/02/2002
Posts: 79
There's got to be a better way to do this. Is it possible to create a standard script to install backup software and then have a standard script in the root with a few easy to change variables that can be run and have the backup just work? It would be could if something like this could be run thru hijack with 2 Empegs connected via a crossover.

What I am really saying is that there are many of us with multiple Empegs/Riocars, and the current backup process is tedious, complicated for most, potentially dangerous, and time consuming. Can someone genious programmer help out the community? In my opinion this is more important than any of the current programming projects in process.

Top
#147107 - 05/03/2003 23:52 Re: Better system for backing up/cloning Empegs. [Re: fink08]
tfabris
carpal tunnel

Registered: 20/12/1999
Posts: 31565
Loc: Seattle, WA
/me keeps an eye out for Doug...
_________________________
Tony Fabris

Top
#147108 - 06/03/2003 06:42 Re: Better system for backing up/cloning Empegs. [Re: tfabris]
pgrzelak
carpal tunnel

Registered: 15/08/2000
Posts: 4859
Loc: New Jersey, USA
Indeed! Any minute now...

Do you use rsync to perform your backups between the different players over the crossover? That is what I do.
_________________________
Paul Grzelak
200GB with 48MB RAM, Illuminated Buttons and Digital Outputs

Top
#147109 - 06/03/2003 13:23 Re: Better system for backing up/cloning Empegs. [Re: pgrzelak]
fink08
journeyman

Registered: 15/02/2002
Posts: 79
I use rsync, but not with crossovers. I'm not great with the linux CLI so i find it very challenging to do backups everytime i have trouble and it doesn't come out perfectly.

Top
#147110 - 06/03/2003 19:55 Re: Better system for backing up/cloning Empegs. [Re: tfabris]
tanstaafl.
carpal tunnel

Registered: 08/07/1999
Posts: 5539
Loc: Ajijic, Mexico
/me keeps an eye out for Doug...

Rather than repeat myself, just look

here
or
here
or
here
or
here
or
here
or
here
or
here
or
here

Hey, I just had an idea. Wouldn't it be nice if we had some sort of utility that could backup and restore our empegs with an exact mirror image? Even if the backup file were totally unusable other than to restore to the same empeg that created it?

I'd pay money for a utility like that...



tanstaafl. (Who is NOT turning blue holding his breath waiting for it to happen!

_________________________
"There Ain't No Such Thing As A Free Lunch"

Top
#147111 - 06/03/2003 20:27 Re: Better system for backing up/cloning Empegs. [Re: tanstaafl.]
fink08
journeyman

Registered: 15/02/2002
Posts: 79
Actually imaging the drive is kind of along the lines of what i was thinking. I'm more interested in backing up my rio than i am keeping it in sync with another. Thanks for stating my purposes more lucidly.

Top
#147112 - 06/03/2003 21:34 Re: Better system for backing up/cloning Empegs. [Re: fink08]
fink08
journeyman

Registered: 15/02/2002
Posts: 79
I tried using the Beta 13 clone wizard in Win2k but it can only find one empeg. Will it work right in Win98? Does it work well?

Edit: I tried in 98 and I have the same problem. Good news is that it doesn't work any worse in WinXP! Just as good.


Edited by fink08 (07/03/2003 01:31)

Top
#147113 - 06/03/2003 22:22 Re: Better system for backing up/cloning Empegs. [Re: tanstaafl.]
mlord
carpal tunnel

Registered: 29/08/2000
Posts: 14478
Loc: Canada
Hey, I just had an idea. Wouldn't it be nice if we had some sort of utility that could backup and restore our empegs with an exact mirror image? Even if the backup file were totally unusable other than to restore to the same empeg that created it?


Too easy.. just use FTP to grab /dev/hda and /dev/hdc from the player and save them under the system of your choice. I accept paypal

Of course, this is very slow.. and cannot handle incremental backups, but it does capture EVERYTHING.

Cheers

Top
#147114 - 07/03/2003 18:39 Re: Better system for backing up/cloning Empegs. [Re: mlord]
mcomb
pooh-bah

Registered: 31/08/1999
Posts: 1649
Loc: San Carlos, CA
Of course, this is very slow.. and cannot handle incremental backups, but it does capture EVERYTHING.


Install rsync and use it to sync the dev entry as Mark suggested. Slightly more complicated but much faster as it would just get the changes after the first sync and it would also capture every last bit. Honestly I think the real reason nobody has made the "holy grail backup utility" that some of you want is because there are at least a dozen different ways to accomplish backups with existing utilities if you are willing to put five minutes of effort into getting it setup.

-Mike
_________________________
EmpMenuX - ext3 filesystem - Empeg iTunes integration

Top
#147115 - 07/03/2003 20:59 Re: Better system for backing up/cloning Empegs. [Re: mcomb]
fink08
journeyman

Registered: 15/02/2002
Posts: 79
I have put plenty of time into trying to set it up, but everytime I try to use it i run into some kind of problem. There was a guide posted here a while ago, i followed it to the letter and it wound up syncing to the wrong directory even though i never told it to sync to the right directory. There are people who own empegs who are even less linux literate than me and there really is a need for a more simplified method to accomplish this process. Maybe a scripts that install and run rsync for you.

Top
#147116 - 10/03/2003 16:10 Re: Better system for backing up/cloning Empegs. [Re: mlord]
tanstaafl.
carpal tunnel

Registered: 08/07/1999
Posts: 5539
Loc: Ajijic, Mexico
Too easy.. just use FTP to grab /dev/hda and /dev/hdc from the player and save them under the system of your choice. I accept paypal

Of course, this is very slow.. and cannot handle incremental backups, but it does capture EVERYTHING.


Please excuse my ignorance abut things *nix. Or does that even enter into it?

Would I just set up an ethernet connection between my empeg and my PC, determine what IP address the empeg was using, and then at my PC do something like:

CD C:\
mkdir empegftp
cd empegftp
ftp
open <empeg IP address>
mget /dev/hd*

and then would the restore operation work pretty much the same way except use "mput" instead of "mget"?

You say "...this would be very slow..." How slow is that? I have about 15 GB on my player. Are we talking hours, here? Days? Weeks? Even if it took a couple of days, I wouldn't mind.

Am I on the right track here, or am I just displaying my indomitable ignorance?

tanstaafl.


_________________________
"There Ain't No Such Thing As A Free Lunch"

Top
#147117 - 10/03/2003 16:27 Re: Better system for backing up/cloning Empegs. [Re: fink08]
bodybag
addict

Registered: 07/03/2002
Posts: 504
Loc: Southern California
I haven't read this entire thread yet so if this is redundant, I'm sorry.

In regards to you trying to use the Empeg clone tool with beta 13 and xp, 200, '98 etc... it doesn't work. I have tried all the same stuff, you have to go back and put the 1.03 version on BOTH players for the Empeg clone to find them. The clone works flawlessly for me when using 1.03. When you're done you'll have to go back to whatever beta version you want. There is a previous thread I started regarding this issue, it won't help to look for it 'cause the solution is 1.03.



_________________________
Bodybag - So Cal
Not a Whiner any more!!!

Top
#147118 - 10/03/2003 16:27 Re: Better system for backing up/cloning Empegs. [Re: tanstaafl.]
mlord
carpal tunnel

Registered: 29/08/2000
Posts: 14478
Loc: Canada
Yeah, that's basically it.

Except don't mget /dev/hd* (it'll transfer everything twice!),
but rather: mget /dev/hda /dev/hdc

It will be slow, about 0.5Mbytes/sec up to maybe 0.7Mbytes/sec, and it will transfer the entire hard disk(s), not just the parts that actually have files on them.

So for a single 30GB drive, this will take around 60000 seconds, or 1000 minutes, or 16-17 hours, to complete. Each time.

Cheers


Edited by mlord (10/03/2003 16:27)

Top
#147119 - 10/03/2003 17:06 Re: Better system for backing up/cloning Empegs. [Re: mlord]
tanstaafl.
carpal tunnel

Registered: 08/07/1999
Posts: 5539
Loc: Ajijic, Mexico
Yeah, that's basically it.

Omigod! If it was always that easy, why didn't somebody bang me over the head and tell me?

No doubt there have been posts on the bbs about this in the past, but I only recently began exploring the mysteries of ftp, so those posts wouldn't have registered with me.

If I do this, will I really, truly, end up with a mirrored structure that I can just ftp back into my empeg with a new hard drive installed and there will be no way to tell that I changed out the drive?

[run] Heads for the computer shop to buy a network card for his PC [/run]

tanstaafl.
_________________________
"There Ain't No Such Thing As A Free Lunch"

Top
#147120 - 10/03/2003 17:10 Re: Better system for backing up/cloning Empegs. [Re: tanstaafl.]
mlord
carpal tunnel

Registered: 29/08/2000
Posts: 14478
Loc: Canada
But.. it only works for drives of identical capacities,
and most likely only for identical models as well.

-ml

Top
#147121 - 10/03/2003 18:25 Re: Better system for backing up/cloning Empegs. [Re: mlord]
tanstaafl.
carpal tunnel

Registered: 08/07/1999
Posts: 5539
Loc: Ajijic, Mexico
But.. it only works for drives of identical capacities,
and most likely only for identical models as well.


Oh.

Then I'm right back where I started, then...

I have an 18GB drive in my player that is dying.

I have a new 40 GB Travelstar ready to replace it.

In words of one syllable or less, what do I do?

tanstaafl.
_________________________
"There Ain't No Such Thing As A Free Lunch"

Top
#147122 - 10/03/2003 18:32 Re: Better system for backing up/cloning Empegs. [Re: tanstaafl.]
pgrzelak
carpal tunnel

Registered: 15/08/2000
Posts: 4859
Loc: New Jersey, USA
If FTP is okay, you might be able to use one of the GUI ftp programs like WS_FTP or FTP Voyager, drag and drop the root directory of the empeg onto your local hard drive.
_________________________
Paul Grzelak
200GB with 48MB RAM, Illuminated Buttons and Digital Outputs

Top
#147123 - 10/03/2003 20:28 Re: Better system for backing up/cloning Empegs. [Re: pgrzelak]
tanstaafl.
carpal tunnel

Registered: 08/07/1999
Posts: 5539
Loc: Ajijic, Mexico
If FTP is okay, you might be able to use one of the GUI ftp programs like WS_FTP or FTP Voyager, drag and drop the root directory of the empeg onto your local hard drive.

And that would give me what I want? A mirror copy including directory structure, database, metadata, etc. that could be copied transparently back into my empeg after a hard drive swap?

tanstaafl.
_________________________
"There Ain't No Such Thing As A Free Lunch"

Top
#147124 - 10/03/2003 20:42 Re: Better system for backing up/cloning Empegs. [Re: pgrzelak]
TheAmigo
enthusiast

Registered: 14/09/2000
Posts: 363
Using FTP to grab all the files doesn't strike me as a good idea... all symlinks will become normal files, /dev and /proc will be a mess.

How about tar or cpio? Mount both drives in the empeg and copy all the files:

cd /
tar cf - /dir1 /dir2 /dir3 | (cd /newdrive; tar xvf -)

My empeg's in the car right now and I don't recall all the directories in root that would need to be copied. Would be easier if tar had a -xdev option like find does, but AFAIK, it doesn't.
_________________________
--The Amigo

Top
#147125 - 11/03/2003 02:23 Re: Better system for backing up/cloning Empegs. [Re: tanstaafl.]
Roger
carpal tunnel

Registered: 18/01/2000
Posts: 5680
Loc: London, UK
In words of one syllable or less, what do I do?

Assuming that you can put both of the disks in the empeg at once:

1. Unplug the 18
2. Install the 40 (as master)
3. Run the disk builder (to format the 40). This is why the 18 is unplugged.
4. Install a player developer .upgrade file (to replace the builder)
5. Plug the 18 back in. You'll need to jumper it as slave at this point.
6. Open a shell prompt using Hyperterminal or similar.
7. Issue these commands:

# rw ; rwm

This will remount the disks read-write.

# cp -a /drive1 /drive0

This will copy your music and configuration from drive1 (the old 18) onto drive0 (the new 40). It'll take a while.

# dd if=/dev/hdc3 of=/dev/hda3

This will copy your dynamic data from the partition on drive1 to drive0.

# ro ; rom

This will remount the disks read-only

8. Unplug the 18

I'm not sure how well this plays if you've installed any other applications, but it'll work with a stock player. No need for hijack.
_________________________
-- roger

Top
#147126 - 11/03/2003 10:45 Re: Better system for backing up/cloning Empegs. [Re: Roger]
tfabris
carpal tunnel

Registered: 20/12/1999
Posts: 31565
Loc: Seattle, WA
I thought there was already an essentially-equivalent set of instructions like this as part of the drive upgrade guide? Or is this describing something different?
_________________________
Tony Fabris

Top
#147127 - 11/03/2003 10:52 Re: Better system for backing up/cloning Empegs. [Re: tfabris]
Chimaera
enthusiast

Registered: 10/09/2002
Posts: 285
Loc: DFW Area, Texas, US
Tony,

the FAQ just mentions copying the FIDS directory (songs and tags only), Rogers modified copy steps look like they should copy EVERYTHING.

Now if only we knew who the FAQ maintainer was so he could update the drive upgrade guide
_________________________
Mark. [blue]MKI, MKII & MKIIa, all Blue, and all Mine![/blue]

Top
#147128 - 11/03/2003 11:15 Re: Better system for backing up/cloning Empegs. [Re: Chimaera]
tfabris
carpal tunnel

Registered: 20/12/1999
Posts: 31565
Loc: Seattle, WA
Rogers modified copy steps look like they should copy EVERYTHING.
Generally, you don't want it to copy everything. You *want* Emplode to be forced to rebuild the database because what if you were playing musical-drives with different master/slave configurations (as I had to do in my recent drive upgrade) and different file sets ended up on the player than what you started with.

Although it might be proper to add an instruction to copy config.ini.
_________________________
Tony Fabris

Top
#147129 - 11/03/2003 11:23 Re: Better system for backing up/cloning Empegs. [Re: tfabris]
Chimaera
enthusiast

Registered: 10/09/2002
Posts: 285
Loc: DFW Area, Texas, US
Generally, you don't want it to copy everything. You *want* Emplode to be forced to rebuild the database because what if you were playing musical-drives with different master/slave configurations (as I had to do in my recent drive upgrade) and different file sets ended up on the player than what you started with.

Agreed, but there may be people who just want an exact mirror, and I would have thought updating the drive upgrade guide to also include the new info from Roger is the right to keep track of it?
_________________________
Mark. [blue]MKI, MKII & MKIIa, all Blue, and all Mine![/blue]

Top
#147130 - 11/03/2003 11:48 Re: Better system for backing up/cloning Empegs. [Re: Chimaera]
tfabris
carpal tunnel

Registered: 20/12/1999
Posts: 31565
Loc: Seattle, WA
Outside of the scope of the drive upgrade guide. I have added instructions for copying config.ini. This means that it currently has instructions for:

- Copying the songs and playlists from the old drive to the new drive, and making emplode rebiuild the database after this is done.
- Copying the dynamic data partition from the old drive to the new drive.
- Copying the configuration file from the old drive to the new drive.

I think that's an appropriate amount of coverage for the drive upgrade guide, and it covers essentially everything a drive upgrader needs, including what Doug needs to do to upgrade to his 40.
_________________________
Tony Fabris

Top
#147131 - 11/03/2003 13:22 Re: Better system for backing up/cloning Empegs. [Re: fink08]
Chuck
member

Registered: 06/06/2001
Posts: 183
I use the WS_FTP synchronization utility to sync the Empeg drive0 and drive1 directories to a PC. After the initial sync (which takes a while) only changes are copied on subsequent syncs, so it doesn't take long at all. When I want to sync my second empeg, I use to the same utility to sync, but reverse the sync rules (rules can be saved and reloaded). So I have copies in 3 places: Empeg1, Empeg2, and the PC.

I even wrote a mp3 player to load the Empeg database on the PC and play the FIDs, so I have all the playlists etc.

-Chuck

Top
#147132 - 11/03/2003 14:36 Re: Better system for backing up/cloning Empegs. [Re: Chuck]
bodybag
addict

Registered: 07/03/2002
Posts: 504
Loc: Southern California
Chuck,

Could you explain the steps you use to do this and what software is necessary? I have multiple Empegs (5) that I am attempting to keep sync'd by using Empeg Clone. My music database on the Empeg's is nearly 40gb, so using the Clone takes forever. Your way sounds fairly easy and quick (at least after the first sync). Thank you in advance for your time.
_________________________
Bodybag - So Cal
Not a Whiner any more!!!

Top
#147133 - 11/03/2003 20:48 Re: Better system for backing up/cloning Empegs. [Re: bodybag]
Chuck
member

Registered: 06/06/2001
Posts: 183
The only software you'll need is the Hijack kernal (for it's FTP server) and a FTP Sync utility. I use WS_FTP Pro personally and it comes with a sync utility. If you need any other help, feel free to ask away.

-Chuck

Top
#147134 - 12/03/2003 11:09 Re: Better system for backing up/cloning Empegs. [Re: tfabris]
tms13
old hand

Registered: 30/07/2001
Posts: 1115
Loc: Lochcarron and Edinburgh
Just chipping in to say thanks for the drive upgrade guide, all those who contributed to it(1).

I've just upgraded my secondary drive, copying all the files across, and it went like a dream. And since I used my spare player for the upgrade, no need to re-install Hijack etc.

Took about 2 hours to copy 10GB of music from drive to drive (these were both 4200rpm Travelstars if it matters).


(1) even to myself, as I have more confidence in something I wrote back when it didn't matter so urgently - for example, which direction we're doing the copy...
_________________________
Toby Speight
030103016 (80GB Mk2a, blue)
030102806 (0GB Mk2a, blue)

Top
#147135 - 14/03/2003 15:04 Re: Better system for backing up/cloning Empegs. [Re: Chuck]
bodybag
addict

Registered: 07/03/2002
Posts: 504
Loc: Southern California
Chuck,

Do you sync the drives separately or together when you sync with WS_FTP? What are your syncronization settings? I tried to sync today, and it will only let me do one drive at a time (ie: drive0 or drive1). I'm pretty carefull, but it seems like there's a bit of "room for error" doing individaul syncs on the drives, I'd like to do them as a pair or sync the entire player directory. Please let me know how you're going about it so I can get my routine down to a minimum. Thanks in advance for your help.
_________________________
Bodybag - So Cal
Not a Whiner any more!!!

Top
Page 1 of 2 1 2 >