Unoffical empeg BBS

Quick Links: Empeg FAQ | RioCar.Org | Hijack | BigDisk Builder | jEmplode | emphatic
Repairs: Repairs

Page 1 of 2 1 2 >
Topic Options
#249035 - 12/02/2005 17:29 Mp3TOFID and Rsync Woes
kendrick
member

Registered: 09/12/2003
Posts: 150
Does anyone have a good guide on how to use rsync and mp3tofid the one on the mp3tofid isn't very complete.

I followed the instructions there and i get this error when i try to run rsync on my empeg

+ ./rsync --times --delete --verbose --recursive --copy-unsafe-links --exclude=config.ini --exclude=lost+found 192.168.0.180::empegfids/drive0 /
receiving file list ... rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(229)

Any ideas?

On my Music server i created the file /etc/rsyncd.conf

inside of that i put

[empegfids]
path = /mnt/empegfids
read only = yes
hosts allow = 192.168.0.178
use chroot = no

Then i ran rsync --daemon


I transferred the file rsync-2.5.5-vfdhack-1.tar.gz to my empeg
and then unzipped it onto my empeg.

On my empeg i go into the rsync-2.5.5-vfdhack-1 directory where the rsync file resides and i run the command
+ ./rsync -auv --delete --dry-run rsync://192.168.0.180/empegfids .
receiving file list ...

And it just stops there.

Also when i run the command
./rsync --times --delete --verbose --recursive --copy-unsafe-links --exclude=config.ini --exclude=lost+found 192.168.0.180::empegfids/drive0 /

It does the same thing.
Any ideas?


Edited by kendrick (12/02/2005 18:05)

Top
#249036 - 12/02/2005 17:49 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
tfabris
carpal tunnel

Registered: 20/12/1999
Posts: 31594
Loc: Seattle, WA
Is that error copied-and-pasted, or did you re-type it by hand?

The IP address of the player is faulty in that error message, it's missing a period (I'm guessing it should be 1.80 instead of 180). Maybe that's the problem?
_________________________
Tony Fabris

Top
#249037 - 12/02/2005 17:58 Re: Mp3TOFID and Rsync Woes [Re: tfabris]
kendrick
member

Registered: 09/12/2003
Posts: 150
Sup I did it again with teh correct ip 192.168.0.180

Same thing still happens.

Top
#249038 - 13/02/2005 06:22 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
kendrick
member

Registered: 09/12/2003
Posts: 150
Hrmm Mp3TOFID and Rsync only seem to work for me if i first connect to the empeg via the hyperterminal with the serial cable connected.

After i do that, then i can connect through the microsoft telnet program without the serial cable connected and run the rsync.

Is that normal?

The only difference I can think of is that in Hypterminal i send the Q command to enter into developer mode.

Anyway you can enter into developer mode from the Microsoft Terminal Window?


Edited by kendrick (13/02/2005 07:06)

Top
#249039 - 13/02/2005 16:28 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
kendrick
member

Registered: 09/12/2003
Posts: 150
Any ideas?
No one uses rsync and MP3toFID here?

I guess my main question at this point is there anyway to go into Development mode from Microsoft Telnet Program because that seems to be the only way i can get Rsync and Mp3toFID to work.


Edited by kendrick (13/02/2005 16:31)

Top
#249040 - 13/02/2005 17:09 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
mlord
carpal tunnel

Registered: 29/08/2000
Posts: 14491
Loc: Canada
Perhaps it's simply the old networking bug. The empeg hardware/firmware have a problem with some networking setups, whereby they fail DHCP and fail to send packets out initially after each reboot. I usually just ping the player until it comes to life, and then everything else works until the next reboot. All of my various empeg scripts I use here now do that as a matter of course.

cheers

Top
#249041 - 13/02/2005 22:46 Re: Mp3TOFID and Rsync Woes [Re: mlord]
kendrick
member

Registered: 09/12/2003
Posts: 150
Ok, if i ping the player before the rsync command then it works.

However the next problem im having is. I do my initial mp3tofid and that takes about 45 minutes. Then i added a song to the directory and did the mp3tofid command again and it still takes the same amount of time?

I thought mp3tofid was supposed to run in less than a minute or somethin?


Edited by kendrick (13/02/2005 23:24)

Top
#249042 - 14/02/2005 01:35 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
mlord
carpal tunnel

Registered: 29/08/2000
Posts: 14491
Loc: Canada
Dunno.. I've never used that s/w here. But the first thing to try would be to ensure that the date, time, and timezone on the player match that on the PC that's being used for the rsync. Shouldn't matter, but..

Top
#249043 - 14/02/2005 10:35 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Quote:
I thought mp3tofid was supposed to run in less than a minute or somethin?


Yes, it should only rescan what is changed since the last run.

Are you using Linux, some other *ix, or cygwin?
On what kind of filesystem are your tunes stored?

Pim

Top
#249044 - 14/02/2005 10:42 Re: Mp3TOFID and Rsync Woes [Re: mlord]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Quote:
Shouldn't matter, but..


Yes, it helps, but it doesn't matter. rsync will handle that.

But kendricks problem is not rsync inefficiency, but mp3tofid
inefficiency. It shouldn't scan all tunes every run, it should
rely on previously generated fids, if the corresponding tune
has not changed.

There are a couple of checks like mtime, size, inode number
and major/minor numbers of the filesystem that contains the
tunes.

Pim

Top
#249045 - 14/02/2005 13:26 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
My Tunes are stored on NTFS file system on a windows machine.
The tunes are mounted to my linux box over the network.
Then I am using my linux box to perform the mp3tofid


Edited by kendrick (14/02/2005 13:27)

Top
#249046 - 14/02/2005 15:23 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Quote:
My Tunes are stored on NTFS file system on a windows machine.
The tunes are mounted to my linux box over the network.


I'm afraid that's the problem. mp3tofid uses a fid number allocation
strategy based on the tune's inode number. The idea is that the inode
number of a tune does not change when you rename or move it,
or edit it. This is important, as you do not want the fid numbers of
your tunes to change, otherwise rsync will be copying the files
over and over.

Unfortunately, inode numbers are an alien concept in NTFS.
cygwin knows how to emulate inode numbers in a consistent,
persistent way, but smbfs does not.

You can check this for yourself. Do "ls -li mytune.mp3".
Unmount the filesystem, remount it and repeat the ls command.
You'll see different inode numbers.

Your best bet is to turn things round. Store your tunes on your
linux box and use samba to share them to your windows clients.
This is what I do.

Pim

Top
#249047 - 14/02/2005 15:35 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
Alright, i'll put my music on a linux filesystem

What rsync command do you use by the way, so that FIDS dont have to get deleted and replaced everytime?

Also is there anyway to make a script so that my empeg is being pinged while the rsync command is running thats the only way my box seems to do it without the serial cable hooked up?

Top
#249048 - 14/02/2005 16:04 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Quote:

What rsync command do you use by the way, so that FIDS dont have to get deleted and replaced everytime?


Moving your tunes to the linux box will cause yet another full rsync transfer,
unless you're in for some hacking. But after that, fid numbers will remain
persistent and rsync will be efficient.

For full transfers, it will be much faster to just delete the current fids
on the player, as having rsync compare them all will slow things down
seriously.

Quote:

Also is there anyway to make a script so that my empeg is being pinged while the rsync command is running thats the only way my box seems to do it without the serial cable hooked up?


I use telnetd without having to ping. I do use "ifconfig lo up" in my rsync script
on the player. Maybe this helps too.

Pim

Top
#249049 - 14/02/2005 17:39 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
rsync \
$@ \
--times \
--delete \
--verbose \
--recursive \
--copy-unsafe-links \
--exclude=config.ini \
--exclude=lost+found \
${rsyncserver}::${modulename}/drive0 /


Hey, PIM this is the rsync command that I am currnetly using?
Is this similar to the one you use? If not could you post or attach the script you use?

Top
#249050 - 14/02/2005 20:03 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
I had to change my script to use one rsync run per drive. otherwise
my player would crash, even when using swap. Now that have had
a memory upgrade, it isn't necessary anymore, but I left it the way it
is. It's probably a tad faster as well.

Code:
 
#!/bin/sh

rsyncserver=192.168.101.1
modulename=empegfids

set -x
killall -INT player

# only remount if drives are mounted read-only
if grep -q "/dev/hd.4.* ro " /proc/mounts
then
remount=true
else
remount=false
fi

sleep 5
test $remount = true && sh -x rwm
ifconfig lo 127.0.0.1 up
for i in 0 1
do
rsync \
$@ \
--times \
--stats \
--delete \
--verbose \
--progress \
--recursive \
--empeg-progress \
--copy-unsafe-links \
--block-size=100000 \
--exclude=rsync \
${rsyncserver}::${modulename}/drive${i} /
done
test $remount = true && sh -x rom




killall is not included on the player. I got it from debian.
rsync itself is excluded in my script; that's because I sync
all my tools from empegfids::drive0/local/bin

Pim

Top
#249051 - 16/02/2005 05:16 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
PIM

when i do ifconfig lo 127.0.0.1 up
It says ifconfig command not found.

Also when i try do do ping
i get command not found


Edited by kendrick (16/02/2005 06:29)

Top
#249052 - 16/02/2005 07:06 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Right, my ping and ifconfig are also from debian, so it seems.
I'm having trouble finding the link to the debian tarball
I used, but I did find this on Roger's website.

Hope this helps.

Pim

Top
#249053 - 16/02/2005 07:08 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
Roger
carpal tunnel

Registered: 18/01/2000
Posts: 5683
Loc: London, UK
You want http://www.differentpla.net/~roger/empeg/car/files/base.tar.gz

Transfer it to your /drive0 folder, then, in the root:

# tar xvfz drive0/base.tar.gz

You'll need to create /etc/resolv.conf if you want name resolution to work.
_________________________
-- roger

Top
#249054 - 16/02/2005 07:10 Re: Mp3TOFID and Rsync Woes [Re: pim]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands

Top
#249055 - 16/02/2005 07:52 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
Cool, Thanks.
I'll include all of this in the instructions im trying to make also.

Hey PIM does that tarball you linked include the killall as well? All the extras needed to run your script?

Also I notieced your script has a {i} does that make it run the script for /drive0 then /drive1

Top
#249056 - 16/02/2005 13:23 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
kendrick
member

Registered: 09/12/2003
Posts: 150
Hrmm, I haven't tried the ifconfig part of yoru script yet.

But for some odd reason when i run my script via Microsoft Telnet it runs extremely slow, to the point where it'll eventually just stop.

However if i run the script through Hyperterminal with the Serial Port connected it runs extremely fast.

Top
#249057 - 16/02/2005 14:50 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
If you use hyperterminal, you know for sure the player process is stopped.
If you telnet, you don't. You need to make sure the player process is stopped.

Pim

Top
#249058 - 16/02/2005 17:27 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
Could I just install busybox to include all these commands that i need like ifconfig, killall, etc.

I have the busybox source, is there a special way you have to install it on the empeg or can I just do a regular ./configure, make , make install?


Edited by kendrick (16/02/2005 18:07)

Top
#249059 - 16/02/2005 21:23 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Quote:

Hey PIM does that tarball you linked include the killall as well? All the extras needed to run your script?


yes

Quote:

Also I notieced your script has a {i} does that make it run the script for /drive0 then /drive1


Yes, ${i} is a shell variable that will take values 0 and 1.

Pim

Top
#249060 - 16/02/2005 21:29 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Quote:
Could I just install busybox to include all these commands that i need like ifconfig, killall, etc.


I suppose so, but it's a lot easier to just copy what you need from the tarballs.

Quote:

I have the busybox source, is there a special way you have to install it on the empeg or can I just do a regular ./configure, make , make install?


You cannot develop on the player itself. You need to set up a crosscompiler.
Download the arm linux toolchain from the hijack site and prepare some
time for getting it to work.

Some configure scripts make wrong decisions when running in a crosscompiler
environment. I noticed that when building rsync.

Pim

Top
#249061 - 16/02/2005 21:34 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
I see, you know where I can find a killall tarball?

Top
#249062 - 16/02/2005 22:21 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
pim
addict

Registered: 14/11/2000
Posts: 474
Loc: The Hague, the Netherlands
Right, killall isn't in either tarball mantioned in this thread.
I probably downloaded it from debian directly.

For your convenience, here is my collection of arm tools.

Pim


Attachments
248960-empeg-tools.tar.gz (74 downloads)



Edited by pim (16/02/2005 22:23)

Top
#249063 - 16/02/2005 22:34 Re: Mp3TOFID and Rsync Woes [Re: pim]
kendrick
member

Registered: 09/12/2003
Posts: 150
Awesome, thats very nice of you I appreciate it.

Top
#249064 - 16/02/2005 23:07 Re: Mp3TOFID and Rsync Woes [Re: kendrick]
kendrick
member

Registered: 09/12/2003
Posts: 150
To use your set of tools, do i need to use teh ARM cross compiler or can i just extract the tar.gz that you attached to /bin or something?

Top
Page 1 of 2 1 2 >