Unoffical empeg BBS

Quick Links: Empeg FAQ | RioCar.Org | Hijack | BigDisk Builder | jEmplode | emphatic
Repairs: Repairs

Topic Options
#316691 - 26/11/2008 03:56 odd network performance
DWallach
carpal tunnel

Registered: 30/04/2000
Posts: 3810
Last night, I copied a large stack of files from my work machine to my home machine via a single, batch scp. Both machines, Mac Minis, were otherwise idle. My home DSL is ostensibly 6Mb. Each file is a 10-13MB DNG raw file.

So the question is where the following odd performance numbers come from:

Quote:
bandwidth / wall-clock time
57.0KB/s 03:48
73.3KB/s 02:59
66.5KB/s 03:16
67.4KB/s 03:13
68.3KB/s 03:07
65.2KB/s 03:16
74.1KB/s 02:55
74.2KB/s 02:55
79.1KB/s 02:44
70.8KB/s 02:49
74.3KB/s 02:41
98.8KB/s 02:01
102.3KB/s 02:01
92.3KB/s 02:14
109.9KB/s 01:53
117.5KB/s 01:36
135.4KB/s 01:28
173.7KB/s 01:09
149.9KB/s 01:24
156.2KB/s 01:22
144.6KB/s 01:27
163.6KB/s 01:11
168.8KB/s 01:09
211.4KB/s 00:55
176.3KB/s 01:06
222.7KB/s 00:55
292.0KB/s 00:40
318.9KB/s 00:36
338.5KB/s 00:36
370.8KB/s 00:33
267.7KB/s 00:48
305.9KB/s 00:42
267.3KB/s 00:48
317.8KB/s 00:39
365.2KB/s 00:34
358.7KB/s 00:36
324.9KB/s 00:39
364.5KB/s 00:27
406.4KB/s 00:22
407.9KB/s 00:22
431.5KB/s 00:21
428.2KB/s 00:21
450.9KB/s 00:20
454.8KB/s 00:20
473.3KB/s 00:19
471.4KB/s 00:19
629.2KB/s 00:20
591.5KB/s 00:21
613.3KB/s 00:20
632.9KB/s 00:19
609.7KB/s 00:22
609.0KB/s 00:22
605.5KB/s 00:22
616.8KB/s 00:22
618.1KB/s 00:22
617.9KB/s 00:22
619.4KB/s 00:22
615.5KB/s 00:20
593.5KB/s 00:21
621.9KB/s 00:20
621.2KB/s 00:20
613.9KB/s 00:20
614.7KB/s 00:19
608.5KB/s 00:20
629.0KB/s 00:19
619.9KB/s 00:20
626.7KB/s 00:20
606.1KB/s 00:21
623.9KB/s 00:17
614.5KB/s 00:17
622.0KB/s 00:17
591.9KB/s 00:17
621.3KB/s 00:16
625.9KB/s 00:16
562.3KB/s 00:18
636.9KB/s 00:16
633.1KB/s 00:16

The initial batch of files were being transmitted a factor of ten slower than the later files with what looks like a gradual ramp-up in performance. Any ideas?

Top
#316692 - 26/11/2008 04:24 Re: odd network performance [Re: DWallach]
matthew_k
pooh-bah

Registered: 12/02/2002
Posts: 2298
Loc: Berkeley, California
Well, the batch SCP probably means it used one TCP connection, which was in linear growth mode the whole time. Something probably knocked it down out of the exponential ramp up by dropping a packet early on.

We could speculate as to if this was intentional on your ISPs part or just a random coincidence.

Is the behavior reproducible?

Top
#316695 - 26/11/2008 05:17 Re: odd network performance [Re: DWallach]
wfaulk
carpal tunnel

Registered: 25/12/2000
Posts: 16706
Loc: Raleigh, NC US
TCP usually implements a variety of congestion control and avoidance algorithms that are transparent to the TCP protocol itself. That is, using them doesn't require any collaboration from the remote end. Many of these implement a ramping feature. While your numbers seem to ramp fairly slowly based on my familiarity with those algorithms, I'd be surprised if they weren't the culprits.
_________________________
Bitt Faulk

Top
#316725 - 27/11/2008 03:05 Re: odd network performance [Re: wfaulk]
DWallach
carpal tunnel

Registered: 30/04/2000
Posts: 3810
Matthew's hypothesis is probably as good as anything. My only other hypothesis was that maybe TimeMachine backups on the source computer could well have been running and gumming up the works. Still it does seem a bit odd when you know the sending machine has the bandwidth, you know the local pipe is empty, and you know you're getting 10% of peak.

Top