IT Lab   About Frank   ·  About IT   ·  Ravenel Bridge  ·  Unbuilding Bridges  ·  Photo Essays   ·  Forgetting
September 24, 2008: http, https and scp tests from dumbo and port (.duke-nus.edu.sg)

The idea was to compare the download responses over ports 22, 80 and 443. The overall result was that http did not stall (5 attempts), while https and scp stalled > 50% of the time. Peak download rates ranged from 800 KB/s to 1.4 MB/s.

Testing within the NUS network. I downloaded from dumbo to garfield and frank, both behind the Duke-NUS firewall. All downloads succeeded. This suggests that the server is capable of downloading at >2 MB/s files to targets within the NUS network.

HTTPS downloads from dumbo.duke-nus.edu.sg

For https -  5 attempts,   3 stalls and 2 successes.  The average download rate was 800 KB/s   
Note that the stalls all occurred early during the transfer.
[cfs@queens ~]$ wget --no-check-certificate "https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:50:10--  https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.1'
1% [                              ] 524,288      663K/s          STALL

[cfs@queens ~]$ wget --no-check-certificate "https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:50:29--  https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.2'
0% [                              ] 425,984     1005K/s           STALL

cfs@queens ~]$ wget --no-check-certificate "https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:50:38--  https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.3'

100%[======================================>] 45,809,112   752K/s   in 59s   
2008-09-24 05:51:37 (754 KB/s) - `gms_downloadtest.pdf.3' saved [45809112/45809112]

[cfs@queens ~]$ wget --no-check-certificate "https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:51:54--  https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.4'

100%[======================================>] 45,809,112   809K/s   in 56s   
2008-09-24 05:52:50 (801 KB/s) - `gms_downloadtest.pdf.4' saved [45809112/45809112]

[cfs@queens ~]$ wget --no-check-certificate "https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:53:48--  https://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.5'

1% [                          ] 557,056      413K/s              (STALL)

HTTP downloads from dumbo.duke-nus.edu.sg

For http - 5 attempts 5 successes. Average download rate was 1.2 MB/s

[cfs@queens ~]$ wget "http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:54:18--  http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
Resolving dumbo.duke-nus.edu.sg... 137.132.155.240
Connecting to dumbo.duke-nus.edu.sg|137.132.155.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.6'

100%[======================================>] 45,809,112  1.16M/s   in 53s   
2008-09-24 05:55:11 (841 KB/s) - `gms_downloadtest.pdf.6' saved [45809112/45809112]

[cfs@queens ~]$ wget "http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:55:14--  http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
Resolving dumbo.duke-nus.edu.sg... 137.132.155.240
Connecting to dumbo.duke-nus.edu.sg|137.132.155.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.7'

100%[======================================>] 45,809,112  1.35M/s   in 32s   
2008-09-24 05:55:47 (1.34 MB/s) - `gms_downloadtest.pdf.7' saved [45809112/45809112]

[cfs@queens ~]$ wget "http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:55:49--  http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
Resolving dumbo.duke-nus.edu.sg... 137.132.155.240
Connecting to dumbo.duke-nus.edu.sg|137.132.155.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.8'

100%[======================================>] 45,809,112  1.37M/s   in 32s   
2008-09-24 05:56:21 (1.37 MB/s) - `gms_downloadtest.pdf.8' saved [45809112/45809112]

[cfs@queens ~]$ wget "http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:57:20--  http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
Resolving dumbo.duke-nus.edu.sg... 137.132.155.240
Connecting to dumbo.duke-nus.edu.sg|137.132.155.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.9'

100%[======================================>] 45,809,112  1.29M/s   in 34s   
2008-09-24 05:57:54 (1.30 MB/s) - `gms_downloadtest.pdf.9' saved [45809112/45809112]

[cfs@queens ~]$ wget "http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf"
--2008-09-24 05:58:36--  http://dumbo.duke-nus.edu.sg/gms_downloadtest.pdf
Resolving dumbo.duke-nus.edu.sg... 137.132.155.240
Connecting to dumbo.duke-nus.edu.sg|137.132.155.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 45809112 (44M) [application/pdf]
Saving to: `gms_downloadtest.pdf.10'

100%[======================================>] 45,809,112  1.40M/s   in 32s   
2008-09-24 05:59:08 (1.37 MB/s) - `gms_downloadtest.pdf.10' saved [45809112/45809112]

SCP downloads from dumbo.duke-nus.edu.sg

For scp - 5 attempts: 3 stalls and 2 successes. Average download rate 800KB/s. Note that the stalls all occur early during the transfer

2008-09-24 05:59:08

[cfs@queens ~]$ scp dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                100%   44MB 844.1KB/s 783.5KB/s   00:53   Max throughput:   1.2MB/s

[cfs@queens ~]$ scp dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  1%  496KB  35.6KB/s   0.0KB/s - stalled -

[cfs@queens ~]$ scp dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  1%  496KB  28.8KB/s   0.0KB/s - stalled -

[cfs@queens ~]$ scp dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                100%   44MB 813.4KB/s 143.5KB/s   00:55   Max throughput:   1.0MB/s

[cfs@queens ~]$ scp dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  1%  560KB  23.7KB/s   0.0KB/s - stalled - 

SCP downloads from port.duke-nus.edu.sg (inside Duke-NUS firewall)

Here are the results from my desktop system (port.duke-nus.edu.sg) to queens: 9 attempts, 6 stalls. Note all stalls occur early during the transfers. Ave xfer rate 800 KB/s with peak to 1.4 MB/s (probably maxes out my maxonline from Starhub

[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                100%   44MB 894.7KB/s 431.5KB/s   00:50   Max throughput:   1.4MB/s
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  1%  560KB  40.2KB/s   0.0KB/s - stalled -
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  2% 1264KB  39.1KB/s   0.0KB/s - stalled -
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  0%  144KB  24.0KB/s   0.0KB/s - stalled -
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                100%   44MB 994.1KB/s 431.5KB/s   00:45   Max throughput:   1.5MB/s

[cfs@queens ~]$ date
Wed Sep 24 06:22:55 SGT 2008

[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                100%   44MB 951.8KB/s 207.5KB/s   00:47   Max throughput:   1.5MB/s
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  1%  528KB  88.1KB/s   0.0KB/s - stalled -
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  1%  560KB  84.1KB/s   0.0KB/s - stalled -
[cfs@queens ~]$
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                  0%  272KB  76.8KB/s   0.0KB/s - stalled -
[cfs@queens ~]$ scp port.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                100%   44MB 813.4KB/s 975.5KB/s   00:55   Max throughput:   1.4MB/s 

These tests indicate that there are no stalls within the NUS network. Here from dumbo to port.duke-nus.edu.sg

SCP downloads from dumbo.duke-nus.edu.sg to port.duke-nus.edu.sg

Wed Sep 24 13:06:00 SGT 2008

[cfs@frank from_dumbo]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@frank from_dumbo]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.3MB/s   00:19    
[cfs@frank from_dumbo]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@frank from_dumbo]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@frank from_dumbo]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@frank from_dumbo]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.3MB/s   00:19  

SCP downloads from dumbo.duke-nus.edu.sg to garfield.duke-nus.edu.sg

[cfs@garfield ~]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@garfield ~]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@garfield ~]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@garfield ~]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.2MB/s   00:20    
[cfs@garfield ~]$ scp  dumbo.duke-nus.edu.sg:/home/cfs/gms_downloadtest.pdf .
gms_downloadtest.pdf                          100%   44MB   2.3MB/s   00:19