Data Transfer

From oldwiki.scinet.utoronto.ca
Revision as of 22:33, 8 February 2010 by Ljdursi (talk | contribs) (Created page with 'hpn-ssh [http://www.psc.edu/networking/projects/hpn-ssh/ High-Performance-enabled ssh] scp scp -oNoneSwitch=yes -oNoneEnabled=yes rsync -av -e ssh 45-tangle2/*0025.bin ljdursi...')
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

hpn-ssh High-Performance-enabled ssh

scp

scp -oNoneSwitch=yes -oNoneEnabled=yes

rsync -av -e ssh 45-tangle2/*0025.bin ljdursi@nuexport00.cita.utoronto.ca:/mnt/raid-cita/ljdursi/athDrape/45-tangle2

If the files compress well, compressing first, or transmitting with compression on (scp -C, rsync -z) can significantly enhance effective data transfer rates

with hpn-ssh rsync -av: ~70MB/s scp: ~50MB/s

without: about half that.

Numbers << less than that: could be a number of things.

 - network connection between scinet and your machine
 - how busy is the server
 - how busy is the disk