Enable rsh or other way for fast file transfer
in [Solaris]
|
Prev: MPxIO and stmsboot
Next: Scrambled display
From: Colin B. on 6 Nov 2009 11:58 Dave <foo(a)coo.com> wrote: > I have two Sun workstations which I want to copy a lot of data between - one Sun > is quite old, the other is new. > > 1) Sun Blade 2000, 2 x 1200 MHz SPARC > 2) Sun Ultra 27. Quad core 3.33 GHz Xeon. > > I've stuck a Gigabit Ethernet card in the Blade 2000, so these have a gigabit > connection between them. > > Transferring a 1000 MB file via ssh is taking 49 seconds (20 MB/s), compared to > the 11 seconds (91 MB/s) I can achieve with ftp. It's clear the Blade is > limiting the transfer speed, due to the speed of its CPU. > > What are my options for a faster transfer between these two machines? I want to > do a recursive copy, so normal ftp is not convenient. > > I can't seem to work out how to enable rcp to work. Can anyone tell me how? > Perhaps I can find an ftp client which can work recursively. > > Security is not an issue - these is between two machines on a home LAN. > > Any other suggestions? ncftp will do recursive FTP, if I'm not mistaken (and is a really great ftp client in general). Look up HPN-SSH - High performance networking additions to the SSH source code. Amongst other things, it allows you to use "none" as a cipher with SSH, and also can multithread a connection, using both of your CPUs. As a bonus, it makes SSH much MUCH faster over high latency connections. (Not your case between two local machines, but very useful in general.) Colin
From: Canuck57 on 7 Nov 2009 10:25 Dave wrote: > I have two Sun workstations which I want to copy a lot of data between - > one Sun is quite old, the other is new. > > 1) Sun Blade 2000, 2 x 1200 MHz SPARC > 2) Sun Ultra 27. Quad core 3.33 GHz Xeon. > > I've stuck a Gigabit Ethernet card in the Blade 2000, so these have a > gigabit connection between them. > > Transferring a 1000 MB file via ssh is taking 49 seconds (20 MB/s), > compared to the 11 seconds (91 MB/s) I can achieve with ftp. It's clear > the Blade is limiting the transfer speed, due to the speed of its CPU. > > What are my options for a faster transfer between these two machines? I > want to do a recursive copy, so normal ftp is not convenient. > > I can't seem to work out how to enable rcp to work. Can anyone tell me > how? Perhaps I can find an ftp client which can work recursively. > > Security is not an issue - these is between two machines on a home LAN. > > Any other suggestions? ssh/scp will always be slower than ftp because of the encryption and compression. But try "scp -C ..." as it might help. Second, while the old system may have a GB card in it, it may not be able to feed the card at wire speed. Slower CPU and I/O bus, slower disks etc. Not much you can do about that. If your network is secure, try NFS and copy he files out of the mount.
From: Sami Ketola on 8 Nov 2009 02:14 Dave <foo(a)coo.com> wrote: > Transferring a 1000 MB file via ssh is taking 49 seconds (20 MB/s), compared to > the 11 seconds (91 MB/s) I can achieve with ftp. It's clear the Blade is > limiting the transfer speed, due to the speed of its CPU. I doubt it. Since even if you disable encryption completely on the ssh connection (yes it can be done if you really want to) you will find out that even then copying files with scp is much slower than plain ftp. > What are my options for a faster transfer between these two machines? I want to > do a recursive copy, so normal ftp is not convenient. nfs? tar? rsync over nfs? Sami --
From: Michael Tosch on 10 Nov 2009 19:25
Dave wrote: > I have two Sun workstations which I want to copy a lot of data between - > one Sun is quite old, the other is new. > > 1) Sun Blade 2000, 2 x 1200 MHz SPARC > 2) Sun Ultra 27. Quad core 3.33 GHz Xeon. > > I've stuck a Gigabit Ethernet card in the Blade 2000, so these have a > gigabit connection between them. > > Transferring a 1000 MB file via ssh is taking 49 seconds (20 MB/s), > compared to the 11 seconds (91 MB/s) I can achieve with ftp. It's clear > the Blade is limiting the transfer speed, due to the speed of its CPU. > > What are my options for a faster transfer between these two machines? I > want to do a recursive copy, so normal ftp is not convenient. > > I can't seem to work out how to enable rcp to work. Can anyone tell me > how? Perhaps I can find an ftp client which can work recursively. > > Security is not an issue - these is between two machines on a home LAN. > > Any other suggestions? > > Dave GNU Midnight Commander connects to the remote host with ftp, presents it like a file system, and let you do a recursive copy in either direction. However it is interactive, and uses the F-Function keys. rcp uses rsh. In Solaris 10 you enable rsh service by command inetadm -e svc:/network/shell:default And you invite the calling host in ~root/.rhosts The syntax is +host root The invited host must be an exact string match, i.e. as shown after an ssh-login by the command who am i In case the rsh is much slower than ftp, you should enable NFS server on the one host, and have an NFS v3 mount on the other host. -- echo imhcea\.lophc.tcs.hmo | sed 's2\(....\)\(.\{5\}\)2\2\122;s1\(.\)\(.\)1\2\11g;1s;\.;::;2' |