I need some help with improving our data transfer rate between two locations (Midwest to East-Coast).
our setup information:
1. we have a 1Gbit dedicated pipe between locations
2. our RTT = 23 milliseconds.
3. both servers (source, destination) = Sun x4600, Solaris10 Update 6 (x86)
4. we are using FTP to transfer data (fastest method?)
Till now, we tried:
1. 1GB file and 5GB files.
2. tweaked TCP parameters to:
First problem I see is the 5GB. Many methods are limited to 2GiB (Gi means 1024^3) or 4GiB. So you first have to find out if the method choosen allows transferring 5GB.
FTP uses two network connections. One of them for control (e.g. "PUT" command) and the other one only for data. On the data connection there is no byte stuffing or control bytes. This means: On a TCP network FTP is the fastest method for large files (for small files you'd had to think about the overhead in the control connection).
- If you use "your" network (not the public Internet) you may try to choose a network protocol that has less data overhead than TCP/IP. (Unfortunately I'm not an expert in this question.)
- Maybe data compression will also be an option to improve your performance. This will probably not work if your data is already compressed.