High-speed file transfer: Difference between revisions
From Iskomunidad
mNo edit summary |
|||
| (7 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
=GridFTP= | =GridFTP= | ||
GridFTP is an extension of the standard File Transfer Protocol for high-speed, reliable, and secure data transfer. | GridFTP is an extension of the standard File Transfer Protocol for high-speed, reliable, and secure data transfer. | ||
<br> | <br /> | ||
<br /> | |||
Special thanks to [http://pregi.net PREGINET] and [http://cc.upd.edu.ph UPCC] for the test servers and special lines. | |||
{| align="right" | |||
| __TOC__ | |||
|} | |||
<br /> | |||
<br /> | |||
==Different Implementations== | ==Different Implementations== | ||
* [https://wiki.birncommunity.org/display/BIRNDOC/GridFTP+Install+Guide installation guide @ BIRN] | * [https://wiki.birncommunity.org/display/BIRNDOC/GridFTP+Install+Guide installation guide @ BIRN] | ||
| Line 8: | Line 15: | ||
* [http://www.globus.org/toolkit/docs/latest-stable/gridftp/ GridFTP @ Globus]. See also [https://www.globusonline.org/media/publications/The_Resource_Providers_Guide_to_Globus_Online/gridftp.html guide] | * [http://www.globus.org/toolkit/docs/latest-stable/gridftp/ GridFTP @ Globus]. See also [https://www.globusonline.org/media/publications/The_Resource_Providers_Guide_to_Globus_Online/gridftp.html guide] | ||
* [http://cac.engin.umich.edu/resources/loginnodes/globus.html Globus GridFTP @ Umich] | * [http://cac.engin.umich.edu/resources/loginnodes/globus.html Globus GridFTP @ Umich] | ||
<br /> | <br /><br /> | ||
==Globus Implementation== | ===Globus Implementation=== | ||
*'''Platform: CentOS 6 x86_64''' | *'''Platform: CentOS 6 x86_64''' | ||
*GridFTP Server | *GridFTP Server | ||
| Line 17: | Line 24: | ||
<br> | <br> | ||
==Screenshots== | ====Screenshots==== | ||
[[Image:Gridftp_sample.png|500px]] | [[Image:Gridftp_sample.png|500px]] | ||
<br> | <br> | ||
<br> | <br> | ||
Using 950MB file, we compare the transfer rate of both services. | ====GridFTP vs standard FTP==== | ||
Using 950MB file and 100Mbps network cards, we compare the transfer rate of both services. | |||
<br> | <br> | ||
In standard FTP, it took about 15mins to transfer the file completely. | In standard FTP, it took about 15mins to transfer the file completely. | ||
| Line 40: | Line 46: | ||
<br> | <br> | ||
==CERN Implementation== | ==CERN Implementation== | ||
<br> | |||
==Issues== | ==Issues== | ||
*Platform: Ubuntu 13 | *Platform: Ubuntu 13 | ||
| Line 47: | Line 53: | ||
Issues:<br> | Issues:<br> | ||
1. pacman-3.26-r1 is not supported by ubuntu 13<br> | 1. pacman-3.26-r1 is not supported by ubuntu 13<br> | ||
*'''Stand-alone Gridftp @ OSG''' <br> | *'''Stand-alone Gridftp @ OSG''' <br> | ||
| Line 60: | Line 65: | ||
==ToDo== | ==ToDo== | ||
* GUI wrapper | |||
<br> | <br> | ||
Latest revision as of 16:26, 14 February 2014
GridFTP
GridFTP is an extension of the standard File Transfer Protocol for high-speed, reliable, and secure data transfer.
Special thanks to PREGINET and UPCC for the test servers and special lines.
Different Implementations
- installation guide @ BIRN
- Stand-alone Grid FTP @ OSG
- Setting up Gridftp server @ CERN
- GridFTP @ Globus. See also guide
- Globus GridFTP @ Umich
Globus Implementation
- Platform: CentOS 6 x86_64
- GridFTP Server
- GridFTP Client
- GridFTP Modules
Screenshots
GridFTP vs standard FTP
Using 950MB file and 100Mbps network cards, we compare the transfer rate of both services.
In standard FTP, it took about 15mins to transfer the file completely.
While in GridFTP, it took only 1 minute and 30 seconds.
OSG Implementation
CERN Implementation
Issues
- Platform: Ubuntu 13
- Installation guide @ Birn
Issues:
1. pacman-3.26-r1 is not supported by ubuntu 13
- Stand-alone Gridftp @ OSG
Issues:
1. osg-gridftp package is only supported by rhel-5/6 platform
- Gridftp @ CERN
Issues:
1. Only supported by RPMs (rhel platforms)
- All installation of gridftps are only supported by rhel platforms. There is no available for ubuntu.
ToDo
- GUI wrapper
Caution
See Also