High-speed file transfer: Difference between revisions

From Iskomunidad
mNo edit summary
 
(5 intermediate revisions by 3 users not shown)
Line 1: Line 1:
=GridFTP=
=GridFTP=
GridFTP is an extension of the standard File Transfer Protocol for high-speed, reliable, and secure data transfer.  
GridFTP is an extension of the standard File Transfer Protocol for high-speed, reliable, and secure data transfer.  
<br>
<br />
<br />
Special thanks to [http://pregi.net PREGINET] and [http://cc.upd.edu.ph UPCC] for the test servers and special lines.
{| align="right"
  | __TOC__
  |}
<br />
<br />
==Different Implementations==
==Different Implementations==
* [https://wiki.birncommunity.org/display/BIRNDOC/GridFTP+Install+Guide installation guide @ BIRN]
* [https://wiki.birncommunity.org/display/BIRNDOC/GridFTP+Install+Guide installation guide @ BIRN]
Line 8: Line 15:
* [http://www.globus.org/toolkit/docs/latest-stable/gridftp/ GridFTP @ Globus]. See also [https://www.globusonline.org/media/publications/The_Resource_Providers_Guide_to_Globus_Online/gridftp.html guide]
* [http://www.globus.org/toolkit/docs/latest-stable/gridftp/ GridFTP @ Globus]. See also [https://www.globusonline.org/media/publications/The_Resource_Providers_Guide_to_Globus_Online/gridftp.html guide]
* [http://cac.engin.umich.edu/resources/loginnodes/globus.html Globus GridFTP @ Umich]
* [http://cac.engin.umich.edu/resources/loginnodes/globus.html Globus GridFTP @ Umich]
<br>
<br /><br />


==Globus Implementation==
===Globus Implementation===
*'''Platform: CentOS 6 x86_64'''
*'''Platform: CentOS 6 x86_64'''
*GridFTP Server
*GridFTP Server
Line 17: Line 24:
<br>
<br>


==Screenshots==
====Screenshots====


[[Image:Gridftp_sample.png|500px]]
[[Image:Gridftp_sample.png|500px]]
<br>
<br>
<br>
<br>
==GridFTP vs standard FTP==
====GridFTP vs standard FTP====
Using 950MB file, we compare the transfer rate of both services.
Using 950MB file and 100Mbps network cards, we compare the transfer rate of both services.
<br>
<br>
In standard FTP, it took about 15mins to transfer the file completely.
In standard FTP, it took about 15mins to transfer the file completely.
Line 39: Line 46:
<br>
<br>
==CERN Implementation==
==CERN Implementation==
<br><br>
<br>
==Issues==
==Issues==
*Platform: Ubuntu 13
*Platform: Ubuntu 13
Line 46: Line 53:
Issues:<br>
Issues:<br>
1. pacman-3.26-r1 is not supported by ubuntu 13<br>
1. pacman-3.26-r1 is not supported by ubuntu 13<br>


*'''Stand-alone Gridftp @ OSG''' <br>
*'''Stand-alone Gridftp @ OSG''' <br>
Line 59: Line 65:


==ToDo==
==ToDo==
* GUI wrapper
<br>
<br>



Latest revision as of 08:26, 14 February 2014

GridFTP

GridFTP is an extension of the standard File Transfer Protocol for high-speed, reliable, and secure data transfer.

Special thanks to PREGINET and UPCC for the test servers and special lines.



Different Implementations



Globus Implementation

  • Platform: CentOS 6 x86_64
  • GridFTP Server
  • GridFTP Client
  • GridFTP Modules


Screenshots



GridFTP vs standard FTP

Using 950MB file and 100Mbps network cards, we compare the transfer rate of both services.
In standard FTP, it took about 15mins to transfer the file completely.


While in GridFTP, it took only 1 minute and 30 seconds.


OSG Implementation


CERN Implementation


Issues

  • Platform: Ubuntu 13
  • Installation guide @ Birn

Issues:
1. pacman-3.26-r1 is not supported by ubuntu 13

  • Stand-alone Gridftp @ OSG

Issues:
1. osg-gridftp package is only supported by rhel-5/6 platform

  • Gridftp @ CERN

Issues:
1. Only supported by RPMs (rhel platforms)

  • All installation of gridftps are only supported by rhel platforms. There is no available for ubuntu.


ToDo

  • GUI wrapper


Caution



See Also