1 / 21

Globus FTP Evaluation test

Globus FTP Evaluation test. Catania – 10/04/2001 Antonio Forte – INFN Torino. Globus FTP. GlobusFTP is the Globus implementation of the GridFTP Protocol. The GridFTP protocol is a superset of a GSI-enabled FTP protocol. . Catania – 10/04/2001 Antonio Forte – INFN Torino.

ginger-olsen
Download Presentation

Globus FTP Evaluation test

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Globus FTPEvaluation test Catania – 10/04/2001 Antonio Forte – INFN Torino

  2. Globus FTP GlobusFTP is the Globus implementation of the GridFTP Protocol. The GridFTP protocol is a superset of a GSI-enabled FTP protocol.  Catania – 10/04/2001 Antonio Forte – INFN Torino

  3. Globus FTP Features • A high throughput, reliable, secure and robust data transfer mechanism • GSSAPI security (PKI and Kerberos) support • Automatic negotiation of TPC buffer/window sizes • Parallel data transfer • Third-party control of data transfer • Partial file transfer • Reliable data transfer • Replica catalogs mechanisms Catania – 10/04/2001 Antonio Forte – INFN Torino

  4. Globus FTP Implementation • Globus Data Grid Alpha Release 2: • aparticular version of Globus containing a set ofproductionlibraries and tools that allow the use of GridFTP protocol. • GSI WUFTP v0.4b5: • a modified version of the wu-ftpd server, enhanced with GridFTP's security plus the GridFTP partial file transfer and parallel transfer capabilities. • GSI NCFTP v0.3: • a modified version of the ncftp client tools,enhanced with GridFTP's GSI-based security. Catania – 10/04/2001 Antonio Forte – INFN Torino

  5. Test INFN sites and resources Catania – 10/04/2001 Antonio Forte – INFN Torino

  6. Test layout Catania – 10/04/2001 Antonio Forte – INFN Torino

  7. Tests • BASELINE MEASUREMENT • ROUND TRIP TIME (RTT) • Measurement of RTT with 500 icmp packets • THROUGHPUT WITH STANDARD FTP (GET and PUT) • Variable file size (1, 10, 50, 100, 500 MB) • TESTS WITH GSIFTP PROTOCOL (using globus-url-copy • command) • COMPARISON BETWEEN STANDARD GSI FTP AND • PARALLEL GSI FTP (GET and PUT) • streams (1, 2, 4, 8, 16, 32, 64), fixed file size (100MB) • streams (1, 2, 4, 8, 16, 32, 64), fixed file size (500MB) • fixed streams (8), variable file size (1, 10, 50, 100, 500 MB) Catania – 10/04/2001 Antonio Forte – INFN Torino

  8. Tests • EVALUATION OF GSIFTP PERFORMANCES VARING • TCP BUFFER SIZE(GET and PUT) • (Parameter: -tcp-bsbuffer-size) • fixed streams (1), variable TCP buffer size (4, 8, 16, 32, 64, 128, 256 KB) • fixed streams (8), variable TCP buffer size (4, 8, 16, 32, 64, 128, 256 KB) • EVALUATION OF GSIFTP PERFORMANCES VARING • BLOCK SIZE (GET and PUT) • (Parameter: -bs block size) • fixed streams (1), variable block size (4, 8, 16, 32, 64, 128, 256 KB) • fixed streams (8), variable block size (4, 8, 16, 32, 64, 128, 256 KB) Catania – 10/04/2001 Antonio Forte – INFN Torino

  9. COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT) Results • asymmetrical throughput in different directions • throughput increases for up to 16 streams and then keeps constant or, alternatively, decreases Catania – 10/04/2001 Antonio Forte – INFN Torino

  10. WAN Link statistics Results INFN Padova – Link 16 Mbps Saturation with 500 MB file size INFN Torino – Link 12 Mbps • the asymmetrical throughput depends on the different data path Catania – 10/04/2001 Antonio Forte – INFN Torino

  11. COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT) Results • asymmetrical throughput in different directions • throughput increases for up to 8 streams, then decreases Catania – 10/04/2001 Antonio Forte – INFN Torino

  12. COMPARISON BETWEEN STANDARD GSI FTP AND PARALLEL GSI FTP (GET and PUT) Results • no significative throughput for 1 MB file size • throughput slighty decreasesfor transfer of very large files (500 MB) Catania – 10/04/2001 Antonio Forte – INFN Torino

  13. EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE(GET and PUT) Results • Optimal TCP buffer size is 32 KB Catania – 10/04/2001 Antonio Forte – INFN Torino

  14. EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE(GET and PUT) Results • Optimal TCP buffer size is 32 KB • Similar results in symmetrical tests (TO-NA, NA-TO) Catania – 10/04/2001 Antonio Forte – INFN Torino

  15. EVALUATION OF GSIFTP PERFORMANCES VARING TCP BUFFER SIZE(GET and PUT) Results • No influence on the performance with 8 parallel streams Catania – 10/04/2001 Antonio Forte – INFN Torino

  16. EVALUATION OF GSIFTP PERFORMANCES VARING BLOCK SIZE (GET and PUT) Results • No influence on the performance (no CPU bottleneck) Catania – 10/04/2001 Antonio Forte – INFN Torino

  17. EVALUATION OF GSIFTP PERFORMANCES VARING BLOCK SIZE (GET and PUT) Results • No influence … Catania – 10/04/2001 Antonio Forte – INFN Torino

  18. Advantages • No further authentication required (only grid-proxy-init • needed) • Throughput increases with parallel streams • Third-party control of data transfer is possible • Partial and realible transfer works fine with GSI FTP • client (GSINCFTP) Catania – 10/04/2001 Antonio Forte – INFN Torino

  19. Troubles • No stable release (very frequently updated, we used the version downloaded on the 9th Jan 2001) • System crash with globus-url-copy, 64 streams and 500 MB of data • Network interface sometimes in down state after parallel transfers of large files (500 MB) which frequently freeze; problems encountered with 16 streams between CNAF and Padova, with 32 or 64 streams between Torino and Napoli. These problems probably depend on bugs in the Linux kernel (we used 2.2.12) • Production WAN links negatively influenced the tests: dedicated links need!!! Catania – 10/04/2001 Antonio Forte – INFN Torino

  20. Latest release Globus Data Grid Alpha Release 3 released on the 26th March 2001 (annunced by Lee Liming) not tested yet!!! Available at the following URL: http://www.globus.org/gsiftp-alpha/release-alpha3.html Catania – 10/04/2001 Antonio Forte – INFN Torino

  21. More info Available at the WorkPackage 5 (Network) -INFN GRID Projecthomepage: http://www.infn.it/netgrid Catania – 10/04/2001 Antonio Forte – INFN Torino

More Related