Improving Data Mobility & Management for International Climate Science

Use Internet2 SiteID

Already have an Internet2 SiteID?
Sign in here.

Internet2 SiteID

A Comparative Analysis of Protocols Used to Distribute Data Between Archive Centers of the Earth Observing System (EOS

Time 07/15/14 04:00PM-04:20PM

Room GC402

Session Abstract

NASA recently conducted a study of various file transfer protocols being considered for use between globally distributed Earth Science archival facilities. In the past, common, ubiquitous protocols such as FTP, HTTP, and SCP have been sufficient for meeting data distribution performance requirements over the globally distributed Earth Observing System Data and Information System (EOSDIS). However, developments in the capabilities of scientific instruments aboard next generation spacecraft are capable of generating data in greater volume than in the past, resulting in increases in data transfer rate requirements that the classic file transfer protocols can't satisfy due to TCP congestion avoidance behavior in WAN environments.

A suite of candidate file transfer protocols were compared across a range of file sizes and emulated network conditions to determine which protocols performed best in each environment. Other factors including encryption ciphers, parallel stream counts and system load were also analyzed. The observations made in the laboratory were validated against observations made over the Internet. The results of the study will be used by EOS data distribution system designers to employ file transfer protocols that will meet their data distribution requirements based on their operational network environment.


Speaker George Uhl NASA Goddard Space Flight Center

Presentation Media