NASA approach for Big Data access to support Climate Science
Time 07/15/14 01:30PM-01:50PM
Multiple science domains face increasing challenges in dealing both with the growth in volumes of data and in effectively harnessing extremely large computational resources. Climate Science investigations are now moving beyond the petabyte range; computational resources are similarly growing beyond PetaFLOPS scale. Large scale computing resources at NASA, such as the NASA Center for Climate Simulation (NCCS) at Goddard Space Flight Center and the NASA Advanced Supercomputing facility (NAS) at NASA Ames Research Center, strive to keep pace with the growth in these demands. Key challenges for these types of facilities include developing the ability to expand beyond the typical 10Gbps external gateways and providing IT Security mechanisms that don’t hinder the science community while addressing the requirements of Trusted Internet Connections (TIC).
This presentation will describe a potential multi-element approach to enhance access to large scale data and computational resources using a combination of existing and upcoming technologies. To better enable “friction free” data access, specific types of data flows can be transmitted along paths unencumbered by traditional inspection devices; while initially done statically, the designation of flow types is ultimately expected to be done dynamically, under software control . To enhance storage and data transfer performance, Data Transfer Nodes can be tuned for large Bandwidth Delay Product networks, especially ones reached through national and international research networks. To help continually assess and improve performance, network instrumentation (perfSONAR) can be deployed in more locations
Speaker Mark Foster NASA