2019 Internet2 Global Summit

Use Internet2 SiteID

Already have an Internet2 SiteID?
Sign in here.

Internet2 SiteID

The Intelligent Network Service Plane: Intent and Interaction (Working Toward a Smart Network and Smart Application Ecosystem)

Time 03/08/19 10:30AM-11:45AM

Room Archives (M4)

Session Abstract

Today, domain science applications and workflow processes are forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. As a result, domain science applications frequently suffer poor performance, especially so in highly distributed environments. Indeed, the ability for a science application to interact and negotiate with network infrastructure of a science ecosystem, should be a hallmark of truly smart networks and smart applications. It seems clear that current static, non-interactive network infrastructures do not have a path forward to assist or accelerate domain science application innovations.

This session will present a vison, and an early instantiation, of an Intelligent Network Service Plane, where the application workflow agents can engage, interact, and obtain custom services from a smart networked ecosystem. The following key features of Intelligent Network Service Plane are emphasized in this session:

• Intent - The ability for an application to submit a service request in the form of a high-level statement of desired results or outcomes, as opposed to a specific set of network centric inputs.

• Interaction - The ability for an application workflow agent to engage in a "conversation" with the network as part of workflow planning. This conversation can include discovery of available services, asking "what is possible" or "what do you recommend" types of questions, engaging in iterative negotiations prior to actual service requests, or full-service life-cycle status and troubleshooting queries.

The following systems and features are highlighted:

SENSE (SDN for End-to-end Networked Science at the Exascale)
The SENSE system as an example on an Intelligent Network Service Plane deployment will be presented, including the underlying SDN and smart infrastructure. This system is currently deployed as a prototype on ESnet production and testbed infrastructures, as well as inside multiple DOE Laboratory and University Science DMZs. Work is ongoing to evolve the current SENSE prototype deployment into a production level service. A key component of this work is integration with science domain applications and workflow systems.

BigData Express
This high-performance data transfer system will be described along with its interaction with the Intelligent Network Service Plane to optimize operations and provide a more deterministic experience for its users. In this context, the BigData Express system is acting as smart user of smart networked cyberinfrastructure to provide custom services for its users.

Science Domain Use Cases
Use of these services by multiple science domain applications will be discussed including: ExaFEL: Data Analytics at Exascale for Free Electron Lasers, Large Hadron Collider (LHC) Compact Muon Solenoid (CMS), SuperFacility, Named Data Networking.

The DOE Office of Science funded SENSE Project collaborative team is led by Energy Sciences Network (ESnet) and includes collaboration with Lawrence Berkeley National Laboratory (LBL), Fermilab (FNAL), Argonne National Laboratory (ANL), Caltech, and the University of Maryland/Mid-Atlantic Crossroads (UMD/MAX). This project is building smart network services to accelerate scientific discovery in the era of ‘big data’ driven by Exascale, cloud computing, machine learning and AI.

The DOE Office of Science funded BigData Express project (bigdataexpress.fnal.gov) collaborative team includes Fermilab and Oak Ridge National Laboratory. BigData Express is developing a schedulable, predictable, and high-performance data transfer service for DOE’s large-scale science computing facilities and their collaborators. The BigData Express team is collaborating with StarLight International/National Communications Exchange to deploy BigData Express at various research platforms. It is envisioned that we are working toward building a multi-domain and multi-tenant software defined infrastructure (SDI) for high-performance data transfer.

1) Intelligent Network Services and SENSE Overview (Tom Lehman)
2) Big Data Express Overview (Wenji Wu)
3) Prototype Deployment and Demonstration Review (Xi Yang, Wenji Wu)
4) Future Vision and Work (Joe Mambretti, Harvey Newman)
5) Questions and Discussion (All)


Speaker Wenji Wu Fermi National Accelerator Laboratory (FNAL)

Speaker Joe Mambretti Northwestern University

Speaker Xi Yang MAX (Mid-Atlantic Crossroads)

Speaker Harvey Newman Caltech (California Institute of Technology)

Speaker Tom Lehman Virnao

Presentation Media

media item thumbnail Big Data Express: An Intelligent and High-Performance Data Transfer Service

Speaker Wenji Wu Fermi National Accelerator Laboratory (FNAL)

Primary track Advanced Networking

platinum Sponsors

gold Sponsors