NANOG Meeting Presentation Abstract

SONATA: Scalable Streaming Analytics for Network Telemetry
Meeting:	NANOG70
Date / Time:	2017-06-07 11:00am - 11:30am
Room:	Grand Ballroom
Presenters:	Speakers: Arpit Gupta, Princeton University Arpit Gupta is currently a fourth year Ph.D. student in CS at Princeton University. At Princeton, he works under the supervision of Dr. Nick Feamster and is also mentored by Dr. Jennifer Rexford. His research focuses on the intersection of Internet Routing, Software Defined Networks (SDN), and Big Data. He is one of the creators of software-defined IXPs (SDXs). Before joining Princeton, he completed his Masters from NC State University and undergrad from Indian Institute of Technology, Roorkee, India. Web: http://www.cs.princeton.edu/~arpitg/
Abstract:	Current solutions for network telemetry are ill-suited for security or performance troubleshooting as they offer limited expressibility and are harder to scale as the number of monitoring queries or the volume of data increases. Expressing queries as dataflow operations (i.e., map/ reduce/ distinct/ group, etc.) over packet tuples addresses the expressibility problem, but scaling such a system is non-trivial. We observe that network telemetry can benefit from two key observations: (1)~underlying data plane can process the packets at line rate, and (2)~small portion of the total traffic satisfies the query for most network monitoring applications. This talk presents the design and implementation of SONATA, a stream-based network telemetry system that allows an operator to express network-wide queries as dataflow operations over packet tuples. Given a query, SONATA automatically determines the optimal plan, (1)~refining the input query to iteratively zoom in over portions of traffic that satisfy the query, and (2)~partitioning the refined queries across the network switches and the stream processing system. We implement several example queries that are motivated by real-world security and troubleshooting scenarios and quantify the scalability benefits of SONATA for these queries using traffic traces from different production networks.
Files:	SONATA: Scalable Streaming Analytics for Network Telemetry(PDF) SONATA: Scalable Streaming Analytics for Network Telemetry
Sponsors:	None.

Back to NANOG70 agenda.

NANOG70 Abstracts

• Show All

• Keynote: Revisiting Statistical Multiplexing in Your Network
  Speakers:
  Len Bosack, XKL;

• Seattle Internet Exchange
  Speakers:
  Jared Reimer

• DDoS Trends in Last 20 Years
  Speakers:
  Merike Kaeo, Farsight Security;

• When BGP meets Big-data
  Speakers:
  Tim Evens, Cisco;

• Bootstrapping IX-Denver: A Cooperative IX Case Study
  Speakers:
  Chris Grundemann, Myriad Supply;

• Tutorial: Segment Routing
  Speakers:
  Ron Bonica, Juniper Networks;

• Interconnection Track: Automated Peering Operations
  Speakers:
  Job Snijders, NTT;

• Interconnection Track: PeeringDB Update
  Speakers:
  Aaron Hughes, 6connect;

• Interconnection Track: Creating a Centralized Database for Peering and Colocation Services
  Speakers:
  Eric SilvermanInflect Inc. ; .
  

• Panel Discussion: Finding your next gig
  Speakers:
  Jeff DeClue.
  Mehmet Akcin, Yahoo Inc; Michael Ballenger.
  Dan Seifert.
  Peter Hartzell.
  TJ TraskFacebook; .
  

• Panel Discussion: Finding your next gig
  Speakers:
  Jeff DeClue.
  Mehmet Akcin, Yahoo Inc; Michael Ballenger.
  Dan Seifert.
  Peter Hartzell.
  TJ TraskFacebook; .
  

• Panel Discussion: Finding your next gig
  Speakers:
  Jeff DeClue.
  Mehmet Akcin, Yahoo Inc; Michael Ballenger.
  Dan Seifert.
  Peter Hartzell.
  TJ TraskFacebook; .
  

• Panel Discussion: Finding your next gig
  Speakers:
  Jeff DeClue.
  Mehmet Akcin, Yahoo Inc; Michael Ballenger.
  Dan Seifert.
  Peter Hartzell.
  TJ TraskFacebook; .
  

• Panel Discussion: Finding your next gig
  Speakers:
  Jeff DeClue.
  Mehmet Akcin, Yahoo Inc; Michael Ballenger.
  Dan Seifert.
  Peter Hartzell.
  TJ TraskFacebook; .
  

• Panel Discussion: Finding your next gig
  Speakers:
  Jeff DeClue.
  Mehmet Akcin, Yahoo Inc; Michael Ballenger.
  Dan Seifert.
  Peter Hartzell.
  TJ TraskFacebook; .
  

• The State of Open Source Routers
  Speakers:
  Russ White, Ericsson;

• Turning the Network: Lessons learned from redeploying an ISP's network
  Speakers:
  Andrew Gray.
  

• NANOG 70 Hackathon runner up presentations
  Speakers:
  Nick Pappin.
  Mike Korshunov.
  Akshat Sharma, Cisco Systems Inc.;

• NANOG 70 Hackathon runner up presentations
  Speakers:
  Nick Pappin.
  Mike Korshunov.
  Akshat Sharma, Cisco Systems Inc.;

• NANOG 70 Hackathon runner up presentations
  Speakers:
  Nick Pappin.
  Mike Korshunov.
  Akshat Sharma, Cisco Systems Inc.;

• The Internet is Flat: Revisited
  Speakers:
  Robert Bender, CTS Telecom;

• Building a nationwide carrier for <$1M - war stories & lessons learned
  Speakers:
  Tim Hoffman, Twitter; Jonny MartinLimelight Networks; .
  

• Building a nationwide carrier for <$1M - war stories & lessons learned
  Speakers:
  Tim Hoffman, Twitter; Jonny MartinLimelight Networks; .
  

• Lightning Talks
  Speakers:
  Igor GashinskyYahoo; .
  Ian FlintYahoo; .
  Punky DueroICANN; .
  Chris GrundemannMyriad Supply; .
  

• Lightning Talks
  Speakers:
  Igor GashinskyYahoo; .
  Ian FlintYahoo; .
  Punky DueroICANN; .
  Chris GrundemannMyriad Supply; .
  

• Lightning Talks
  Speakers:
  Igor GashinskyYahoo; .
  Ian FlintYahoo; .
  Punky DueroICANN; .
  Chris GrundemannMyriad Supply; .
  

• Lightning Talks
  Speakers:
  Igor GashinskyYahoo; .
  Ian FlintYahoo; .
  Punky DueroICANN; .
  Chris GrundemannMyriad Supply; .
  

• Tutorial: New and Updated - Everything You Always Wanted to Know About Optical Networking
  Speakers:
  Richard A Steenbergen, PacketFabric;

• Hashing on broken assumptions
  Speakers:
  Lorenzo Saino, Fastly;

• BGP Optimal Route Reflection - Technology and Deployment
  Speakers:
  Phil Bedard, Cisco;

• Lost in Fat Tree forest and route out
  Speakers:
  Rafal Szarecki, Juniper Networks;

• The Networking Grand Challenge
  Speakers:
  Kireeti Kompella, Juniper Networks;

• SONATA: Scalable Streaming Analytics for Network Telemetry
  Speakers:
  Arpit Gupta, Princeton University;

• Network Telemetry at Yahoo!
  Speakers:
  Matt Hudgins, Yahoo! ; Varun Varma, Yahoo;

• Network Telemetry at Yahoo!
  Speakers:
  Matt Hudgins, Yahoo! ; Varun Varma, Yahoo;

• Network Automation And Programmability: Reality Versus The Vendor Hype When Considering Legacy And NFV Networks
  Speakers:
  Patrick Moore, Itential, LLC;

• The other side of DDoS
  Speakers:
  Krassimir Tzvetanov, Fastly, Inc.;

• Open Undersea Cable Systems
  Speakers:
  Jamie Gaudette, Microsoft;

• OpenContrail as SDN controller for NFV infrastructure in AT&T network.
  Speakers:
  Alexey Gorbunov, AT&T;

• Lightning Talks
  Speakers:
  Edward LopezCorsa; .
  Rafal SzareckiJuniper; .
  Peter ThimmeschAddrex; .
  

• Lightning Talks
  Speakers:
  Edward LopezCorsa; .
  Rafal SzareckiJuniper; .
  Peter ThimmeschAddrex; .
  

• Lightning Talks
  Speakers:
  Edward LopezCorsa; .
  Rafal SzareckiJuniper; .
  Peter ThimmeschAddrex; .
  

• Designing Multi-tenant Data Centers using EVPN Integrated Routing and Bridging (IRB)
  Speakers:
  Neeraj Malhotra, Cisco; Ahmed Abeer.
  

• Designing Multi-tenant Data Centers using EVPN Integrated Routing and Bridging (IRB)
  Speakers:
  Neeraj Malhotra, Cisco; Ahmed Abeer.
  

• Status and Solutions for Whois Data Accuracy
  Speakers:
  Tina MorrisLeslie Nobile

• Status and Solutions for Whois Data Accuracy
  Speakers:
  Tina MorrisLeslie Nobile

• Minesweeper and Propane: Two Tools for Improving Network Reliability
  Speakers:
  Ryan Beckett, Princeton University;