NANOG Meeting Presentation Abstract

Monitor BGP using open source OpenBMP and Apache Kafka
Meeting:	NANOG65
Date / Time:	2015-10-06 3:15pm - 4:00pm
Room:	Le Grand Salon & Marquette
Presenters:	Speakers: Tim Evens, Cisco Tim Evens has over 19 years of experience as a network engineer and programmer in wide range of industries including carrier and internet service providers, financial trading, healthcare, retail and technology. Tim has been active as a double CCIE for 14 years. In his current position, Tim works in the Chief Technology and Architecture Office at Cisco and is responsible for establishing inter-networking data analytics. He is the maintainer of OpenBMP (www.openbmp.org).
Abstract:	BGP and OSPF/IS-IS monitoring is commonly implemented using VTY scripting of CLI output or by using passive BGP peering sessions. Scripting CLI output can be slow and cumbersome in terms of credential management and it can be prohibitive when access is restricted. In addition, CLI output is specific to the router OS resulting in the scripter having to constantly maintain various router implementations. BGP peering is complex to implement and overkill for most use-cases when only monitoring of prefixes or viewing of RIB tables are needed. Existing tools can be difficult to deploy and have complex API's when interacting with both RAW and parsed BGP data. We will show that OpenBMP breaks down the traditional barrier of complexity in interacting with BGP data. We will discuss why Kafka is being used and review features that Kafka provides over other existing methods to convey real-time parsed and raw BMP/BGP data. We will cover use-cases and examples of different types of OpenBMP/Kafka consumers. We will show how a network engineer can interact with real-time live BGP data using simple BASH and AWK scripting or by using CQL/SQL queries.
Files:	Monitor BGP using open source OpenBMP and Apache Kafka(PDF) Monitor BGP using open source OpenBMP and Apache Kafka
Sponsors:	None.

Back to NANOG65 agenda.

NANOG65 Abstracts

• Show All

• Conference Opening
  Speakers:
  Tony Tauber, Comcast; Christian S. TacitTorIX; .
  Philippe Couture, Videotron; Clinton Work, TELUS;

• Conference Opening
  Speakers:
  Tony Tauber, Comcast; Christian S. TacitTorIX; .
  Philippe Couture, Videotron; Clinton Work, TELUS;

• Conference Opening
  Speakers:
  Tony Tauber, Comcast; Christian S. TacitTorIX; .
  Philippe Couture, Videotron; Clinton Work, TELUS;

• Conference Opening
  Speakers:
  Tony Tauber, Comcast; Christian S. TacitTorIX; .
  Philippe Couture, Videotron; Clinton Work, TELUS;

• NANOG 65 Keynote Address
  Speakers:
  Jack Waters, Level3 Communications;

• Your Bitcoins or Your Site: An Analysis of the DDoS for Bitcoins (DD4BC) DDoS Extortion Campaign.
  Speakers:
  Roland Dobbins, Arbor Networks;

• The many uses of NetFlow and flow-like data
  Speakers:
  Avi Freedman, Kentik;

• NANOG Board Candidates
  Moderators:
  William CharnockPacketFabric; .
  

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• Data Center Track
  Moderators:
  Gabe Cole, RTE Group, Inc.;

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• DNS Track
  Speakers:
  Geoff HustonAPNIC; .
  Duane Wessels, VeriSign; Keith MithcellDNS-OARC; .
  Brian SomersOpenDNS ; .
  Ray BellisInternet Systems Consortium; .
  Eddie Winstead.
  Tomas HlavacekCZ.NIC; .
  

• NetDevOps - Ansible 101 to network nirvana
  Speakers:
  Bronwyn Lewis, Packet Clearing House; Matt Peterson, Cumulus Networks;

• NetDevOps - Ansible 101 to network nirvana
  Speakers:
  Bronwyn Lewis, Packet Clearing House; Matt Peterson, Cumulus Networks;

• Demystifying Pros & Cons of large Scale BGP RR deployments
  Speakers:
  rohit bothra, Brocade Communications;

• DDoS Tutorial
  Speakers:
  Krassimir Tzvetanov, A10 Networks, Inc.;

• Security Track
  Speakers:
  Krassimir Tzvetanov, A10 Networks, Inc.;

• Wi-Fi: Fundamentals, Design and Troubleshooting
  Speakers:
  Troy Martin, Aerohive Networks;

• 10 Weird (and Possibly Useful) Things You Didn't Know about International Networks
  Speakers:
  Tim Stronge, TeleGeography;

• Monitor BGP using open source OpenBMP and Apache Kafka
  Speakers:
  Tim Evens, Cisco;

• Building a smallish DC...for the rest of us
  Speakers:
  Karl Brumund, Dyn;

• Running MPLS efficiently in ring networks
  Speakers:
  Ravi Singh, Juniper Networks;

• BGPuma -- Border Gateway Protocol Update Metric Analysis
  Speakers:
  Leigh Metcalf, CERT;

• Whack-a-Mole Routing: The effects of ISP Traffic Engineering on Non-ISP Networks
  Speakers:
  Rick Casarez, Salesforce;

• Distributed Route Aggregation on the Global Network (DRAGON)
  Speakers:
  João Luís Sobrinho, Instituto de Telecomunicações, University of Lisbon;

• Cloudy with a chance of Breach: Forecasting Cyber Security Incidents
  Speakers:
  Manish Karir, QuadMetrics;

• Optimal routing vs. Route Reflector VNF - reconcile the fire with water
  Speakers:
  Rafal Szarecki, Juniper Networks;

• The future of North American Regional BCOP
  Speakers:
  Aaron Hughes6connect; .
  Chris Grundemann.
  

• The future of North American Regional BCOP
  Speakers:
  Aaron Hughes6connect; .
  Chris Grundemann.
  

• Lightning Talks
  Speakers:
  NANOG Lightning TalksNANOG Community; .
  

• Peering Track
  Moderators:
  Sylvie LaPerriere, Google Inc.; Patrick Gilmore, Markley Group; Panelists:
  David E. Young, Verizon; Hank Hultquist, AT&T; Joseph Cavender, Level 3 Communications; Speakers:
  Jon Nistor, TorIX;

• Strategies of packet buffering inside Routers
  Speakers:
  Rafal Szarecki, Juniper Networks;

• Peering Track
  Moderators:
  Sylvie LaPerriere, Google Inc.; Patrick Gilmore, Markley Group; Panelists:
  David E. Young, Verizon; Hank Hultquist, AT&T; Joseph Cavender, Level 3 Communications; Speakers:
  Jon Nistor, TorIX;

• Peering Track
  Moderators:
  Sylvie LaPerriere, Google Inc.; Patrick Gilmore, Markley Group; Panelists:
  David E. Young, Verizon; Hank Hultquist, AT&T; Joseph Cavender, Level 3 Communications; Speakers:
  Jon Nistor, TorIX;

• Peering Track
  Moderators:
  Sylvie LaPerriere, Google Inc.; Patrick Gilmore, Markley Group; Panelists:
  David E. Young, Verizon; Hank Hultquist, AT&T; Joseph Cavender, Level 3 Communications; Speakers:
  Jon Nistor, TorIX;

• Peering Track
  Moderators:
  Sylvie LaPerriere, Google Inc.; Patrick Gilmore, Markley Group; Panelists:
  David E. Young, Verizon; Hank Hultquist, AT&T; Joseph Cavender, Level 3 Communications; Speakers:
  Jon Nistor, TorIX;

• Peering Track
  Moderators:
  Sylvie LaPerriere, Google Inc.; Patrick Gilmore, Markley Group; Panelists:
  David E. Young, Verizon; Hank Hultquist, AT&T; Joseph Cavender, Level 3 Communications; Speakers:
  Jon Nistor, TorIX;

• Proactive Network Configuration Validation with Batfish
  Speakers:
  Todd MillsteinUniversity of California, Los Angeles; .
  ratul mahajanmicrosoft research; .
  Ari Fogel, UCLA; Meg Walraed-SullivanSpace Exploration Technologies; .
  

• Proactive Network Configuration Validation with Batfish
  Speakers:
  Todd MillsteinUniversity of California, Los Angeles; .
  ratul mahajanmicrosoft research; .
  Ari Fogel, UCLA; Meg Walraed-SullivanSpace Exploration Technologies; .
  

• Proactive Network Configuration Validation with Batfish
  Speakers:
  Todd MillsteinUniversity of California, Los Angeles; .
  ratul mahajanmicrosoft research; .
  Ari Fogel, UCLA; Meg Walraed-SullivanSpace Exploration Technologies; .
  

• Proactive Network Configuration Validation with Batfish
  Speakers:
  Todd MillsteinUniversity of California, Los Angeles; .
  ratul mahajanmicrosoft research; .
  Ari Fogel, UCLA; Meg Walraed-SullivanSpace Exploration Technologies; .
  

• Deploying IPv6 at Scale as an ISP
  Speakers:
  Clinton Work, TELUS;

• Closing Remarks
  Speakers:
  Betty Burke, NANOG Executive Director;