Monitoring Extreme-Scale Apache Kafka Using eBPF at New Relic

Streaming Audio: Apache Kafka® & Real-Time Data - A podcast by Confluent, founded by the original creators of Apache Kafka®

Categories:

New Relic runs one of the larger Apache Kafka® installations in the world, ingesting circa 125 petabytes a month, or approximately three billion data points per minute. Anton Rodriguez is the architect of the system, responsible for hundreds of clusters and thousands of clients, some of them implemented in non-standard technologies. In addition to the large volume of servers, he works with many teams, which must all work together when issues arise.Monitoring New Relic's large Kafka installati...