SHOW

Filter (clear filters)

Domains

Companies

Technologies

Functions

Highlights


Overview for kafka





Event Driven Microservices with Kafka & Evolution of the Data Pipeline in Agoda

Agoda is one of the best known travel booking sites in Asia. It is also one of the most sophisticated Kafka users in Asia; processing 400 billion events daily (175 TB) using 230 Kafka brokers across over 20 kafka clusters.
In this talk, Shaun Sit Agoda's development manager focuses on the Evolution of Data Pipeline over the years, the architecture, challenges and lessons learned, design decisions and future roadmap as Agoda continues to scale the pipeline to serve the business needs.

Links


Big Data, Fast Data @ PayPal

PayPal has over 7PB of data in Apache Kafka, so they've got some good experience with building fast data products. In this presentation Sid Anand the Chief Data Engineer at PayPal covers their architecture, like how they use change data capture and why you should use Apache Avro for your data in Kafka.

Links