How to performance-tune Spark applications in large clusters

Omkar Joshi a senoir software engineer at Uber discusses a new Spark ingestion system known as Marmaray. This new system has been designed to ingest billions of Kafka messages at intervals of 30 minutes. 

Links

« Apache Kafka at LinkedIn: How LinkedIn Customizes Kafka to Work at the Trillion Scale Apache Flink 101 - the rise of stream processing and beyond »