SHOW

Filter (clear filters)

Domains

Companies

Functions

Technologies


Overview for yahoo

Large-Scale Machine Learning: Use Cases and Technologies

This talk highlights Yahoo use cases where big data and machine learning technologies are best exemplified. It explains algorithm/system challenges to scale ML algorithms for massive datasets. Learn about a technical overview of CaffeOnSpark and TensorFlowOnSpark to jumpstart your journey of large-scale machine learning.

Links


Handling Kernel Upgrades at Scale - The Dirty Cow Story

Apache Hadoop at Yahoo is a massive platform with 36 different clusters spread across YARN, Apache HBase, and Apache Storm deployments, totaling 60,000 servers made up of 100s of different hardware configurations accumulated over generations, presenting unique operational challenges and a variety of unforeseen corner cases. In this talk, Sameer Gawande, a Hadoop System Engineer at Yahoo will share methods, tips and tricks to deal with large scale kernel upgrade on heterogeneous platforms within tight timeframes with 100% uptime and no service or data loss through the Dirty COW use case (privilege escalation vulnerability found in the Linux Kernel in late 2016).

Links


Large-Scale Machine Learning: Use Cases and Technologies

A talk on Yahoo use cases where big data and machine learning technologies are best exemplified. Andy Feng is a VP of Architecture at Yahoo explains algorithm/system challenges to scale ML algorithms for massive datasets. He provides a technical overview of CaffeOnSpark and TensorFlowOnSpark to jumpstart a journey of large-scale machine learning.

Links


Data Sketches: A required toolkit for Big Data Analytics

Jon Malkin is a scientist and Alexander Saydakov is a senior software engineer at Yahoo discuss how they use data sketches at Yahoo which has helped Yahoo successfully reduce data processing times from days to hours, or minutes to seconds on a number of its internal platforms.

Links



Lessons learned building a scalable self-serve, real-time, multitenant monitoring service at Yahoo

How Yahoo has build a real time monitoring service using Apache Storm Trident, Kafka, HBase, and OpenTSDB.

Links