file.pdf (180.94 kB)

Ganesha: Black-Box Fault Diagnosis for MapReduce Systems (CMU-PDL-08-112)

Download (180.94 kB)
journal contribution
posted on 01.09.2008 by Xinghao Pan, Jiaqi Tan, Soila Kavulya, Rajeev Gandhi, Priya Narasimhan
Ganesha aims to diagnose faults transparently in MapReduce systems, by analyzing OS-level metrics alone. Ganesha’s approach is based on peer-symmetry under fault-free conditions, and can diagnose faults that manifest asymmetrically at nodes within a MapReduce system. While our training is performed on smaller Hadoop clusters and for specific workloads, our approach allows us to diagnose faults in larger Hadoop clusters and for unencountered workloads. We also candidly highlight faults that escape Ganesha’s black-box diagnosis.

History

Publisher Statement

All Rights Reserved

Date

01/09/2008

Exports

Exports