Center for Experimental Research in Computer Systems Open Cirrus Summit 2011
Oct 12-13, Atlanta, Georgia

YCSB++: Benchmarking and Performance Debugging Advanced Features in Scalable Table Stores
-- Swapnil V. Patil, Carnegie Mellon Universiry

Abstract:
Inspired by Google’s BigTable, a variety of scalable, semi- structured, weak-semantic table stores have been developed and optimized for different priorities such as query speed, ingest speed, availability, and interactivity. As these systems mature, performance benchmarking will advance from measuring the rate of simple workloads to understanding and debugging the performance of advanced features such as ingest speed-up techniques and function shipping filters from client to servers. This talk describes YCSB++, a set of extensions to the Yahoo! Cloud Serving Benchmark (YCSB) to improve performance understanding and debugging of advanced table store features. YCSB++ includes multi-tester coordination for increased load and eventual consistency measurement, multi-phase workloads to quantify the consequences of work deferment and the benefits of anticipatory configuration optimization such as B-tree pre-splitting or bulk loading, and abstract APIs for explicit incorporation of advanced features in benchmark tests. To enhance performance debugging, we customized an existing cluster monitoring tool to gather the internal statistics of YCSB++, table stores, system services like HDFS, and operating systems, and to offer easy post-test correlation and reporting of performance behaviors.

Contact Us | ECE Home | CoC Home | Georgia Tech Home
© 2001-2011 CERCS at Georgia Tech :: Atlanta, Georgia 30332

Last Modified:Monday, 19-Sep-2011 22:55:44 EDT 

back to the CERCS main page

Valid HTML 4.0 Transitional