YCSB++: Benchmarking and Performance Debugging Advanced Features in
Scalable Table Stores
-- Swapnil V. Patil, Carnegie Mellon Universiry
Abstract:
Inspired by Google’s BigTable, a variety of scalable, semi-
structured, weak-semantic table stores have been developed and
optimized for different priorities such as query speed, ingest speed,
availability, and interactivity. As these systems mature, performance
benchmarking will advance from measuring the rate of simple workloads
to understanding and debugging the performance of advanced features
such as ingest speed-up techniques and function shipping filters from
client to servers. This talk describes YCSB++, a set of extensions to
the Yahoo! Cloud Serving Benchmark (YCSB) to improve performance
understanding and debugging of advanced table store features. YCSB++
includes multi-tester coordination for increased load and eventual
consistency measurement, multi-phase workloads to quantify the
consequences of work deferment and the benefits of anticipatory
configuration optimization such as B-tree pre-splitting or bulk
loading, and abstract APIs for explicit incorporation of advanced
features in benchmark tests. To enhance performance debugging, we
customized an existing cluster monitoring tool to gather the internal
statistics of YCSB++, table stores, system services like HDFS, and
operating systems, and to offer easy post-test correlation and
reporting of performance behaviors.
Contact Us | ECE Home | CoC Home | Georgia Tech Home © 2001-2011 CERCS at Georgia Tech :: Atlanta, Georgia 30332 Last Modified:Monday, 19-Sep-2011 22:55:44 EDT