Language Flags

Translation Disclaimer

HPCwire Enterprise Tech HPCwire Japan
Webinar Powering Research with Knowledge Discovery & Data Mining

January 14, 2013

Thumbtack Releases Benchmark Analysis of NoSQL Databases

Thumbtack Technology has published a report analyzing how NoSQL databases perform under conditions of extremely high load—addressing an increasingly common use case with big data.

The Thumbtack benchmark report, entitled Ultra-High Performance NoSQL Benchmarking: Analyzing Durability and Performance Tradeoffs, is intended to help organizations obtain an independent understanding of the strengths and weaknesses of various NoSQL database approaches to supporting applications that process huge volumes of data and need durable and consistent storage semantics. In it, Thumbtack takes a focused, tuned and optimized approach to answering specific real-world questions by evaluating four databases (Aerospike, Cassandra, Couchbase, and MongoDB) as they would be optimized for this scenario.

In particular, the report focused on how durability and consistency needs affect raw performance. The data strongly suggests that for synchronously replicated, durable data, Aerospike was able to outperform the other databases by a wide margin, whereas when those constraints are relaxed, both Aerospike and Couchbase are able to process transaction volumes approaching 1 million operations per second.

“Previous published NoSQL benchmarks typically have run out-of-the-box queries against default settings on a broad set of databases, but not all use cases are the same. That is why we have focused on testing a few NoSQL databases for their ability to address a specific class of real-world problem with big data,” said Ben Engber, Thumbtack Technology CEO and co-author of the benchmark study. “We believe IT decision-makers will benefit from the focused results of our report, as they seek to gain a clearer understanding of how databases can support their application needs.”

Benchmark Methodology

Thumbtack performed its tests using a modified version of the Yahoo Cloud Serving Benchmark (YCSB) from Yahoo! Research, which is rapidly becoming the standard for benchmarking NoSQL databases. However, because the YCSB hasn’t been optimized for testing at the highest volumes, Thumbtack altered and extended the YCSB tool and supporting scripts to overcome these limitations as part of this benchmarking project. In conjunction with publishing the report, Thumbtack has also made available its changes to the core YCSB framework on which the tests were run. These include various performance and functional changes that allow YCSB to create a higher load and support a variety of different kinds of replication and durability models.

Today’s report is the first in a series of reports Thumbtack plans to produce to help organizations make the correct decisions in the very broadly defined NoSQL space. Upcoming reports will provide detailed analysis of aspects other than raw key-value performance, including fault-tolerance and secondary index support. Additional databases and hosting environments will also be incorporated into the analysis.

Share Options


» Subscribe to our weekly e-newsletter


There are 0 discussion items posted.


Most Read Features

Most Read News

Most Read This Just In


Sponsored Whitepapers

Planning Your Dashboard Project

02/01/2014 | iDashboards

Achieve your dashboard initiative goals by paving a path for success. A strategic plan helps you focus on the right key performance indicators and ensures your dashboards are effective. Learn how your organization can excel by planning out your dashboard project with our proven step-by-step process. This informational whitepaper will outline the benefits of well-thought dashboards, simplify the dashboard planning process, help avoid implementation challenges, and assist in a establishing a post deployment strategy.

Download this Whitepaper...

Slicing the Big Data Analytics Stack

11/26/2013 | HP, Mellanox, Revolution Analytics, SAS, Teradata

This special report provides an in-depth view into a series of technical tools and capabilities that are powering the next generation of big data analytics. Used properly, these tools provide increased insight, the possibility for new discoveries, and the ability to make quantitative decisions based on actual operational intelligence.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

Webinar: Powering Research with Knowledge Discovery & Data Mining (KDD)

Watch this webinar and learn how to develop “future-proof” advanced computing/storage technology solutions to easily manage large, shared compute resources and very large volumes of data. Focus on the research and the application results, not system and data management.

View Multimedia

Video: Using Eureqa to Uncover Mathematical Patterns Hidden in Your Data

Eureqa is like having an army of scientists working to unravel the fundamental equations hidden deep within your data. Eureqa’s algorithms identify what’s important and what’s not, enabling you to model, predict, and optimize what you care about like never before. Watch the video and learn how Eureqa can help you discover the hidden equations in your data.

View Multimedia

More Multimedia

Leverage Big Data

Job Bank

Datanami Conferences Ad

Featured Events

May 5-11, 2014
Big Data Week Atlanta
Atlanta, GA
United States

May 29-30, 2014
St. Louis, MO
United States

June 10-12, 2014
Big Data Expo
New York, NY
United States

June 18-18, 2014
Women in Advanced Computing Summit (WiAC ’14)
Philadelphia, PA
United States

June 22-26, 2014

» View/Search Events

» Post an Event