Language Flags

Translation Disclaimer

HPCwire HPC in the Cloud Digital Manufacturing Report Green Computing Report
Rogue Wave

January 19, 2012

Amazon Unveils Dynamo as a Service


Reliability and scalability are topping the enterprise priority charts when it comes to looking at NoSQL solutions--and Amazon is the latest to step in with a new proposed solution.

The shopping giant and infrastructure as a service provider is touting its new cloudy data powerhouse as enterprise ready and is telling organizations that they can (and should) look to running their mission-critical applications on its cloud—and utilizing its services, including Dynamo, Elastic Map Reduce and more..

The company says that its new data store offering, Dynamo, provides the reliability and scaling capabilities that Amazon has been using internally to run mission-critical, highly fluctuating customer interactions.

Amazon says that Dynamo is designed to “manage the state of services that have very high reliability requirements and need tight control over the tradeoffs between availability, consistency, cost-effectiveness and performance.” Additionally, this capability is offered as a service, meaning that organizations seeking to make use of it don’t need to bother with rapid manual provisioning headaches; as a cloud service, Dynamo will scale to meet demand (automatically to a point, but large customers will need to contact Amazon) and wind back down as well.

They point to an example of Dynamo in action by noting that features on Amazon.com’s shopping site, including customer preferences, shopping carts, sales rank of new titles and other customer-facing elements would hit major scaling and availability walls when set within a standard relational database. Dynamo, however, provides the primary key only interface that can adapt to these requirements and scale with demand.

According to Amazon, one of the biggest internal challenges they face their own with daily operations is achieving reliability at the massive scale. As they noted this week, “even the slightest outage has significant financial consequences and impacts customer trust.”

 Accordingly, they say they’ve built their infrastructure of tens of thousands of servers and network components across several datacenters to create the most fault-tolerant environment possible; one in which components regularly fail but these failures are managed and mitigated. Amazon claims that this approach means that a “persistent state is managed in the face of these failures” and that this “drives the reliability and scalability of the software systems.”

“One of the lessons our organization has learned from operating Amazon’s platform is that the reliability and scalability of a system is dependent on how its application state is managed. Amazon uses a highly decentralized, loosely coupled, service oriented architecture consisting of hundreds of services. In this environment there is a particular need for storage technologies that are always available. For example, customers should be able to view and add items to their shopping cart, even if disks are failing, network routes are flapping, or data centers are being destroyed by tornadoes.  Therefore, the service responsible for managing shopping carts requires that it can always write to and read from its data store, and that its data needs to be available across multiple data centers.”

As Doug Henschen noted, “Another appeal of DynamoDB is that it's closely tied to Amazon's Hadoop-based Elastic MapReduce service. Customers using DynamoDB will be able to use data from within DynamoDB (and the AWS S3 storage service) in MapReduce processes and downstream analytic queries, something many Internet-scale businesses are routinely doing or anticipating doing as their businesses scale up. So it's a single environment with scalable processing, scalable storage and scalable data-processing and analytic capabilities.”

Share Options


Subscribe

» Subscribe to our weekly e-newsletter


Discussion

There are 0 discussion items posted.

 
Cray CS300-LC

Sponsored Links

Sponsored Whitepapers

Best Practices in Big Data Storage - Sponsored by Cleversafe, Cray, DDN, NetApp, & Panasas

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas

From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Download this Whitepaper...

Big Data, Big Brains – Sponsored By NetApp

04/22/2013 | NetApp

Big data has proven to be one of the most promising yet challenging technologies for both government and industry. But, before IT leaders can harness the full potential of big data, there are key issues to address surrounding infrastructure, storage, personnel, and training.
MeriTalk surveyed 17 visionary big data leaders to find out what they see as the big data challenges and opportunities as well as how government can best leverage big data. Download the “Big Data, Big Brains Report”.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

SGI President and CEO, Jorge Titinger, on Big Data

SGI President and CEO, Jorge Titinger, talks about SGI's history and leadership in HPC and how that has converged into Big Data Solutions.

View Multimedia

Cray CS300-AC Cluster Supercomputer Air Cooling Technology Video

The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.

View Multimedia

More Multimedia

SGI DataRaptor with MarkLogic Database

Job Bank

Datanami Conferences Ad

Featured Events

May 22-23, 2013
Business Intelligence Innovation Summit
Chicago, IL
United States

June 4-4, 2013
The Economist's Information Forum
San Francisco, CA
United States

June 10-13, 2013
Cloud & Big Data Expo
New York City, NY
United States

June 19-20, 2013
GigaOM Structure
San Francisco, CA
United States

June 26-27, 2013
2013 Hadoop Summit
San Jose, CA
United States

June 26-27, 2013
Big Data World Congress
London
United Kingdom

» View/Search Events

» Post an Event