Language Flags

Translation Disclaimer

HPCwire Enterprise Tech HPCwire Japan


February 20, 2013

Hortonworks Proposes New Hadoop Incubation Projects


Hortonworks today announced the submission of two new incubation projects to the Apache Software Foundation and the launch of the Stinger Initiative, three efforts aimed at enhancing the security and performance of Hadoop applications.

“Our approach to innovation has been consistent from when our team began their work on the Hadoop project at Yahoo! more than seven years ago,” said Greg Pavlik, vice president of engineering for Hortonworks. “Simply put, we believe that the fastest way to innovate is to do our work within the open source community, introduce enterprise feature requirements into the public domain, and collaborate with others to progress existing open source projects or incubate new projects to meet those needs. By staying true to our 100-percent open source philosophy and applying enterprise software rigor to the test and release process, we can continue to accelerate the adoption of Hadoop within mainstream enterprises.”

The proposed incubation projects and the Stinger Initiative follow on the success of similar innovative projects initiated within the community by Hortonworks engineers, including Apache Ambari, Apache HCatalog and Apache Hadoop YARN, which are now foundational elements of Apache Hadoop for the enterprise.

The new efforts focus on enterprise requirements that are essential for broad adoption across the Hadoop ecosystem:

  • The Stinger Initiative to Optimize Apache Hive for Interactive Queries: Stinger represents a concerted effort by Hortonworks and the broader Apache community to improve Hive performance and better serve business intelligence use cases such as interactive data exploration, visualization and parameterized reporting. It is complementary to best-of-breed data warehouse and analytic platforms. As approximately 50 percent of Hadoop users depend on Hive for SQL-based operational data processing, enhancing Hive’s SQL capabilities and optimizing its query performance in support of user-focused SQL interactions is critical to ensuring Hive remains the de-facto standard for SQL queries with Hadoop. 
  • Tez Next-generation Runtime Proposed as Apache Incubator Project: The Tez proposal aims to enhance the performance of Hadoop components that currently run on MapReduce, such as Apache Hive, by providing an alternative, next-generation runtime built on Hadoop YARN that significantly improves latency and throughput of Hadoop applications.
  • Hadoop Gateway Proposed as Apache Incubator Project: The Hadoop Gateway proposal addresses the need for a single point of authentication and secure access for Apache Hadoop services in a cluster, which will simplify Hadoop security for users who access data and execute jobs and operators who control and manage the cluster. 

Hortonworks has proposed Tez and Hadoop Gateway as incubator projects to the Apache Software Foundation and looks forward to engaging with the community on these proposals.

Share Options


Subscribe

» Subscribe to our weekly e-newsletter


Discussion

There are 0 discussion items posted.

 

Most Read Features

Most Read News

Most Read This Just In

Cray Supercomputer

Sponsored Whitepapers

Planning Your Dashboard Project

02/01/2014 | iDashboards

Achieve your dashboard initiative goals by paving a path for success. A strategic plan helps you focus on the right key performance indicators and ensures your dashboards are effective. Learn how your organization can excel by planning out your dashboard project with our proven step-by-step process. This informational whitepaper will outline the benefits of well-thought dashboards, simplify the dashboard planning process, help avoid implementation challenges, and assist in a establishing a post deployment strategy.

Download this Whitepaper...

Slicing the Big Data Analytics Stack

11/26/2013 | HP, Mellanox, Revolution Analytics, SAS, Teradata

This special report provides an in-depth view into a series of technical tools and capabilities that are powering the next generation of big data analytics. Used properly, these tools provide increased insight, the possibility for new discoveries, and the ability to make quantitative decisions based on actual operational intelligence.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

Webinar: Powering Research with Knowledge Discovery & Data Mining (KDD)

Watch this webinar and learn how to develop “future-proof” advanced computing/storage technology solutions to easily manage large, shared compute resources and very large volumes of data. Focus on the research and the application results, not system and data management.

View Multimedia

Video: Using Eureqa to Uncover Mathematical Patterns Hidden in Your Data

Eureqa is like having an army of scientists working to unravel the fundamental equations hidden deep within your data. Eureqa’s algorithms identify what’s important and what’s not, enabling you to model, predict, and optimize what you care about like never before. Watch the video and learn how Eureqa can help you discover the hidden equations in your data.

View Multimedia

More Multimedia

ISC'14

Job Bank

Datanami Conferences Ad

Featured Events

May 5-11, 2014
Big Data Week Atlanta
Atlanta, GA
United States

May 29-30, 2014
StampedeCon
St. Louis, MO
United States

June 10-12, 2014
Big Data Expo
New York, NY
United States

June 18-18, 2014
Women in Advanced Computing Summit (WiAC ’14)
Philadelphia, PA
United States

June 22-26, 2014
ISC'14
Leipzig
Germany

» View/Search Events

» Post an Event