Tag: yarn

Hadoop 3.0 Likely to Arrive Before Christmas

Dec 5, 2017 |

It’s looking like big data developers will get an early holiday present as work on Hadoop version 3.0 nears completion. And while Hadoop 3.0 brings compelling new features, including a 50% increase in capacity and upwards of a 4x improvement in scalability, more exciting stuff – like support for Docker, support for GPUs, and an S3-compatible storage API —   Read more…

Hadoop Was Hard to Find at Strata This Week

Sep 29, 2017 |

It’s been barely six months since the word “Hadoop” was removed from the name of the world’s biggest big-data trade show, and at this week’s Strata Data Conference in New York City, Hadoop all but disappeared. Read more…

Committers Talk Hadoop 3 at Apache Big Data

May 18, 2017 |

The upcoming delivery of Apache Hadoop 3 later this year will bring big changes to how customers store and process data on clusters. Here at the annual Apache Big Data show in Miami, Florida, a pair of Hadoop project committers from Cloudera shared details on how the changes will impact YARN and HDFS. Read more…

Can Hadoop Be Simple Again?

Sep 19, 2016 |

In the beginning, Hadoop had two pieces: HDFS and MapReduce. Developers knew how to use them to build applications, and IT teams knew what it took to operate them. Fast forward to 2016, and developers have a cornucopia of technologies and frameworks at their disposal. Read more…

From Spiders to Elephants: The History of Hadoop

Apr 15, 2015 |

Have you ever wonder where this thing called Hadoop came from, or even why it’s here? Marko Bonaci has wondered such things, too. In fact, he wondered about them so much that he decided to write a History of Hadoop chapter for his upcoming book, “Spark in Action.” Read more…

Hortonworks Hatches a Roadmap to Improve Apache Spark

Sep 24, 2014 |

Hortonworks today issued a broad and detailed roadmap outlining the investment it would like to see made to Apache Spark, the in-memory processing framework that has become one of Hadoop’s most popular subprojects. Read more…

Enforcing Hadoop SLAs in a Big YARN World

Jul 23, 2014 |

The Apache Hadoop community has done a truly amazing job developing a scalable and versatile platform for big data analytic workloads. And with the recent introduction of YARN in Hadoop 2, we’re now able to run multiple analytic engines on our clusters simultaneously. Read more…

Moving Beyond ‘Traditional’ Hadoop: What Comes Next?

Jun 5, 2014 |

The phrase “traditional Hadoop” was heard early and often at this week’s 2014 Hadoop Summit. While first-generation Hadoop technologies unlocked previously unseen potential in big data sets, it pales in comparison to what we’ll see with second-gen Hadoop, we’re told. Read more…

Yahoo: We Run the Whole Company on Hadoop

Jun 4, 2014 |

Hadoop is absolutely critical to the operations of Yahoo, executives with the company said this week at the Hadoop Summit. While the company, which spun out Hortonworks in 2011, is moving away from “traditional” Hadoop components like MapReduce in favor of YARN, Tez, and Hive, the Hadoop platform remains absolutely core to its operations. Read more…

Hortonworks Spins Up a YARN Readiness Program

Jun 3, 2014 |

Hortonworks today launched its YARN Ready Program to help Hadoop application vendors adopt the technology that’s at the heart of the modern Hadoop v2 infrastructure.

YARN is the key piece of technology that enables multiple data engines to run simultaneously on the same Hadoop cluster, and is the centerpiece of Hadoop v2, which launched last October. Read more…

Older Entries