Follow Datanami:

Tag: grid engine

The Art of Scheduling in Big Data Infrastructures Today

Arun Murthy, architect with Hortonworks, said recently that the Hadoop community wanted to “fundamentally re-architect Hadoop...in a way where multiple types of applications can operate efficiently and predictable within the same cluster”. The starting point to do this, he says, is YARN, which has the potential to “turn Hadoop from a single application system to a multi-application operating system”. Fritz Ferstl, CTO with Univa argues that such efforts may run the risk of reinventing the wheel. Read more…

Sharing Infrastructure: Can Hadoop Play Well With Others?

A lot of big data/Hadoop implementations are swimming against the currents of what recent history has taught about large scale computing and the result is a significant amount of waste, says Univa CEO, Gary Tyreman, who believes that Hadoop shared-infrastructure environments are on the rise. Read more…

Managing MapReduce Applications in a Shared Infrastructure

Sponsored Content

An organization’s Big Data is key to customer insight and product design superiority. The story about the growth of Big Data enabling the crunching of vast amounts of data has been well covered in the media the past couple of years. Hadoop is positioned as the premier technology solution to help organizations create this insight and product superiority. What is less visible for some is the convergence of Big Compute and Big Data infrastructure. Read more…

This Week’s Big Data Big Ten

This week's big data big ten for week ending May 4 includes data-intensive system news out of Australia, big genomics investments at key U.S. research centers, some multi-million sum investments in analytics platforms, and a few other items of interest, including HPCC Systems' move into Asia. Read more…

Datanami