Too many big data initiatives are science projects that take months of effort, risk failure and require highly trained data scientists with scarce skills. According to a CSC survey, 55 percent of big data projects aren’t completed and many others fall short of their objectives.Read more...
Hewlett-Packard and Hortonworks today announced a strategic partnership that will see the vendors work together around Hadoop. In exchange for HP’s $50 million investment in Hortonworks, HP gets the right to distribute the Hortonworks Data Platform (HDP) as the Hadoop component of its HAVEn big data suite. While HP offers a range of IT solutions for big data problems, the IT giant has not had a very aggressive Hadoop strategy. It strengthened its Hadoop story in June 2013, when it Read more…
In the video game Roller Coaster Tycoon, players would build and manage an amusement park while being able to see the thoughts of their patrons in real time as they walk through and experience the park. Through social media, Hadoop, and HANA, the software giant SAP says the same type of interaction can be created in the real world.
YARN was the big news this week, with the announcement that the Hadoop resource manager is finally hitting the streets as part of the Hortonworks Data Platform (HDP) “Community Preview.” According to Bruno Fernandez-Ruiz, who spoke at Hadoop Summit this week, Yahoo! has been able to leverage YARN to transform the processing in their Hadoop cluster from simple, stodgy MapReduce, to a nimble micro-batch engine processing machine – a change which they refer to as “continuous computing.”
Fresh from the game changing announcement that they have received a $50 million dollar haul from new investors, Hortonworks is in full swagger as Hadoop Summit kicks off today. The company put more cards on the table this morning, revealing the launch of the “community preview” of the Hortonworks Data Platform (HDP) 2.0, and a strategic partnership with Teradata that will culminate in a Hortonworks-based Hadoop appliance.
Hortonworks CEO, Rob Bearden announced that the company has secured a new round of funding to the tune of $50 million dollars, giving the upstart Hadoop distro company a new level of legitimacy in the enterprise Hadoop wars.
Arun Murthy, architect with Hortonworks, said recently that the Hadoop community wanted to “fundamentally re-architect Hadoop…in a way where multiple types of applications can operate efficiently and predictable within the same cluster”. The starting point to do this, he says, is YARN, which has the potential to “turn Hadoop from a single application system to a multi-application operating system”. Fritz Ferstl, CTO with Univa argues that such efforts may run the risk of reinventing the wheel.
Hadoop is about to see a fundamental reset in its base functionality, says Arun Murthy, architect with Hortonworks and the Apache Software Foundation, who says that SQL in Hadoop via YARN is a part of the core of this metamorphosis.
Hadoop data management tools for the enterprise are on their way says a team of open source developers at Hortonworks and InMobi, who recently saw their project, dubbed Falcon, accepted as an Apache Software Foundation incubator project.
Hadoop has come a long way, and with projects currently underway it’s got plenty of fuel to drive enterprise innovation for years to come said Hortonworks co-founder and CTO, Eric Baldeschwieler in his recent Hadoop Summit Keynote in Amsterdam, Netherlands.
Between the ingestion, storage, processing and distribution of large, multi-structured data volumes, there is bound to be complexity, especially when it’s happening within a Hadoop cluster. However, according to HPC storage company, Data Direct Networks (DDN), all it takes to remedy the hassles is a Hadoop appliance that…