Follow Datanami:

Tag: yarn

Cloudera Begins New Cloud Era with CDP Launch

Eleven years after its founding, Cloudera fulfilled its name in a big way today with the launch of Cloudera Data Platform (CDP), its new flagship data platform that allows customers to securely manage and govern their da Read more…

Google Charts Data Stack Overhaul with Kubernetes

Google today announced that its hosted Spark and Hadoop distribution, Cloud Dataproc, can now run on Kubernetes, at least as an alpha. It may not sound particularly groundbreaking. But when you consider the work that wen Read more…

Seeing the Big Picture on Big Data Market Shift

Hidden from view in the "I want to be data-driven" conversation are the nitty-gritty details of how actually to become a data-driven organization. The grand hope is that artificial intelligence, in the guise of machine l Read more…

Re-Imagining Big Data in a Post-Hadoop World

In the big data battle for architectural supremacy, the cloud is clearly winning and Hadoop is clearly losing. Customers are shying away from investing in monolithic Hadoop clusters in favor of more nimble (if not less e Read more…

What’s Behind Lyft’s Choices in Big Data Tech

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of a Read more…

Intel Builds Analytics, Database Use Cases for Optane

Intel offered a list of use cases for its Optane DC persistent memory technology during a company event this week, including Twitter’s effort to scale its Hadoop clusters using Optane and SAP HANA’s database improvem Read more…

Hadoop Gets Improved Hooks to Cloud, Deep Learning

Organizations that adopt the latest version 3.2 release of Apache Hadoop will get new integration hooks into the AWS and Azure clouds, as well as access to a new deep learning project called Hadoop Submarine. Hadoop m Read more…

More Hadoop, YARN Threats Surface

New reports have emerged of expanding security threats targeting cloud-based Hadoop and YARN instances, including more sophisticated attacks described as “multi-vector/multi-platform threats.” Securonix, a securit Read more…

Latest Bot Targets Hadoop Clusters

Hadoop clusters are under siege by a recently discovered malware threat designed to take over cloud-based servers as a platform for launching distributed denial-of-service attacks. The malware dubbed DemonBot was repo Read more…

New Open-Source Projects Emerge for Machine Learning

Two open-source projects contributed by Chinese tech giants Baidu and Tencent will focus on machine and deep learning advances with the long-term goal of making the AI technologies easier to use while advancing cloud ser Read more…

Hadoop 3.0 Likely to Arrive Before Christmas

It's looking like big data developers will get an early holiday present as work on Hadoop version 3.0 nears completion. And while Hadoop 3.0 brings compelling new features, including a 50% increase in capacity and upward Read more…

Hadoop Was Hard to Find at Strata This Week

It's been barely six months since the word "Hadoop" was removed from the name of the world's biggest big-data trade show, and at this week's Strata Data Conference in New York City, Hadoop all but disappeared. Yet key pa Read more…

Committers Talk Hadoop 3 at Apache Big Data

The upcoming delivery of Apache Hadoop 3 later this year will bring big changes to how customers store and process data on clusters. Here at the annual Apache Big Data show in Miami, Florida, a pair of Hadoop project com Read more…

Can Hadoop Be Simple Again?

In the beginning, Hadoop had two pieces: HDFS and MapReduce. Developers knew how to use them to build applications, and IT teams knew what it took to operate them. Fast forward to 2016, and developers have a cornucopia o Read more…

From Spiders to Elephants: The History of Hadoop

Have you ever wonder where this thing called Hadoop came from, or even why it's here? Marko Bonaci has wondered such things, too. In fact, he wondered about them so much that he decided to write a History of Hadoop chapt Read more…

Hortonworks Hatches a Roadmap to Improve Apache Spark

Hortonworks today issued a broad and detailed roadmap outlining the investment it would like to see made to Apache Spark, the in-memory processing framework that has become one of Hadoop's most popular subprojects. The p Read more…

Enforcing Hadoop SLAs in a Big YARN World

The Apache Hadoop community has done a truly amazing job developing a scalable and versatile platform for big data analytic workloads. And with the recent introduction of YARN in Hadoop 2, we're now able to run multiple Read more…

Moving Beyond ‘Traditional’ Hadoop: What Comes Next?

The phrase "traditional Hadoop" was heard early and often at this week's 2014 Hadoop Summit. While first-generation Hadoop technologies unlocked previously unseen potential in big data sets, it pales in comparison to wha Read more…

Yahoo: We Run the Whole Company on Hadoop

Hadoop is absolutely critical to the operations of Yahoo, executives with the company said this week at the Hadoop Summit. While the company, which spun out Hortonworks in 2011, is moving away from “traditional” Hado Read more…

Hortonworks Spins Up a YARN Readiness Program

Hortonworks today launched its YARN Ready Program to help Hadoop application vendors adopt the technology that's at the heart of the modern Hadoop v2 infrastructure. YARN is the key piece of technology that enables mu Read more…

Older Entries
Datanami