Follow Datanami:

Tag: yarn

Cloudera Begins New Cloud Era with CDP Launch

Sep 24, 2019 |

Eleven years after its founding, Cloudera fulfilled its name in a big way today with the launch of Cloudera Data Platform (CDP), its new flagship data platform that allows customers to securely manage and govern their data while deploying analytic and AI applications in a platform-as-a-service (PaaS) approach on the cloud. Read more…

Google Charts Data Stack Overhaul with Kubernetes

Sep 10, 2019 |

Google today announced that its hosted Spark and Hadoop distribution, Cloud Dataproc, can now run on Kubernetes, at least as an alpha. It may not sound particularly groundbreaking. But when you consider the work that went into replacing YARN with Kubernetes on Cloud Datarpoc — Read more…

Seeing the Big Picture on Big Data Market Shift

Aug 27, 2019 |

Hidden from view in the “I want to be data-driven” conversation are the nitty-gritty details of how actually to become a data-driven organization. The grand hope is that artificial intelligence, in the guise of machine learning, will power our data-driven aspirations, and it’s clear that big data is the raw commodity that makes it all possible. Read more…

Re-Imagining Big Data in a Post-Hadoop World

Aug 12, 2019 |

In the big data battle for architectural supremacy, the cloud is clearly winning and Hadoop is clearly losing. Customers are shying away from investing in monolithic Hadoop clusters in favor of more nimble (if not less expensive) cloud platforms. Read more…

What’s Behind Lyft’s Choices in Big Data Tech

May 10, 2019 |

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of an advantage in terms of architecting its big data infrastructure in the cloud, as it was able to sidestep some of the challenges that Uber faced in building out its on-prem system. Read more…

Intel Builds Analytics, Database Use Cases for Optane

Apr 4, 2019 |

Intel offered a list of use cases for its Optane DC persistent memory technology during a company event this week, including Twitter’s effort to scale its Hadoop clusters using Optane and SAP HANA’s database improvements focused on applications like machine learning and predictive analytics. Read more…

Hadoop Gets Improved Hooks to Cloud, Deep Learning

Jan 25, 2019 |

Organizations that adopt the latest version 3.2 release of Apache Hadoop will get new integration hooks into the AWS and Azure clouds, as well as access to a new deep learning project called Hadoop Submarine. Read more…

More Hadoop, YARN Threats Surface

Jan 24, 2019 |

New reports have emerged of expanding security threats targeting cloud-based Hadoop and YARN instances, including more sophisticated attacks described as “multi-vector/multi-platform threats.”

Securonix, a security analytics and operations management platform vendor, said this week it is monitoring persistent malicious attacks affecting exposed cloud and server infrastructure. Read more…

Latest Bot Targets Hadoop Clusters

Oct 29, 2018 |

Hadoop clusters are under siege by a recently discovered malware threat designed to take over cloud-based servers as a platform for launching distributed denial-of-service attacks.

The malware dubbed DemonBot was reported in a blog post last week by datacenter cybersecurity vendor Radware. Read more…

New Open-Source Projects Emerge for Machine Learning

Aug 30, 2018 |

Two open-source projects contributed by Chinese tech giants Baidu and Tencent will focus on machine and deep learning advances with the long-term goal of making the AI technologies easier to use while advancing cloud services using deep learning frameworks. Read more…

Do NOT follow this link or you will be banned from the site!