Follow Datanami:

Tag: yarn

What’s Behind Lyft’s Choices in Big Data Tech

May 10, 2019 |

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of an advantage in terms of architecting its big data infrastructure in the cloud, as it was able to sidestep some of the challenges that Uber faced in building out its on-prem system. Read more…

Intel Builds Analytics, Database Use Cases for Optane

Apr 4, 2019 |

Intel offered a list of use cases for its Optane DC persistent memory technology during a company event this week, including Twitter’s effort to scale its Hadoop clusters using Optane and SAP HANA’s database improvements focused on applications like machine learning and predictive analytics. Read more…

Hadoop Gets Improved Hooks to Cloud, Deep Learning

Jan 25, 2019 |

Organizations that adopt the latest version 3.2 release of Apache Hadoop will get new integration hooks into the AWS and Azure clouds, as well as access to a new deep learning project called Hadoop Submarine. Read more…

More Hadoop, YARN Threats Surface

Jan 24, 2019 |

New reports have emerged of expanding security threats targeting cloud-based Hadoop and YARN instances, including more sophisticated attacks described as “multi-vector/multi-platform threats.”

Securonix, a security analytics and operations management platform vendor, said this week it is monitoring persistent malicious attacks affecting exposed cloud and server infrastructure. Read more…

Latest Bot Targets Hadoop Clusters

Oct 29, 2018 |

Hadoop clusters are under siege by a recently discovered malware threat designed to take over cloud-based servers as a platform for launching distributed denial-of-service attacks.

The malware dubbed DemonBot was reported in a blog post last week by datacenter cybersecurity vendor Radware. Read more…

New Open-Source Projects Emerge for Machine Learning

Aug 30, 2018 |

Two open-source projects contributed by Chinese tech giants Baidu and Tencent will focus on machine and deep learning advances with the long-term goal of making the AI technologies easier to use while advancing cloud services using deep learning frameworks. Read more…

Hadoop 3.0 Likely to Arrive Before Christmas

Dec 5, 2017 |

It’s looking like big data developers will get an early holiday present as work on Hadoop version 3.0 nears completion. And while Hadoop 3.0 brings compelling new features, including a 50% increase in capacity and upwards of a 4x improvement in scalability, more exciting stuff – like support for Docker, support for GPUs, and an S3-compatible storage API —   Read more…

Hadoop Was Hard to Find at Strata This Week

Sep 29, 2017 |

It’s been barely six months since the word “Hadoop” was removed from the name of the world’s biggest big-data trade show, and at this week’s Strata Data Conference in New York City, Hadoop all but disappeared. Read more…

Committers Talk Hadoop 3 at Apache Big Data

May 18, 2017 |

The upcoming delivery of Apache Hadoop 3 later this year will bring big changes to how customers store and process data on clusters. Here at the annual Apache Big Data show in Miami, Florida, a pair of Hadoop project committers from Cloudera shared details on how the changes will impact YARN and HDFS. Read more…

Can Hadoop Be Simple Again?

Sep 19, 2016 |

In the beginning, Hadoop had two pieces: HDFS and MapReduce. Developers knew how to use them to build applications, and IT teams knew what it took to operate them. Fast forward to 2016, and developers have a cornucopia of technologies and frameworks at their disposal. Read more…

Do NOT follow this link or you will be banned from the site!