Tag: HDFS

Committers Talk Hadoop 3 at Apache Big Data

May 18, 2017 |

The upcoming delivery of Apache Hadoop 3 later this year will bring big changes to how customers store and process data on clusters. Here at the annual Apache Big Data show in Miami, Florida, a pair of Hadoop project committers from Cloudera shared details on how the changes will impact YARN and HDFS. Read more…

ODPi Tackles Hive with Latest Hadoop Runtime Spec

Sep 27, 2016 |

ODPi today unveiled the second major release of its Runtime Specification that’s geared at setting a standard for Hadoop components to ensure greater interoperability among distributions and third-party products. New additions to the spec include Apache Hive and the Hadoop Compatible File System (HCFS). Read more…

Investments in Fast Data Analytics Surge

Jul 7, 2016 |

Companies are quickly ramping up their investments fast data analytics and real-time stream processing frameworks and lowering spending on batch technologies in an attempt to get on top of growing data volumes and velocities, a new survey says. Read more…

Hadoop Past, Present, and Future

May 17, 2016 |

Every few years the technology industry seems to be consumed with a shiny new object that gets hyped far beyond reality. At worst, the inevitable bursting of the hype bubble leads to the disappearance of the technology from relevance (remember Internet browsing on your TV?), but more often the hype subsides until a real but narrower focus for the technology is found. Read more…

Resolving Hadoop’s Storage Gap

Mar 28, 2016 |

Over the past several years, the Hadoop ecosystem has made great strides in its real-time access capabilities, narrowing the gap compared to traditional database technologies. With systems such as Impala and Spark, analysts can now run complex queries or jobs over large datasets within a matter of seconds. Read more…

BlueTalon Delivers Fine-Grain Protection of HDFS Data

Sep 29, 2015 |

BlueTalon today announced that its big data security software now supports the enforcement of fine-grained authorization policies and masking of HDFS data. This will enable customers to control access to Hadoop data using the same tool they use to control access to enterprise data warehouses and relational databases, the company says. Read more…

Does InfiniBand Have a Future on Hadoop?

Aug 4, 2015 |

Hadoop was created to run on cheap commodity computers connected by slow Ethernet networks. But as Hadoop clusters get bigger and organizations press the upper limits of performance, they’re finding that specialized gear, such as solid state drives and InfiniBand networks, can pay dividends. Read more…

Data Lake Showdown: Object Store or HDFS?

Jun 23, 2015 |

The explosion of data is causing people to rethink their long-term storage strategies. Most agree that distributed systems, one way or another, will be involved. But when it comes down to picking the distributed system–be it a file-based system like HDFS or an object-based file store such as Amazon S3–the agreement ends and the debate begins. Read more…

JethroData Indexes Its Way to $8.1M SQL Payday

Jun 9, 2015 |

There’s no shortage of SQL-on-Hadoop projects in the works. Hive, Impala, Presto, HAWQ—they all tout a certain advantage. But they all look mostly the same to Eli Singer, the CEO of JethroData, which today landed $8.1 million in Series B funding to continue development of his unique SQL query engine for Hadoop. Read more…

Accelerating Hadoop® Workflows to Yield Greater Application Efficiency

Mar 2, 2015 |

As enterprise-critical decision support fully embraces big data, confusion has grown on how to best satisfy increasing demand for ever larger data analytics. Some have questioned whether Hadoop will continue to reliably scale and serve as the primary workhorse for enterprise production level data analytics. Read more…