Technologies » Storage

Features

Will the Fall of ‘Society’s Genome’ Trigger the Next Dark Age?

Jun 20, 2016 |

Over the past 20 years, we’ve witnessed a remarkable transformation of our society, and digital information is at the very heart of it. But what if we were to suddenly lose all this data that we’ve amassed, or a big chunk of it? It would be, quite simply, devastating to Western civilization, argues the CEO of Spectra Logic in a new book. In the new book, titled “Society’s Genome: Genetic Diversity’s Role in Digital Preservation,” Spectra Logic CEO Nathan Thompson Read more…

The Growing Menace of Data Hoarding

Jun 13, 2016 |

One of the downsides of living and working in a data-rich environment is the desire to squirrel away every last bit and byte for future use. Thanks to cheap storage systems such as Amazon S3 and Hadoop, it’s technically possible to store every piece of data you’ve collected. But going too far down that path can lead to a perilous condition known as data hoarding. While data hoarding may not be as great a threat as physically hoarding real-world items, Read more…

Spark Makes Inroads into NoSQL Ecosystem

Jun 6, 2016 |

Apache Spark may have gained fame for being a better and faster processing engine than MapReduce running in Hadoop clusters. But the in-memory software is increasingly finding use outside of Hadoop, including integration with operational NoSQL databases. Spark is currently supported in one way or another with all the major NoSQL databases, including Couchbase, Datastax, and MongoDB. Datastax may have been the first to announce support for Spark nearly two years ago with Apache Cassandra, but today all of the Read more…

Analyzing Video, the Biggest Data of Them All

May 26, 2016 |

Video data is the fastest growing data type on the Internet, and arguably one of the fastest growing period. Thanks to a proliferation of high-definition video cameras, the volume of video data is exploding. While Web-based delivery of video for entertainment purposes is projected to become a $100 billion industry unto its own, another big opportunity revolves around video analytics. We’re in the midst of a hockey-stick like curve with respect to the growth of video data. Consider that, in Read more…

Biotech Crop Discovery Poised for Fast Growth Thanks to Big Data

May 19, 2016 |

Big agriculture companies have been using HPC techniques to understand and manipulate the genes of food staples like corn and soy for many years. Now, thanks to the big data revolution, that kind of fine-grained genetic control will soon be wielded by smaller firms targeting a much wider swath of biotech crops. One of the companies on the cutting edge of biotech crops is Benson Hill Biosystems. The company, which came out of the Donald Danforth Plance Science Center in Read more…

News In Brief

DDN Flashes New All-flash Arrays for Enterprise Use Cases at Scale

May 17, 2016 |

DDN, a high-end storage standard bearer, this morning joined the ranks of storage vendors offering new all-flash technology with the launch of Flashscale, a family of all-flash, scale-out and scale-up products designed for read, write and mixed workloads for enterprise data analytics, web scale cloud and HPC environments. Available in August, the SFA14KXi (the first model number within the Flashscale family) is targeted at organizations demanding storage platforms that deliver high performance capacity and latency across massive stores of data Read more…

Exascale Storage Targets Big Data Archives

Apr 21, 2016 |

With exascale computing comes the requirement for exascale storage. Such a storage platform has emerged in the form of what is touted as the largest capacity tape storage library aimed initially at media and entertainment companies but also targeting HPC applications. Spectra Logic of Boulder, Colo., unveiled its exascale tape storage system at this week’s National Association of Broadcasters annual trade show—hence, the media emphasis. However, Spectra Logic has previously worked with NASA’s Advanced Supercomputing Division at its Ames Research Read more…

Storage Approach Mimics DNA in Fossils

Apr 11, 2016 |

Researchers in Switzerland focusing on biological storage mechanisms say they have demonstrated a way to store and retrieve data in the form of genetic material. Investigators at ETH Zurich sought to leverage DNA’s ability to store large amounts of information in a compact way while overcoming errors encountered in retrieving data due to chemical degradation and mistakes in DNA sequencing. To overcome gaps and false information in encoded data, they encapsulated segments of DNA where information was stored in silica, Read more…

Transactional Streaming? You Need State

Mar 28, 2016 |

The distinction between traditional operational systems and event/stream processing has begun to blur. Stream-oriented approaches offer novel ways to build applications that yesterday would have used a more traditional stack, such as LAMP or something similar. Rather than have monolithic clients fetch, process and update data over a network, developers are building pipelines that push data through fixed processing. It’s easier to scale, easier to reason about and is friendly to federated architectures and the super-trendy microservices. This new world Read more…

Resolving Hadoop’s Storage Gap

Mar 28, 2016 |

Over the past several years, the Hadoop ecosystem has made great strides in its real-time access capabilities, narrowing the gap compared to traditional database technologies. With systems such as Impala and Spark, analysts can now run complex queries or jobs over large datasets within a matter of seconds. With systems such as Apache HBase and Apache Phoenix, applications can achieve millisecond-scale random access to arbitrarily-sized datasets. These improvements have allowed Hadoop to expand the set of applications for which it Read more…

This Just In

Pepperdata Achieves Hortonworks Data Platform Certification

Jun 28, 2016 |

CUPERTINO, Calif., June 28 — Pepperdata, the world experts in the performance of distributed systems at scale, today announced that it has successfully completed the Hortonworks Data Platform (HDP) Certification process against HDP 2.1, HDP 2.2, HDP 2.3, and HDP 2.4 for Pepperdata 4.5. Together with Hortonworks, a leading innovator of open and connected data platforms, Pepperdata enables users to bring true multi-tenant, multi-workload capabilities to Hadoop with powerful and reliable cluster performance. Pepperdata software actively governs and guarantees the consistent Read more…

Latest Release of Attunity Visibility for Hadoop Announced

Jun 28, 2016 |

June 28 — Attunity Ltd., a leading provider of Big Data management software solutions, announced today the latest release of Attunity Visibility for Hadoop with enhanced technology to enable comprehensive data usage analytics for large-scale and fast-growing Hadoop Data Lake environments. Supporting all major Hadoop distributions, as well as enterprise data warehouses, Attunity Visibility provides a unified platform to analyze usage across enterprise Big Data systems to enable intelligent data management. The new Attunity Visibility solution will be unveiled and demonstrated live Read more…

BMC Announces Expanded Big Data Strategy

Jun 28, 2016 |

HOUSTON, Tex., June 28 — BMC, the global leader in IT software solutions for the digital enterprise, today announced an expanded Big Data strategy to automate, accelerate and secure enterprise-class Hadoop environments, enabling operational excellence and a competitive edge in the digital age. Adding to its Big Data strategy, BMC also announced Control-M Automation API, designed to improve Hadoop application deployment agility. The digital universe is doubling every two years, and by 2020 about 1.7 MB of new information will be created every Read more…

Kyvos Insights Delivers New Version of Big Data Analytics Solution for Hadoop

Jun 22, 2016 |

LOS GATOS, Calif., June 22 — Kyvos Insights, a big data analytics company, today announced general availability of the next major version of Kyvos – a massively scalable, self-service analytics solution designed to make big data lakes ready for BI analysts. Building upon its native integration and support for the Hadoop platform, the new release incorporates enterprise-grade functionality to improve analysts access to the data lake, including advanced security support, improved performance and scalability, and integration with additional BI tools. “Once you have all Read more…

Alation Partners With Hortonworks

Jun 22, 2016 |

REDWOOD CITY, Calif., June 22 — Alation, Inc., the collaborative data company, today announced certification of its Alation platform with the Hortonworks Data Platform (HDP) and interoperability with Apache Tez, the popular processing engine for Apache Hadoop. Now analysts can more easily find and understand data in Hadoop using Alation for increased productivity and maximization of enterprise Hadoop investments. Data analysts familiar with SQL still often struggle with finding and understanding data in Hadoop despite the rapid enterprise adoption of Hadoop as a big data store. Read more…