Technologies » Storage

Features

Analyzing Video, the Biggest Data of Them All

May 26, 2016 |

Video data is the fastest growing data type on the Internet, and arguably one of the fastest growing period. Thanks to a proliferation of high-definition video cameras, the volume of video data is exploding. While Web-based delivery of video for entertainment purposes is projected to become a $100 billion industry unto its own, another big opportunity revolves around video analytics. We’re in the midst of a hockey-stick like curve with respect to the growth of video data. Consider that, in Read more…

Biotech Crop Discovery Poised for Fast Growth Thanks to Big Data

May 19, 2016 |

Big agriculture companies have been using HPC techniques to understand and manipulate the genes of food staples like corn and soy for many years. Now, thanks to the big data revolution, that kind of fine-grained genetic control will soon be wielded by smaller firms targeting a much wider swath of biotech crops. One of the companies on the cutting edge of biotech crops is Benson Hill Biosystems. The company, which came out of the Donald Danforth Plance Science Center in Read more…

Hadoop 3 Poised to Boost Storage Capacity, Resilience with Erasure Coding

May 18, 2016 |

The next major version of Apache Hadoop could effectively double storage capacity while increasing data resiliency by 50 percent through the addition of erasure coding, according to a presentation at the Apache Big Data conference last week. Apache Hadoop version 3 is currently being developed by members of the Apache Hadoop team at the Apache Software Foundation. Akira Ajisaka, who is an Apache Hadoop committer and a PMC member, shared information about the next major release at last week’s Apache Read more…

SnappyData Gets Funded for Spark-GemFire Combo

Apr 27, 2016 |

SnappyData today announced it has received $3.65 million in Series A funding to build a business around its real-time analytics platform that combines Apache Spark, Pivotal’s GemFire data grid, and an innovative data approximation method that makes big data more manageable. SnappyData was spun out of Pivotal earlier this year to pursue development of its technology platform, which essentially combines the data manipulation capabilities of Apache Spark and Spark Streaming, the in-memory persistence of the GemFire’s data grid, and an Read more…

Merging Big Data Analytics Into the Business Fastlane

Apr 20, 2016 |

The abundance of big new data types is creating a feeding frenzy among companies as they gorge themselves at a veritable smorgasbord of information. In every industry, entrepreneurs are trying out new ways to harness big data for competitive advantage. But going from data science project to actionable insight is not as easy as it sounds, and the smart approach demands pragmatic solutions. There are good reasons to be excited about the big data phenomenon. We’re smack dab in the Read more…

News In Brief

DDN Flashes New All-flash Arrays for Enterprise Use Cases at Scale

May 17, 2016 |

DDN, a high-end storage standard bearer, this morning joined the ranks of storage vendors offering new all-flash technology with the launch of Flashscale, a family of all-flash, scale-out and scale-up products designed for read, write and mixed workloads for enterprise data analytics, web scale cloud and HPC environments. Available in August, the SFA14KXi (the first model number within the Flashscale family) is targeted at organizations demanding storage platforms that deliver high performance capacity and latency across massive stores of data Read more…

Exascale Storage Targets Big Data Archives

Apr 21, 2016 |

With exascale computing comes the requirement for exascale storage. Such a storage platform has emerged in the form of what is touted as the largest capacity tape storage library aimed initially at media and entertainment companies but also targeting HPC applications. Spectra Logic of Boulder, Colo., unveiled its exascale tape storage system at this week’s National Association of Broadcasters annual trade show—hence, the media emphasis. However, Spectra Logic has previously worked with NASA’s Advanced Supercomputing Division at its Ames Research Read more…

Storage Approach Mimics DNA in Fossils

Apr 11, 2016 |

Researchers in Switzerland focusing on biological storage mechanisms say they have demonstrated a way to store and retrieve data in the form of genetic material. Investigators at ETH Zurich sought to leverage DNA’s ability to store large amounts of information in a compact way while overcoming errors encountered in retrieving data due to chemical degradation and mistakes in DNA sequencing. To overcome gaps and false information in encoded data, they encapsulated segments of DNA where information was stored in silica, Read more…

Transactional Streaming? You Need State

Mar 28, 2016 |

The distinction between traditional operational systems and event/stream processing has begun to blur. Stream-oriented approaches offer novel ways to build applications that yesterday would have used a more traditional stack, such as LAMP or something similar. Rather than have monolithic clients fetch, process and update data over a network, developers are building pipelines that push data through fixed processing. It’s easier to scale, easier to reason about and is friendly to federated architectures and the super-trendy microservices. This new world Read more…

Resolving Hadoop’s Storage Gap

Mar 28, 2016 |

Over the past several years, the Hadoop ecosystem has made great strides in its real-time access capabilities, narrowing the gap compared to traditional database technologies. With systems such as Impala and Spark, analysts can now run complex queries or jobs over large datasets within a matter of seconds. With systems such as Apache HBase and Apache Phoenix, applications can achieve millisecond-scale random access to arbitrarily-sized datasets. These improvements have allowed Hadoop to expand the set of applications for which it Read more…

This Just In

Datadog Adds Hadoop and Spark Integrations to Cloud-Scale Monitoring Platform

May 24, 2016 |

May 24 — Datadog, the leading SaaS-based monitoring platform for cloud applications, today announced support for Hadoop, bringing its unified view of applications to the Hadoop ecosystem. Hadoop users can now benefit from Datadog’s rich dashboards, full stack visibility and correlation, sophisticated and targeted alerts, collaborative tools and integrations, and easy setup with no maintenance. Integrations with HDFS, MapReduce, YARN, and Spark can be turned on immediately, adding to the long list of technologies DevOps teams can monitor easily and collaboratively Read more…

MapR Celebrates Rapid Innovations in SQL-on-Hadoop Technology

May 19, 2016 |

SAN JOSE, Calif., May 19 — MapR Technologies, Inc., provider of the industry’s only converged data platform, announced today the one year anniversary of Apache Drill on the MapR Platform.  Since its general availability last year, Drill has helped hundreds of organizations worldwide rapidly analyze trillions of records and millions of files, and has fundamentally changed the way businesses actively engage with their data. Drill’s self-describing schema support eases ad-hoc queries in order to help analysts and business users leverage big Read more…

Cloudera and Argyle Data Release Data Survey Results

May 16, 2016 |

SAN MATEO, Calif., May 16 — Telecoms revenue fraud is a primary driver for increased Apache Hadoop adoption, according to a recent poll of telco and enterprise users by Cloudera and Argyle Data. Communication service providers lose around U.S. $38 billion to fraud every year. Cloudera is the global provider of the fastest, easiest, and most secure data management and analytics platform built on Apache Hadoop and the latest open source technologies. Argyle Data‘s industry-leading native Hadoop application suite uses the latest machine learning technologies against a Read more…

Research and Markets Adds New Hadoop Report to Offering

May 13, 2016 |

DUBLIN, Ireland, May 13 — Research and Markets has announced the addition of the “Global Hadoop Market Insights, Opportunity Analysis, Market Shares and Forecast 2016 – 2022” report to their offering. Hadoop is a data storage processing system that enables data storage, file sharing, data analytics etc. The technology is scalable & enables effective analysis from large unstructured data therefore adding value. With increasing role of social media and internet communication Hadoop is being largely used by various spectrum of companies ranging from Facebook Read more…

Keynote Speakers Announced for Leverage Big Data 2016 Summit on “Establishing ROI in the Big Data Frontier”

May 5, 2016 |

SAN DIEGO, Calif., May 5 — The Leverage Big Data 2016 summit, the market-leading, live hosted summit aimed at exploring the panoply of Big Data phenomena and how businesses are leveraging these technologies to establish ROI, today announced the final lineup of end-user speakers for its summit program aimed at arming senior technology business executives in cross-vertical corporate organizations with practical knowledge on everything from streaming analytics, real time data, data integration and governance to storage and compute. Leverage Big Data Read more…