Technologies » Storage

Features

Who IBM’s Server Group Turns To for Machine Data Analytics

Aug 28, 2014 |

IBM’s engineering prowess is second to none, and its Systems and Technology Group builds the computers that run the world’s biggest companies. But when IBM’s STG unit went looking for a way to predict failures by analyzing log data returned by its customers’ servers and storage arrays, it looked externally to a little-known machine data analytics startup from Santa Clara. Glassbeam got its start five years ago, before the Internet of Things (IOT) became the industry’s hottest buzzword and out-hyped Read more…

How to Move 80PB Without Downtime

Aug 25, 2014 |

When the online photo company Shutterfly decided to move its entire data center recently, the possibility of downtime was a big issue. After all, the company had 80 petabytes of customer data spread across tens of thousands of spinning disks, and those disks wouldn’t be spinning while being physically moved. Months later, after the last deliver made its way to Shutterfly‘s new data center, not one piece of data was lost or even temporarily unavailable from the company’s website. How Read more…

AMPLab’s Tachyon Promises to Solidify In-Memory Analytics

Aug 14, 2014 |

U.C Berkeley’s AMPLab first landed on the radar screens of data scientists with Apache Spark, which promises to provide an in-memory data processing framework to replace or augment MapReduce. More recently, the tech wizzes at AMPLab have whipped up Tachyon, a new distributed file system that sits atop HDFS and aims to allow multiple Hadoop or Spark applications and jobs to access the same data at memory speeds without fears of corrupting it. The rapid rise of Apache Spark demonstrates Read more…

Now and Then: The Evolution of In-Memory Computing

Jul 29, 2014 |

The history of data warehousing, big data, and analytics can be described as a constant challenge to process and analyze ever-increasing volumes of data in shorter amounts of time. Fundamentally, the single biggest factor that affects our ability to process data is the speed at which we can access it, and then do something with it. Data warehousing architectures have addressed this over the years by adopting massively parallel processing (MPP) designs, but the lower latency of in-memory computing combined Read more…

Software-Defined Storage Takes Off As Big Data Gets Bigger

Jul 16, 2014 |

The ongoing explosion of data is forcing users to adapt their storage methodologies beyond traditional file- and block-level storage. Object stores and software-defined storage mechanisms, in particular, are quickly gaining footholds at organizations that need to store massive unstructured data sets. Meanwhile, some vendors are promoting a twist on object stores with new “data-defined” storage techniques. File-level storage works well with traditional structured data, such as what you might find in a commercial accounting system using direct-attached storage devices (i.e. Read more…

News In Brief

Are Data Lakes All Wet?

Aug 4, 2014 |

Enterprise data management platforms known as “data lakes” are being promoted as, among other things, a potential solution to “information siloes” by combining different managed collections of data in an unmanaged data lake. The theory is that data consolidation will increase use and sharing of information while reducing storage and server costs. However, a new market study dismisses most of those claims as a “fallacy,” arguing instead that enterprises still require secure data repositories, in other words, data warehouses. At Read more…

Big Data Survey Finds Growing Need for CEP

Jul 30, 2014 |

A global survey of software developers working on big data and advanced analytics projects found that the large majority of respondents require real-time, complex event processing for their applications. The survey, released July 29 by Evans Data Corp. of Santa Cruz, Calif., found that 71 percent of respondents said they require advanced processing more than half the time. “Hadoop’s batch processing model has worked well for several years,” Evans Data CEO Janel Garvin noted in a statement releasing the survey. Read more…

UK Regulators Seek to Balance Big Data, Privacy

Jul 29, 2014 |

As concerns grow over how companies collect and use personal data, a UK regulator has issued guidelines for how companies leveraging big data must operate under Britain’s data protection law. The UK Information Commissioner’s Office recently released a report on July 28 that seeks a balance between operating within Britain’s Data Protection Act of 1998 without slowing data innovation. The report acknowledges that big data analytics frequently focus on areas other than the collection and use of personal data. It Read more…

Big Data Helps Drive Transportation Planning

Jul 2, 2014 |

Transportation planners are embracing big data analytics as the nation’s highways become more congested and data science in some instances replaces costly road-construction projects. The latest example comes from an outfit called Urban Insights Associates, a subsidiary of Cubic Transportation Systems specializing in predictive analytics for the transportation sector. Urban Insights launched a consulting practice in late June designed to help transportation agencies deploy resources for urban transportation networks more efficiently. “One of the biggest challenges facing the global transportation Read more…

Cloudera, Dell, Intel Target ‘Big Data Ecosystem’

Jun 24, 2014 |

Cloudera, Dell and Intel said they plan to launch dedicated Dell In-Memory Appliances for the Cloudera Enterprise as a way to boost real-time analytics performance. The partners said the goal of the engineering partnership is to advance enterprise deployments of Apache Hadoop as well as to integrate hardware and software to help enterprises leverage advanced data analysis. The latter would be enabled through incorporation of real-time data streams into customers’ applications. The partners said the initial effort would be the Read more…

This Just In

DESY and IBM Develop Big Data Architecture for Science

Aug 21, 2014 |

ARMONK, N.Y. and HAMBURG, Germany, Aug. 21 – IBM today announced it is collaborating with Deutsches Elektronen-Synchrotron (DESY), a leading national research center in Germany, to speed up management and storage of massive volumes of x-ray data. The planned Big Data and Analytics architecture based on IBM software defined technology can handle more than 20 gigabyte per second of data at peak performance and help scientists worldwide gain faster insights into the atomic structure of novel semiconductors, catalysts, biological cells and other samples. DESY’s 1.7 Read more…

Violin Memory Announces Deduplication and Compression on Concerto 2200

Aug 20, 2014 |

SANTA CLARA, Calif., Aug. 20 – Violin Memory, Inc., a leading provider of award-winning all-flash storage arrays and appliances delivering application solutions for the enterprise, announced immediate worldwide availability of its data deduplication and compression capabilities on the Concerto 2200 solution. This announcement extends the Company’s industry-leading set of enterprise data services for all-flash array solutions with significant data reduction capabilities. Inline deduplication and compression on the Concerto 2200 solution gives customers maximum storage efficiency, with deduplication rates commonly between 6:1 Read more…

Nexenta Launches NexentaEdge 1.0

Aug 19, 2014 |

SANTA CLARA, Calif., Aug. 19 – Nexenta, the global leader of Software-Defined Storage (SDS) solutions, today announced the launch of NexentaEdge 1.0 – the industry’s first software-only scale out block and object storage solution designed to deliver high performance global inline deduplication on petabyte scale clusters. NexentaEdge is ideally suited for next-generation open source cloud infrastructures and Big Data repositories requiring performance, scale and low total cost of ownership. The solution will be demonstrated for the first time at VMworld US 2014, August 24-28 in San Read more…

DDN Joins Global Alliance for Genomics and Health

Jul 22, 2014 |

SANTA CLARA, Calif., July 22 – DataDirect Networks (DDN) has joined the Global Alliance for Genomics and Health, an alliance working to accelerate world-wide efforts to responsibly share and analyze large amounts of genomic and clinical information with the research and healthcare communities. DDN joins more than 200 of the world’s leading research institutions, healthcare providers, information technology and life science companies, and disease and patient advocacy organizations across more than 40 countries as a key member of the Genomic Data and Security Read more…

DDN to Showcase Storage Technologies at ISC’14

Jun 17, 2014 |

SANTA CLARA, Calif., June 17 – Powering more than 2/3 of the Top 100 most powerful supercomputers in the world, DataDirect Networks (DDN) leads the industry with its innovative solutions that have been proven and in-production in the world’s largest and most demanding HPC, Financial, Life Sciences, Manufacturing, Web/Cloud/Telco and Academic environments to resolve high performance storage challenges. With block, file and object storage products and solutions designed to address the unprecedented requirements of Big Data and Web 2.0 applications today, using DDN technology, Read more…