Technologies » Storage

Features

Now and Then: The Evolution of In-Memory Computing

Jul 29, 2014 |

The history of data warehousing, big data, and analytics can be described as a constant challenge to process and analyze ever-increasing volumes of data in shorter amounts of time. Fundamentally, the single biggest factor that affects our ability to process data is the speed at which we can access it, and then do something with it. Data warehousing architectures have addressed this over the years by adopting massively parallel processing (MPP) designs, but the lower latency of in-memory computing combined Read more…

Software-Defined Storage Takes Off As Big Data Gets Bigger

Jul 16, 2014 |

The ongoing explosion of data is forcing users to adapt their storage methodologies beyond traditional file- and block-level storage. Object stores and software-defined storage mechanisms, in particular, are quickly gaining footholds at organizations that need to store massive unstructured data sets. Meanwhile, some vendors are promoting a twist on object stores with new “data-defined” storage techniques. File-level storage works well with traditional structured data, such as what you might find in a commercial accounting system using direct-attached storage devices (i.e. Read more…

Apache Spark Gets YARN Approval from Hortonworks

Jun 26, 2014 |

Hortonworks today announced that Apache Spark is certified to work with YARN, the quarterback calling plays in next-gen Hadoop v2 clusters. The YARN stamp of approval clears the way for Hortonworks to fully support Spark for machine learning analytic workloads in a new release of HDP later this year. The prospect of running the in-memory Spark framework on Hadoop has garnered a lot of interest over the past year and a half, in particular as a faster and easier-to-program replacement Read more…

The Big Data Inside Amazon’s New Fire Phone

Jun 20, 2014 |

The new Fire phone that Amazon launched this week looks like your ordinary black smartphone, with a bright 4.7-inch screen, sharp 1080p camera, and stereo speakers. But this little device does some stuff that Google and Apple haven’t tried yet in the area of text, sound, and image recognition on a massive scale. From a big data point of view, the most interesting bit about Fire is the Firefly function. To use this function, users point their camera at some Read more…

Why Hadoop on IBM Power

May 12, 2014 |

In the quest to achieve data-driven insight, Hadoop running on Intel X86-based processors has emerged as a defacto standard. But X86 is not the only game in town, and before the book on Hadoop is written, IBM would like to say a thing or two about the virtues of running Hadoop on its Power processor. Unlike most enterprise software markets over the past 30 years, the combination of hardware architecture and operating system is almost completely absent from the Hadoop Read more…

News In Brief

Big Data Survey Finds Growing Need for CEP

Jul 30, 2014 |

A global survey of software developers working on big data and advanced analytics projects found that the large majority of respondents require real-time, complex event processing for their applications. The survey, released July 29 by Evans Data Corp. of Santa Cruz, Calif., found that 71 percent of respondents said they require advanced processing more than half the time. “Hadoop’s batch processing model has worked well for several years,” Evans Data CEO Janel Garvin noted in a statement releasing the survey. Read more…

UK Regulators Seek to Balance Big Data, Privacy

Jul 29, 2014 |

As concerns grow over how companies collect and use personal data, a UK regulator has issued guidelines for how companies leveraging big data must operate under Britain’s data protection law. The UK Information Commissioner’s Office recently released a report on July 28 that seeks a balance between operating within Britain’s Data Protection Act of 1998 without slowing data innovation. The report acknowledges that big data analytics frequently focus on areas other than the collection and use of personal data. It Read more…

Big Data Helps Drive Transportation Planning

Jul 2, 2014 |

Transportation planners are embracing big data analytics as the nation’s highways become more congested and data science in some instances replaces costly road-construction projects. The latest example comes from an outfit called Urban Insights Associates, a subsidiary of Cubic Transportation Systems specializing in predictive analytics for the transportation sector. Urban Insights launched a consulting practice in late June designed to help transportation agencies deploy resources for urban transportation networks more efficiently. “One of the biggest challenges facing the global transportation Read more…

Cloudera, Dell, Intel Target ‘Big Data Ecosystem’

Jun 24, 2014 |

Cloudera, Dell and Intel said they plan to launch dedicated Dell In-Memory Appliances for the Cloudera Enterprise as a way to boost real-time analytics performance. The partners said the goal of the engineering partnership is to advance enterprise deployments of Apache Hadoop as well as to integrate hardware and software to help enterprises leverage advanced data analysis. The latter would be enabled through incorporation of real-time data streams into customers’ applications. The partners said the initial effort would be the Read more…

FDA Beefs Up IT Infrastructure for Big Data Push

Jun 23, 2014 |

As the health care market moves quickly – some would say too quickly – to leverage big data technology, a key industry regulator also is moving to beef up its IT infrastructure to handle the huge datasets generated daily by manufacturers, service providers and scientists. The U.S. Food and Drug Administration, which regulates everything from pharmaceuticals and medical devices to product recalls and pet food ingredients, expects drug and device trials, for example, to generate an avalanche of research data. Read more…

This Just In

DDN Joins Global Alliance for Genomics and Health

Jul 22, 2014 |

SANTA CLARA, Calif., July 22 – DataDirect Networks (DDN) has joined the Global Alliance for Genomics and Health, an alliance working to accelerate world-wide efforts to responsibly share and analyze large amounts of genomic and clinical information with the research and healthcare communities. DDN joins more than 200 of the world’s leading research institutions, healthcare providers, information technology and life science companies, and disease and patient advocacy organizations across more than 40 countries as a key member of the Genomic Data and Security Read more…

DDN to Showcase Storage Technologies at ISC’14

Jun 17, 2014 |

SANTA CLARA, Calif., June 17 – Powering more than 2/3 of the Top 100 most powerful supercomputers in the world, DataDirect Networks (DDN) leads the industry with its innovative solutions that have been proven and in-production in the world’s largest and most demanding HPC, Financial, Life Sciences, Manufacturing, Web/Cloud/Telco and Academic environments to resolve high performance storage challenges. With block, file and object storage products and solutions designed to address the unprecedented requirements of Big Data and Web 2.0 applications today, using DDN technology, Read more…

International Supercomputing Community to Gather in Leipzig From June 22-26

Jun 12, 2014 |

LEIPZIG, Germany, June 12 – In less than 10 days, around 2,500 attendees and 156 exhibitors will converge on Leipzig to take part in ISC’14, the year’s most compelling high performance computing forum. The five-day conference and three-day exhibition offers an exciting program and the organizers would like to draw the attendees’ attention to some particularly engaging sessions that will enrich their experience at this year’s event. ISC’14 Opening Session The 29th ISC will be officially opened by the conference co-chairs, Martin Read more…

Panasas Unveils ActiveStor 16 Hybrid Storage Appliance with PanFS 6.0

Jun 10, 2014 |

SUNNYVALE, Calif., June 10 – Panasas, the leader in hybrid scale-out NAS for technical research and enterprise customers, has unveiled the Panasas ActiveStor 16 hybrid storage appliance with the PanFS 6.0 storage operating system, setting the bar for reliability and availability for high-performance storage and big data workloads. As adoption of high-performance computing increases in the enterprise and big data deployments continue to grow in scale, traditional RAID approaches no longer deliver an adequate level of storage reliability. With ActiveStor 16 and PanFS Read more…

Compuverde Unveils Data Analytics Research Project with Stanford

Jun 9, 2014 |

KARLSKRONA, Sweden, June 9 – Compuverde, the Big Data storage solution for service providers, telecommunications companies and enterprises, today announced its research project with the Stanford University computer science department aimed at designing, developing and delivering a Big Data analytics solution for intuitive use throughout the enterprise environment. Enterprises are seeking ways to capitalize on Big Data analytics, yet can be thwarted by overtly technical solutions that make actionable insights difficult to achieve outside of the IT department. The goal of the project is to Read more…