Technologies » Systems

Features

Apache Spark Gets YARN Approval from Hortonworks

Jun 26, 2014 |

Hortonworks today announced that Apache Spark is certified to work with YARN, the quarterback calling plays in next-gen Hadoop v2 clusters. The YARN stamp of approval clears the way for Hortonworks to fully support Spark for machine learning analytic workloads in a new release of HDP later this year. The prospect of running the in-memory Spark framework on Hadoop has garnered a lot of interest over the past year and a half, in particular as a faster and easier-to-program replacement Read more…

How T-Mobile Got More from Hadoop

Jun 24, 2014 |

When T-Mobile’s engineering department filled up a pair of 1 petabyte Netezza appliances from IBM, the cell phone carrier naturally turned to Hadoop. But when Hive and Pig turned out to be less than ideal query mechanisms on a cluster with half a trillion rows, the company searched for a suitable replacement, which it found from RainStor. T-Mobile had what you would call a big problem with its data warehouse; namely it was growing too fast. The cell phone company Read more…

BlueData Eyes Market for Hadoop VMs

Jun 17, 2014 |

San Francisco-based stealth startup BlueData is gearing up to release a virtual machine layer that ostensibly would take much of the pain out of Hadoop deployments. Founded by former VMware executives and backed by a roster of IT industry veterans, the company recently spoke with Datanami about what’s holding back Hadoop, and how its forthcoming product (still in beta) will fix it. “Think of our software as a VMware for big data,” says BlueData co-founder and CEO Kumar Sreekanti, who Read more…

Ersatz Thinks Up a GPU-Powered Neural Network

Jun 11, 2014 |

If you want to use neural networks to build models that can learn from data in human-like ways, but are having trouble figuring out where to start, you may want to check out Ersatz, the name of the new GPU-powered deep learning platform officially unveiled today by Ersatz Labs. The domain of machine learning is advancing very quickly at the moment, driven by humankind’s rather sudden (and entirely insatiable) desire to keep and understand all data. There are also big Read more…

GPU-Powered Tagging Service ‘Gets’ the Big Picture

May 20, 2014 |

Picture sharing has blossomed on the Internet, thanks to the ubiquitous camera-phone, 4G cell service, and social media sites like Pintrest and Instagram. However, the ability of organizations to interpret and understand those publicly shared image files en masse has not kept up with the volume. Now, AlchemyAPI is giving new tools to organizations that want to incorporate image recognition into their big data analytic workflows. Millennials are at the forefront in using pictures not only to share information, but Read more…

News In Brief

Commerce Department to Hire Data Czar

Jul 23, 2014 |

In an effort to make greater use of government data, the U.S. Commerce Department is hiring its first chief data officer and convening an industry panel to make agency data more accessible. Several agencies within the Commerce Department like the National Weather Service produce and disseminate huge volumes of meteorological data that are used by private enterprises like the Weather Channel and AccuWeather. “The Department of Commerce is working to unleash more of its data to strengthen the nation’s economic Read more…

Auto Data Being Culled to Understand Driver Preferences

Jul 21, 2014 |

Automotive electronics that have enabled the installation of what amount to networks in vehicles are delivering a raft of new telematics and other features for drivers. These systems are also generating huge volumes of data – 25 gigabytes an hour, according to one estimate – that auto makers are struggling to harness as a way to better understand customer trends and preferences. Call centers, sales and marketing were the traditional methods used to gather customer data. Emerging big data platforms Read more…

Big Data Practitioners Ponder Privacy Issues

Jul 9, 2014 |

A panel of big data executives acknowledged the need for trust, privacy and transparency in the handling of consumer information and called for rules of the road to ensure that privacy concerns do not derail technology innovation driven by big data. The executives addressed the issues during an event, “Big Data and the Policy Behind Big Ideas,” organized by the web site, Politico.com. The event was co-sponsored by the consumer electronics giant Philips. Brent Shafer, CEO of Philips North America, Read more…

As Pollution Worsens, China Turns to Big Data

Jul 8, 2014 |

You’ve got to see, smell, feel Beijing’s smog to believe it. Looking out a high window of a tall building, the air is opaque. Despite rules against them, vendors cook and sell food on side streets using charcoal grills. Prevailing winds from the Gobi Desert distribute dust throughout the sprawling capital. The desert dust along with particulates from high-sulfur coal burned in the city’s power plants prompt car owners to brush off their vehicles the way we might clear snow Read more…

Postal Service Eyes ‘Internet of Postal Things’

Jul 8, 2014 |

The U.S. Postal Service is launching a big data effort dubbed the “Internet of Postal Things” that officials stress will require expertise in data strategy and analytics as well as the workings of the emerging Internet of Things. Observers note that the effort is timely since the Postal Service likely collects more data than similar organizations around the world. Indeed, according to a recent industry solicitation, the post office “has always been a major creator of large datasets – from Read more…

This Just In

PSSC Labs’ CloudOOP 12000 Certified with Cloudera Enterprise 5

Jul 14, 2014 |

LOS ANGELES, Calif., July 14 – PSSC Labs is pleased to announce their purpose built CloudOOP 12000 Big Data server is certified compatible to run Cloudera Enterprise 5.  This announcement comes just days after PSSC Labs deployed a 3+ PByte Cluster designated to run Cloudera  Enterprise 5 to a prominent New York based Ad Tech company. The CloudOOP 12000 product line includes the world’s most energy efficient, highest density enterprise storage server platforms.   In just 1U of rack space, the Read more…

Bull Launches New Range of Bullion Servers for Big Data

Jul 2, 2014 |

PARIS, France, July 2 — Bull is launching a new range of bullion servers designed to speed up the implementation of Big Data and private Cloud infrastructures. The latest bullion systems feature a suite of leading-edge technologies for the next generation of Data Center. The bullion S servers have been developed by Bull with the aim of delivering an innovative response to the new requirements created by the massive explosion in enterprise data and the challenges of Data Center modernization Read more…

Bull and Sinequa Partner to Offer Big Data Processing Appliance

Jul 1, 2014 |

PARIS, France, July 1 — Bull and Sinequa have announced the signing of a strategic partnership in the area of Big Data, to provide a search and content analysis appliance based on ultra high-performance, secure infrastructures. By combining the technology of bullion — one of the world’s most powerful servers — with Sinequa’s Real-Time Big Data Search and Analysis solution, the two firms are together offering a secure, integrated appliance capable of achieving unrivalled performance. The new system will be Read more…

Guavus Unveils Reflex 2.0

Jun 30, 2014 |

SAN MATEO, Calif., June 30 – Guavus, a leading provider of big data analytics solutions for operational intelligence, today unveiled Reflex 2.0 with support for Apache Spark and Hadoop YARN. The Guavus Reflex Operational Intelligence Platform provides a real-time analysis across business and operations for better quality decision-making. The latest version of Reflex expands the ability from batch processing to true continuous analysis at scale from multiple sources and systems including data from billing, CRM, OSS, network, applications, devices and cloud Read more…

Numascale Introduces NumaQ

Jun 25, 2014 |

LEIPZIG, Germany, June 25 – Numascale, in collaboration with 1degreenorth, announces an innovative approach to big data analytics by providing in-memory capabilities via NumaQ systems. NumaQ, developed by 1degreenorth, employs Numascale’s scalable shared memory technology to offer a new generation of high performance in-memory analytics capabilities that provide the power of a cluster coupled with the simplicity of a desktop. NumaQ is a state-of-the-art x86 shared memory system from 1degreenorth that is specifically designed for big data in-memory analytics. The system uses Read more…