Tag: Hadoop

Security Concerns Extend to ‘Big Data Life Cycle’

May 20, 2015 |

The “datafication” of modern life is now measured in the quintillions of bytes of data generated by humans each day. The struggle to store, manage and retrieve the waterfall of data has also highlighted a growing list of privacy and security issues. Privacy concerns stemming from the rise of big data and the resulting backlash against abuses like unscrupulous data brokers have resulted in a range of regulatory initiatives designed to safeguard sensitive information. Now, greater attention is being given Read more…

Apache Drill Poised to Crack Tough Data Challenges

May 19, 2015 |

It’s been three years in the making, and today the Apache Drill project announced that version 1 of the eponymous tool is ready for business. MapR Technologies, which develops Hadoop and NoSQL database software, wasted no time adding it to its software stack, and declaring war on fixed schemas everywhere. Apache Drill is revolutionary in the way it allows users to explore, visualize, and query large and diverse data sets, particularly semi-structured data generated on the Web and via machines. Read more…

How Machine Learning Is Eating the Software World

May 18, 2015 |

Marc Andreessen famously said in 2011 that software was eating the world. Four years later, that trend has accelerated, only now it appears that machine learning technology is on the cusp of eating software, and that algorithms will take over the world, with a little help from their friends: the APIs. Not that this is a bad thing, at least not as Elon Musk envisions, with AI-powered overlords enslaving the human race (a separate story for another day). But if Read more…

Gartner: Hadoop Adoption ‘Fairly Anemic’

May 14, 2015 |

Enterprise adoption of Hadoop remains “tentative,” according to a new survey, as lingering challenges posed by doubts about the business value of the software framework and database skills gap hinder uptake. Market researcher Gartner Inc. reported this week that only 125 respondents to a recent survey of 284 clients said they have invested in Hadoop or plan to over the next two years. The survey was conducted between February and March of this year. “Despite considerable hype and reported successes Read more…

Analytics Leaders Target Speed, Context, Functionality

May 13, 2015 |

Among the emerging trends in the data analytics business is the desire for faster access to business insights with improved context along with greater functionality in areas like predictive analytics and cognitive intelligence. Hence, the latest vendor rankings from market watcher Nucleus Research reveal that leading analytics vendors are pursuing both requirements with a mix of deep analytics architectures and flexible, cloud-based offerings. The Nucleus Research “value matrix” is among a growing list of vendor rankings that seeks to identify Read more…

Pentaho Eyes Spark to Overcome MapReduce Limitations

May 12, 2015 |

Pentaho today announced it’s supporting Apache Spark with its suite of data analytic tools. While supporting Spark gives Pentaho performance advantages over MapReduce when executing data transformations and running queries within Hadoop, the software company is approaching the in-memory framework for other use cases with a wary eye. Apache Spark will be a supported engine with the next release of Pentaho‘s analytical platform, which is due in mid to late June. Pentaho is eyeing two main use cases with this Read more…

NoSQL Battle Heats Up As MarkLogic Hauls In $102M

May 12, 2015 |

Just a year ago, MarkLogic CEO Gary Bloom couldn’t get any respect in the Wild West shootout that is the NoSQL database market. But today, with $102 million in new financing and a valuation north of $1 billion for MarkLogic, Bloom has a little swagger to his step as he takes aim at his direct competitors Datastax, Couchbase, and MongoDB. The NoSQL database market has seen its share trash talking over five years as a motley crew of commercial open Read more…

How Hadoop Solved BT’s Data Velocity Problem

May 8, 2015 |

Like most large corporations with millions of customers, BT (British Telecom) has an extensive collection of databases, and is constantly moving data in and out of them. But when data growth maxed out a critical ETL server, it found a solution in a distributed Hadoop system. With £18 billion (about $30 billion) in revenue last year, BT is one of the largest telecommunications provider in the world, and serves more than 18 million consumers and nearly 3 million businesses in Read more…

Zettaset, Utimaco Target Hadoop, NoSQL security

May 7, 2015 |

Big data security specialist Zettaset is joining forces with security hardware vendor Utimaco to offer an integrated data encryption security module for use with Hadoop and NoSQL. The partners said Zettaset’s Secure Hadoop Encryption client software, which is used to encrypt sensitive data, was combined with Utimaco’s CryptoServer hardware security module, which provides physical protection of master cryptographic keys. The integrated security module targets enterprises deploying a Hadoop cluster or a NoSQL database. It protects encryption keys by isolating them Read more…

Wanted: A Plug-In Architecture for Hadoop Development

May 6, 2015 |

Hadoop is hard. There’s just no way around that. Setting up and running a cluster is hard, and so is developing applications that make sense of, and create value from, big data. What Hadoop really needs now, says former Facebook engineer Jonathan Gray, is a plug-in architecture that hides technical complexity from developers. Silicon Valley is full of big data veterans like Gray who know their way around Hadoop and the myriad of projects and engines that make up the Read more…