Features

Why Developers Need to Think Like Data Scientists

Data is growing faster than is even fathomable. By 2020, roughly 1.7 megabytes of new information will be created every second for every human being on the planet. Given the immense amount of data, it’s no wonder there Read more…

Weighing Open Source’s Worth for the Future of Big Data

The open source software movement began in earnest 20 years ago, when a group of technology leaders in Silicon Valley coined the term as an alternative to the repugnant "free software." Fast forward to 2018, and the conc Read more…

Demand For Software, Data Skills Remains Strong

Cloud giant Amazon Web Services and database leader Oracle are among the most popular employers for recent college graduates while software engineers head the list of highest paying jobs, according to a new employment su Read more…

Dr. Elephant Leads the Performance Parade

I started working on big data infrastructure in 2009 when I joined Cloudera, which at the time was a small startup with about 10 engineers. It was a fun place to work. My colleagues and I got paid to work on open source Read more…

Data Science Ed: 5 Tips for Undergrads

Demand for data scientists continues to rise as organizations seek new ways to monetize their data. Those who want to be considered for top data science jobs need a solid education behind them, including postgraduate deg Read more…

Four Open Source Data Projects To Watch Now

While open source isn't the sole source of creativity and progress in big data, it's a major driver in the space. Market-shaking tech like Kafka, Spark, Hadoop, and MongoDB all began as obscure open source projects backe Read more…

Kafka ‘Massively Simplifies’ Data Infrastructure, Report Says

What's behind the rapid rise in Apache Kafka? According to a new survey of Kafka users by Confluent, the commercial venture behind Kafka, the data pipeline's capability to "massively simplify" the IT infrastructure of en Read more…

Hadoop Has Failed Us, Tech Experts Say

The Hadoop dream of unifying data and compute in a distributed manner has all but failed in a smoking heap of cost and complexity, according to technology experts and executives who spoke to Datanami. "I can't find a Read more…

How Kafka Redefined Data Processing for the Streaming Age

The Apache Kafka phenomenon reached a new high today when Confluent announced a $50 million investment from the venture capital firm Sequoia. The investment signals renewed confidence that Kafka is fast becoming a new an Read more…

Dr. Elephant Steps Up to Cure Hadoop Cluster Pains

Getting jobs to run on Hadoop is one thing, but getting them to run well is something else entirely. With a nod to the pain that parallelism and big data diversity brings, LinkedIn unveiled a new release of Dr. Elephant Read more…