Tag: databricks

Databricks Puts ‘Delta’ at the Confluence of Lakes, Streams, and Warehouses

Oct 25, 2017 |

Databricks today launched a new managed cloud offering called Delta that seeks to combine the advantages of MPP data warehouses, Hadoop data lakes, and streaming data analytics in a unifying platform designed to let users analyze their freshest data without incurring enormous complexity and costs. Read more…

The Data Science Behind Dollar Shave Club

Sep 14, 2017 |

Dollar Shave Club burst onto the men’s hygiene scene in 2011 with a hilarious video and preposterous business plan: selling subscriptions for razor blades at a ridiculously low price. Six years later, the company keeps getting laughs with viral YouTube spots, while a sophisticated Apache Spark-based data mining operation running on Databricks’ Read more…

Now Trending: AI Washing

Jul 26, 2017 |

First there was “green washing,” where companies exaggerated the environmental benefits of their products in order to boost sales. Now technology experts are warning us about “AI washing,” an equally questionable tactic pursued by software and technology vendors to boost their artificial intelligence bona fides. Read more…

Exposing AI’s 1% Problem

Jul 25, 2017 |

We see the power of artificial intelligence every day: When Netflix recommends a movie you love, when your bank detects fraud in your account, or when Google routes you around a traffic jam. Read more…

Taking the Data Scientist Out of Data Science

Jul 21, 2017 |

If you were a data scientist three years ago, you could pretty much write your own ticket. Everybody in the industry, it seemed, either wanted to hire a data scientist, or wanted to be one. Read more…

What’s In the Pipeline for Apache Spark?

Mar 6, 2017 |

According to Apache Spark creator Matei Zaharia, Spark will see a number of new features and enhancements to existing features in 2017, including the introduction of a standard binary data format, better integration with Kafka, and even the capability to run Spark on a laptop. Read more…

How These Banking, Energy, and Pharma Firms Use Spark

Jan 20, 2017 |

Few frameworks have gained so much popularity as quickly as Apache Spark.  The open source technology may not be ubiquitous yet in the analytics world, but it’s fast approaching that point. Read more…

Spark ML Runs 10x Faster on GPUs, Databricks Says

Oct 27, 2016 |

Apache Spark machine learning workloads can run up to 10x faster by moving them to a deep learning paradigm on GPUs, according to Databricks, which today announced that its hosted Spark service on Amazon’s new GPU cloud. Read more…

Databricks CEO on Streaming Analytics, Deep Learning, and SQL

Oct 11, 2016 |

As Apache Spark continues to gain steam, so too does Databricks, the company behind the popular distributed processing framework. At the recent Strata + Hadoop World conference, we caught up with Databricks CEO and co-founder Ali Ghodsi to get the latest scoop on advances in the Spark world. Read more…

Apache Spark Adoption by the Numbers

Jun 8, 2016 |

It’s been about three years since Apache Spark burst onto the big data scene and became one of the hottest technologies on the planet. Judging by the numbers surrounding Spark’s adoption—including things like salaries, attendance, and committers–the future of Spark looks quite bright. Read more…