Follow Datanami:

Tag: Hadoop

Databricks Donates Delta Code to Open Source

Apr 24, 2019 |

Databricks today announced that it’s open sourcing the code behind Databricks Delta, the Apache Spark-based product it designed to help keep data neat and clean as it flows from sources into its cloud-based analytics environment. Read more…

Microsoft Expands Hadoop on Azure

Apr 16, 2019 |

Microsoft has upgraded its open source analytics services running on Azure with a new version of Hadoop incorporating enhancements of Apache Hive and other open source analytics frameworks.

The software giant (NASDAQ: Read more…

How Databricks Keeps Data Quality High with Delta

Apr 8, 2019 |

Data lakes have sprung up everywhere as organizations look for ways to store all their data. But the quality of data in those lakes has posed a major barrier to getting a return on data lake investments. Read more…

Intel Builds Analytics, Database Use Cases for Optane

Apr 4, 2019 |

Intel offered a list of use cases for its Optane DC persistent memory technology during a company event this week, including Twitter’s effort to scale its Hadoop clusters using Optane and SAP HANA’s database improvements focused on applications like machine learning and predictive analytics. Read more…

Apache Spark Is Great, But It’s Not Perfect

Apr 3, 2019 |

Apache Spark is one of the most widely used tools in the big data space, and will continue to be a critical piece of the technology puzzle for data scientists and data engineers for the foreseeable future. Read more…

What Makes Apache Spark Sizzle? Experts Sound Off

Mar 11, 2019 |

Apache Spark is one of the most popular open source projects in the world, and has lowered the barrier of entry for processing and analyzing data at scale. We asked some of the leaders in the big data space to give us their take on why Spark has achieved sustained success when so many other frameworks have fizzled. Read more…

Arcadia Data Adds BI Tools, Language Queries

Mar 8, 2019 |

Visual analytics vendor Arcadia Data continues to extend big data search capabilities with AI-driven business intelligence tools that also allow for natural language queries, a capability intended to extend the use of BI to a wider audience of enterprise users. Read more…

Data Engineering Continues to Move the Employment Needle

Mar 5, 2019 |

Interested in a career in big data? You could do well by investing your time and effort in acquiring data science skills. But you may do even better by turning yourself into a data engineer, which is a title that continues to see substantial demand in the job market. Read more…

Can On-Prem S3 Compete with HDFS for Analytic Workloads?

Feb 27, 2019 |

In the battle for big data storage supremacy, Hadoop is still in the running. It may no longer be the 800-lb gorilla, but the demonstrated scalability of the Hadoop Distributed File System (HDFS) makes it a potent contender, especially for storing petabytes on-prem. Read more…

Four Ways Automation Can Rescue Your Data Lake

Feb 21, 2019 |

Ask Gartner Research and you’ll find that as of late 2017, 60% of big data projects failed to survive the pilot phase and only 17% of Hadoop deployments went on to the production phase. Read more…

Do NOT follow this link or you will be banned from the site!