Follow Datanami:

Tag: Spark

Data Science Back to School: Accelerate Your Education

Aug 13, 2019 |

Are you looking to get a data science degree and join the workforce as a data scientist? Then you’re not alone, as thousands of young people around the world are following that same path with the hope of tapping into the high demand – and large salaries – that come with being a data scientist. Read more…

Intel Turbocharges Spark Workloads with Optane DCPMM

Jul 29, 2019 |

Intel didn’t wow chip lovers earlier this year with the launch of its 2nd Generation Intel Xeon Scalable processors “Cascade Lake” processors, which are based on the same 14nm process as the first generation processors. Read more…

Serverless SQL Engine Targets Cloud Analytics

Jun 13, 2019 |

Qubole Inc., the cloud analytics vendor, has added a serverless engine to its platform aimed at simplifying complex tasks like creating data pipelines and server clusters used to scale analytics workloads in the cloud. Read more…

What’s Behind Lyft’s Choices in Big Data Tech

May 10, 2019 |

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of an advantage in terms of architecting its big data infrastructure in the cloud, as it was able to sidestep some of the challenges that Uber faced in building out its on-prem system. Read more…

Microsoft Expands Hadoop on Azure

Apr 16, 2019 |

Microsoft has upgraded its open source analytics services running on Azure with a new version of Hadoop incorporating enhancements of Apache Hive and other open source analytics frameworks.

The software giant (NASDAQ: Read more…

How Databricks Keeps Data Quality High with Delta

Apr 8, 2019 |

Data lakes have sprung up everywhere as organizations look for ways to store all their data. But the quality of data in those lakes has posed a major barrier to getting a return on data lake investments. Read more…

MapR to Autoscale Spark and Drill Via Prebuilt Kubernetes Containers

Apr 2, 2019 |

MapR Technologies today announced a technology preview of pre-built containers for Kubernetes that will give customers new capabilities for dynamically scaling their containerized Spark and Drill applications based on demand. Read more…

A Decade Later, Apache Spark Still Going Strong

Mar 8, 2019 |

Don’t look now but Apache Spark is about to turn 10 years old. The open source project began quietly at UC Berkeley in 2009 before emerging as an open source project in 2010. Read more…

Data Engineering Continues to Move the Employment Needle

Mar 5, 2019 |

Interested in a career in big data? You could do well by investing your time and effort in acquiring data science skills. But you may do even better by turning yourself into a data engineer, which is a title that continues to see substantial demand in the job market. Read more…

Microsoft Invests in Databricks

Feb 5, 2019 |

Databricks, the high-flying analytics startup founded by the creators of Apache Spark, announced yet another venture funding haul this week as it hustles to meet what it says is growing demand for its analytics platform. Read more…

Do NOT follow this link or you will be banned from the site!