Follow Datanami:

Tag: scala

Prophecy Spins Up Low-Code Data Pipeline Tool

In recent years, the shortage of data engineers has at times exceeded the shortage of data scientists. To help close the gap, a Silicon Valley startup called Prophecy today unveiled a low-code data engineering tool that Read more…

Snowflake Extends Its Data Warehouse with Pipelines, Services

Customers running atop Snowflake’s cloud data warehouse soon will find new functionality, including the ability to build ETL data pipelines , as well as the ability to expose pre-built analytic routines as data service Read more…

Apache Spark Is Great, But It’s Not Perfect

Apache Spark is one of the most widely used tools in the big data space, and will continue to be a critical piece of the technology puzzle for data scientists and data engineers for the foreseeable future. With that said Read more…

Which Programming Language Is Best for Big Data?

Nothing is quite so personal for programmers as what language they use. Why a data scientist, engineer, or application developer picks one over the other has as much to do with personal preference and their employers' IT Read more…

First Look at Scio, a Scala API for Apache Beam

Apache Beam has emerged as a powerful new framework for building and running batch and streaming applications in a unified manner. In its first iteration, it offered APIs for Java and Python. Thanks to the new Scio API f Read more…

Data Science Platforms Seen as Difference-Makers

How will data scientists work in the future? Based on today's trends and a new survey by Forrester, it seems likely that much of the work that data scientists do will revolve around centralized platforms that help to org Read more…

Apache Spark Adoption by the Numbers

It's been about three years since Apache Spark burst onto the big data scene and became one of the hottest technologies on the planet. Judging by the numbers surrounding Spark's adoption—including things like salaries, Read more…

Skills Gap Also Includes ‘Failure to Communicate’

The data science skills gap continues to widen, with emerging automation tools like machine learning only just now starting to take up some of the slack. PayScale, the online salary database, released a report Tuesday (M Read more…

Skip the Ph.D and Learn Spark, Data Science Salary Survey Says

Prospective data scientists can boost their salary more by learning Apache Spark and its tied-at-the-hip language Scala than obtaining a Ph.D., a recent data science survey by O'Reilly suggests. In its 2015 Data Scien Read more…

Will Scala Take Over the Big Data World?

When it comes to picking a language for writing big data applications, developers have an embarrassment of riches at their disposal. Python and R have proven popular among data scientists, while Java has been the go-to l Read more…

Spark Steals the Show at Strata

There was a lot of good stuff on display at last week's Strata + Hadoop World conference. But if there was one product or technology that stood out from the pack, that would have to be Apache Spark, the versatile in-memo Read more…

Apache Spark and Java 8: The Big Data Team for 2015

Apache Spark with Java 8 is proving to be the perfect match for Big Data. Spark 1.0 was just released this May, and it's already surpassed Hadoop in popularity on the Web. Java 8, the latest version, came out in March an Read more…

Datanami