Follow Datanami:

Tag: scala

Prophecy Spins Up Low-Code Data Pipeline Tool

In recent years, the shortage of data engineers has at times exceeded the shortage of data scientists. To help close the gap, a Silicon Valley startup called Prophecy today unveiled a low-code data engineering tool that Read more…

Snowflake Extends Its Data Warehouse with Pipelines, Services

Customers running atop Snowflake’s cloud data warehouse soon will find new functionality, including the ability to build ETL data pipelines in Python, as well as the ability to expose pre-built analytic routines as dat Read more…

Apache Spark Is Great, But It’s Not Perfect

Apache Spark is one of the most widely used tools in the big data space, and will continue to be a critical piece of the technology puzzle for data scientists and data engineers for the foreseeable future. With that said Read more…

Which Programming Language Is Best for Big Data?

Nothing is quite so personal for programmers as what language they use. Why a data scientist, engineer, or application developer picks one over the other has as much to do with personal preference and their employers' IT Read more…

First Look at Scio, a Scala API for Apache Beam

Apache Beam has emerged as a powerful new framework for building and running batch and streaming applications in a unified manner. In its first iteration, it offered APIs for Java and Python. Thanks to the new Scio API f Read more…

Data Science Platforms Seen as Difference-Makers

How will data scientists work in the future? Based on today's trends and a new survey by Forrester, it seems likely that much of the work that data scientists do will revolve around centralized platforms that help to org Read more…

Apache Spark Adoption by the Numbers

It's been about three years since Apache Spark burst onto the big data scene and became one of the hottest technologies on the planet. Judging by the numbers surrounding Spark's adoption—including things like salaries, Read more…

Skills Gap Also Includes ‘Failure to Communicate’

The data science skills gap continues to widen, with emerging automation tools like machine learning only just now starting to take up some of the slack. PayScale, the online salary database, released a report Tuesday (M Read more…

Skip the Ph.D and Learn Spark, Data Science Salary Survey Says

Prospective data scientists can boost their salary more by learning Apache Spark and its tied-at-the-hip language Scala than obtaining a Ph.D., a recent data science survey by O'Reilly suggests. In its 2015 Data Scien Read more…

Will Scala Take Over the Big Data World?

When it comes to picking a language for writing big data applications, developers have an embarrassment of riches at their disposal. Python and R have proven popular among data scientists, while Java has been the go-to l Read more…

Datanami