Tag: scala

First Look at Scio, a Scala API for Apache Beam

Nov 15, 2017 |

Apache Beam has emerged as a powerful new framework for building and running batch and streaming applications in a unified manner. In its first iteration, it offered APIs for Java and Python. Read more…

Data Science Platforms Seen as Difference-Makers

Jan 23, 2017 |

How will data scientists work in the future? Based on today’s trends and a new survey by Forrester, it seems likely that much of the work that data scientists do will revolve around centralized platforms that help to organize not just the data and the tools, but data scientists themselves. Read more…

Apache Spark Adoption by the Numbers

Jun 8, 2016 |

It’s been about three years since Apache Spark burst onto the big data scene and became one of the hottest technologies on the planet. Judging by the numbers surrounding Spark’s adoption—including things like salaries, attendance, and committers–the future of Spark looks quite bright. Read more…

Skills Gap Also Includes ‘Failure to Communicate’

May 17, 2016 |

The data science skills gap continues to widen, with emerging automation tools like machine learning only just now starting to take up some of the slack. PayScale, the online salary database, released a report Tuesday (May 17) on the state of the “skills economy” Read more…

Skip the Ph.D and Learn Spark, Data Science Salary Survey Says

Nov 4, 2015 |

Prospective data scientists can boost their salary more by learning Apache Spark and its tied-at-the-hip language Scala than obtaining a Ph.D., a recent data science survey by O’Reilly suggests.

In its 2015 Data Science Salary Survey, O’Reilly found strong correlations between those who used Apache Spark and Scala, and those who were paid more money. Read more…

Will Scala Take Over the Big Data World?

Aug 10, 2015 |

When it comes to picking a language for writing big data applications, developers have an embarrassment of riches at their disposal. Python and R have proven popular among data scientists, while Java has been the go-to language for those developing apps on Hadoop. Read more…

Spark Steals the Show at Strata

Feb 25, 2015 |

There was a lot of good stuff on display at last week’s Strata + Hadoop World conference. But if there was one product or technology that stood out from the pack, that would have to be Apache Spark, the versatile in-memory framework that is taking the big data world by storm. Read more…

Apache Spark and Java 8: The Big Data Team for 2015

Dec 11, 2014 |

Apache Spark with Java 8 is proving to be the perfect match for Big Data. Spark 1.0 was just released this May, and it’s already surpassed Hadoop in popularity on the Web. Read more…