Tag: data pipeline
Feb 24, 2021 |
In recent years, the shortage of data engineers has at times exceeded the shortage of data scientists. To help close the gap, a Silicon Valley startup called Prophecy today unveiled a low-code data engineering tool that enables users to build Spark-based data pipelines in a drag-and-drop manner. Read more…
Jun 2, 2020 |
Snowflake has changed how the industry thinks about data warehouses with its cloud-native offering, which has been adopted by 4,000 organizations, including 2,000 in the last year alone. Now the company is taking the concept one step further with the introduction of a data cloud, which the company is positioning as a one-stop shop where organizations can execute a full range of data-oriented tasks – not just data warehousing and SQL analytics, but also machine learning, data engineering, and monetization of third-party data. Read more…
Dec 12, 2019 |
Data pipelines are being constructed everywhere these days, moving huge swaths of data for a wide variety of operational and analytical needs. There’s no doubt that all these data pipelines are keeping data engineers busy and in high demand (and highly paid, to boot). Read more…
Sep 5, 2019 |
Apache Spark gives developers a powerful tool for creating data pipelines for ETL workflows, but the framework is complex and can be difficult to troubleshoot. StreamSets is aiming to simplify Spark pipeline development with Transformer, the latest addition to its DataOps platform. Read more…
Apr 24, 2019 |
Databricks today announced that it’s open sourcing the code behind Databricks Delta, the Apache Spark-based product it designed to help keep data neat and clean as it flows from sources into its cloud-based analytics environment. Read more…
Apr 24, 2019 |
The industry has largely settled on the notion of a data pipeline as a means of encapsulating the engineering work that goes into collecting, transforming, and preparing data for downstream advanced analytics and machine learning workloads. Read more…
Apr 11, 2019 |
With more than 500 beer brands and $55 billion in sales, Anheuser-Busch InBev is already the world’s biggest beer company. And if all goes as planned with its digital transformation project, it will be the best beer company in the world, too. Read more…
Feb 21, 2019 |
Data integration startups have become prime acquisition targets as cloud analytics vendors look to beef up their migration capabilities.
What that in mind, Google Cloud announced this week it intends to acquire data migration specialist Alooma, a five-year-old Bay Area startup. Read more…
Sep 11, 2018 |
StreamSets, which bills itself as the “air traffic control” tasked with preventing collisions from occurring with big data, today announced that it raised $35 million, which it will use to continue building its data operations, or DataOps, platform. Read more…
Solution Providers
Tabor Network
Featured Events
-
Data Science Salon – Applying AI & Machine Learning To Media, Advertising & Entertainment
May 4 - May 5 -
ASF Roundtable – Harnessing Big Data: Constructing Data Pipelines
May 13 @ 11:00 am - 12:30 pm