Follow Datanami:

Tag: data engineer

Three Ways Companies Can Cope with the AI and Analytics Talent Crunch

With inflation in the United States at a 40-year high and unemployment near a 50-year low, these are tough times to attract and retain employees in just about every sector. When you add the growing demand for talent in h Read more…

How to Stop Failing at Data

Innovate or die. It’s one of the few universal rules of business, and it’s one of the main reasons we continue to invest so heavily in data. Only through data can we get the key insights we need to innovate faster, s Read more…

Bad Data Pipelines Costing Companies Big, Fivetran Finds

Stop us if you’ve heard this one before: Overworked data engineer builds faulty data pipeline, which leads to bad data, which leads to a bad outcome. It may be the same old song, but it’s also the current state of af Read more…

Battle for Data Pros Heats Up as Burnout Builds

“Tell me about your motherboard.” This bit of grim psychological humor accompanied a rather gruesome statistic in a recent data engineering survey, which found 78% of data engineers say they wished their jobs came wi Read more…

Hiring Outlook Bright for Data and Open Source Pros

While the future is uncertain for many types of jobs, folks in the tech business can rest easy knowing there is substantial demand for their services, particularly for data engineers, which was the focus of a new study f Read more…

Kinks in the Data Supply Chain

It goes without saying that having a good data supply chain is instrumental in being a data-driven organization. Without a smooth and repeatable process for acquiring, validating, and preparing data for downstream consum Read more…

Data Pros Are Maxed Out: Survey

The demands of the data-driven life are wearing on data professionals, according to survey results unveiled this week by data pipeline automation solution developer Ascend.io, which found that 96% of data professionals a Read more…

Data Salaries Get a COVID Bump

Data science and application development skills centered on AI, machine learning and cloud deployments remain in high demand, pushing salaries higher in a pandemic year that strained enterprise infrastructure. Accordi Read more…

Data Management Self Service is Key for Data Engineers–And Their Business

In a post-COVID-19 world, remote access has rapidly emerged as the new normal, for every organization. The shift to a remote-first world was already well underway. In fact, in 2019, 54% of U.S. workers reported working r Read more…

Dataiku’s Collaborative AI Platform Attracts New Investors

Dataiku, the enterprise AI platform vendor, again made the case this week its collaborative approach to data science is gaining enterprise adherents, announcing a $100 million funding round. The Series D funding round Read more…

Getting Data Scientists and Data Engineers on the Same Page

Like cats and dogs, data engineers and data scientists often seem like two incompatible species. Scientists love probabilities and experimentation, while engineers live for repeatability and efficiency. They have differe Read more…

How COVID-19 Is Impacting the Market for Data Jobs

The United States has shed nearly 10 million jobs in the past two weeks due to the COVID-19 shutdown, and there are some data science, data engineering, and data analytics positions among them. However, surveys indicate Read more…

Demand for Data Engineers Up 50%, Report Says

Looking to hire a data or machine learning engineer? You’re not alone, as those two positions are among the fastest growing jobs in the country, according to recent figures. The Dice 2020 Tech Job Report labeled dat Read more…

Kaskada Accelerates ML Workflow with Its Feature Store

There’s a lot of surface area in the typical data science workflow for the purveyors of automation to attack. What moves the needle for the folks at the startup Kaskada is the feature engineering and deployment stage, Read more…

2019: A Big Data Year in Review – Part One

At the beginning of the year, we set out 10 big data trends to watch in 2019. We correctly called some of what unfolded, including a renewed focus on data management and continued rise of Kubernetes (that wasn’t hard t Read more…

Don’t Overlook the Importance of Data Stewards

Data scientists may be the rock stars of big data, and data engineers currently are in high demand. But companies that are serious about creating a winning data strategy should carefully consider what a well-trained data Read more…

‘Data Scientist’ Title Evolving Into New Thing

Who is a data scientist, and what do they do? It's a worthy question, and one that's been asked an untold number of times over the years. But now it appears the job definition of the data scientist is changing into somet Read more…

From Big Beer to Big Data: Inside AB InBev’s Digital Transformation

With more than 500 beer brands and $55 billion in sales, Anheuser-Busch InBev is already the world's biggest beer company. And if all goes as planned with its digital transformation project, it will be the best beer comp Read more…

A Decade Later, Apache Spark Still Going Strong

Don't look now but Apache Spark is about to turn 10 years old. The open source project began quietly at UC Berkeley in 2009 before emerging as an open source project in 2010. For the past five years, Spark has been on an Read more…

Data Engineering Continues to Move the Employment Needle

Interested in a career in big data? You could do well by investing your time and effort in acquiring data science skills. But you may do even better by turning yourself into a data engineer, which is a title that continu Read more…

Datanami