Follow Datanami:

Tag: Data engineering

Snowflake Gives Everybody a Little Something at Summit

Whether you’re a data engineer building data pipelines, a data scientist creating AI models, or a CFO trying to minimize cloud spending, Snowflake gave you something today at its annual user conference in Las Vegas, Ne Read more…

Numbers Station Sees Big Potential In Using Foundation Models for Data Wrangling

A startup called Numbers Station is applying the generative power of pre-trained foundation models such as GPT-4 to help with data wrangling. The company, which is based on research conducted at the Stanford AI Lab, has Read more…

Meet Maxime Beauchemin, a 2023 Person to Watch

When it comes to prolific contributors to open source projects in the big data space, Maxime Beauchemin is definitely somebody you should know. As a data engineer at Airbnb, Beauchemin created multiple tools that he subs Read more…

Top 12 Datanami Stories of 2022

With another year almost behind us, it’s time to sit back and consider what we’ve just been through. It’s been another active 12 months in the big data space, with plenty of news for the intrepid big data reader. Read more…

Dataiku 11.1 Update Boosts Data Science and MLOps

Dataiku has unveiled the latest update to its data science and machine learning platform, Dataiku 11.1. This update includes improvements to existing capabilities as well as new features for data scientists, ML engineers Read more…

What’s Holding Up Progress in Machine Learning and AI? It’s the Data, Stupid

The lack of a solid data foundation and solid data workflows is preventing companies from making more progress with machine learning and AI, according to a new Forrester Consulting survey conducted on behalf of Capital O Read more…

No-code Analytics System Redbird Nabs $7.6M Seed

Redbird, a New York-based enterprise analytics operating system, announced it has raised $7.6 million in an oversubscribed seed round. The Redbird platform allows non-technical users to automate and unify analytics wo Read more…

Snowflake Reflects on 10 Years Passed, Ponders 10 Years Ahead

When Snowflake Computing was founded 10 years ago, the big data market looked much different than it does today. Momentum was building behind something called Hadoop, while cloud computing was viewed with suspicion. Desp Read more…

Why DataOps-Centered Engineering is the Future of Data

DataOps will soon become integral to data engineering, influencing the future of data. Many organizations today still struggle to harness data and analytics to gain actionable insights. By centering DataOps in their proc Read more…

Data Automation Poised to Explode in Popularity, Ascend.io Says

The amount of data automation deployed in the wild is quite small at the moment, but it’s set to grow significantly in the months to come as overworked data teams seek respites from grueling manual data tasks. That’s Read more…

The Modernization of Data Engineering at Capital One

Like many enterprises, Capital One Financial Corp. is in the process of democratizing employee access to data to improve profitability, lower risk, and increase customer satisfaction. But lowering the barriers to data ac Read more…

Coiled Finds Traction in Deploying Dask at Scale

When a data scientist is done playing around with a model and wants to run it at scale, she has several options. One potential avenue is Dask, the open source framework that parallelizes Python code. And since 2020, when Read more…

The Upcoming Year in Big Data: A 2022 Preview

The world of big data is a never-ending roller coaster of new technologies, new techniques, and an ever-growing tsunami of data. As we roll into 2022, we turn to the community of big data practitioners and solution provi Read more…

Snowflake Adds Python Support with Winter Release

In a nod to the growing importance of data science and AI development on its platform, Snowflake today unveiled that its upcoming Winter Release will support for executing code written in Python, which is the most popula Read more…

What’s Driving Python’s Massive Popularity?

Earlier this month, Python moved into the number one slot in the TIOBE Index, marking the first time in 20 years that a language named C or Java wasn’t at the top of the list. It’s a nice feather in Python’s cap, a Read more…

AI: It’s Not Just For the Big FAANG Dogs Anymore

It’s been said that AI has a 1% problem, that only the biggest tech firms—the Facebooks, Amazons, Apples, Netflixes, and Googles, or FAANGs, of the world--have the resources required to pull it off.  But thanks to t Read more…

Meet Sean Knapp, a 2021 Datanami Person to Watch

Getting data to the right place at the right time has never been more important than it is now. But for many organizations, the data movement task largely remains a manual affair. Sean Knapp founded Ascend.io because he Read more…

No-Coder Upsolver Aims to Ease Use of Cloud Data Lakes

Upsolver, the no-code data lake platform vendor, has closed a $25 million funding round this week, boosting total venture funding for its cloud analytics tools to about $42 million. The financing round announced Tuesd Read more…

Data Engineering Cloud Launched by Trifacta

Trifacta today launched what might be the world’s first cloud designed specifically for data engineering. Running on AWS, Microsoft Azure, and Google Cloud, the new Trifacta Data Engineering Cloud provides a place for Read more…

Data Labs Look to Boost ‘Data Fluency’

As the role of the data scientist expands, so too does the “data lab” product category which seeks to merge data science with the enterprise plumbing required for data-driven decision-making. Add to the list a new Read more…

Older Entries
Datanami