Follow Datanami:

Tag: big data

Databricks Make a CDC Play with Arcion Acquisition

The quicker you can access transactional data directly from the change log of a database, the quicker you can do analytics or AI on it. That’s the basic math behind Databricks’ announcement today that it intends to a Read more…

Tristan Handy’s Audacious Vision of the Future of Data Engineering

Tristan Handy is a lot of things: co-creator of dbt, founder and CEO of dbt Labs, and self-described “startup person.” But besides leading dbt Labs to a $4 billion valuation, he is one more thing: An audacious dreame Read more…

Immuta Expands Hooks Into Starburst for Better Data Mesh Governance

Starburst and Trino users will have an easier time hammering their distributed data governance policies into place thank to a deeper set of data mesh integrations between the open data analytics engines and Immuta, the d Read more…

Self-Service Data Not Quite a Reality Yet, Capital One Software Says

As the business world continues to transform, it's becoming pretty clear that self-service data is gearing up to be a game-changer for many companies. There's a growing push for organizations to have data at their finger Read more…

How Large Language Models and Humans Can Make Strategic Decisions Together

Over the last year, Large Language Models (LLMs) have taken the world by storm. Much of the public was first exposed to the revolutionary abilities of LLMs when they were introduced to OpenAI's ChatGPT in late 2022. S Read more…

A Smarter Slice: Domino’s and MSFT in GenAI Hookup

Don’t look now, but your next pie could come with a tasty slice of generative AI. Microsoft and Domino’s Pizza yesterday unveiled a partnership that will see the new artificial intelligence technology incorporated Read more…

Using Streaming Data Applications to Power Decision-Making

How do businesses make timely decisions with efficiency? One approach uses streaming (real-time) data applications that collect, analyze, and offer insights about data as it is generated, as opposed to systems that store Read more…

Landing AI Seeks Speed and Simplicity for Computer Vision Apps

It may surprise you to learn that, despite the massive hype around large language models, investments in computer vision AI continue to be made. One of the companies accelerating development in this field is Andrew Ng’ Read more…

Are SSDs Required for Your Big Data Workflow? The Answer May Surprise You

Have you heard the buzz about the predicted death of hard disk drives (HDDs)? Some have gone all in on projections that the growth of SSD deployments will eliminate demand for HDDs within five years. Other industry analy Read more…

Databricks Versus Snowflake: Comparing Data Giants

Databricks and Snowflake have emerged as predominant providers of big data analytics platforms in the cloud. While there are some similarities between the two rivals, there are also important differences in their offerin Read more…

Google Cloud Rolls Out Data Clean Rooms

Google Cloud today unveiled a preview of data clean rooms in BigQuery that will enable companies to share sensitive data while protecting security and privacy. Data clean rooms have proliferated in recent years as com Read more…

Data Mesh 2.0: Realizing the Promise of Decentralization

It’s fair to say that "data mesh" is having a moment. Even a cursory search via Google News turns up dozens of related results, and there’s considerable variety in the mix. Sure, this happens with many new technol Read more…

Duet AI Goes Everywhere in Google’s Cloud

Google Cloud introduced several more uses for Duet AI, the AI interface unveiled earlier this year. Data engineers will be singing duets with integrations for BigQuery, AlloyDB, and Cloud Spanner, while data analysts wil Read more…

Virtualitics Takes Data Viz Tech from Stars to Wall Street

You can’t know what you can’t see. That sums up the approach to data by Virtualitics, which was spun out of Caltech to commercialize AI-powered data visualization technology originally developed for astronomy. With t Read more…

Navigating Data Access Management Strategies: Build Vs. Buy

In today's data-driven world, effectively managing access to a growing volume of cloud-based data is an ongoing challenge for most companies. With over 60% of all corporate data now stored in the cloud, it is a delicate Read more…

In Search of Data Model Repeatability

Everybody wants to be data-driven--that much is clear. But that desire doesn’t necessarily translate into real business results, especially in competitive industries like ecommerce. Data quality has long been a burr Read more…

Redis Delivers First Big Release Under New CEO Trollope

Redis today unleashed a torrent of new functionality in the database, including vector search, native triggers, and a built-in change data capture capability, among others. The features reflect priorities that new CEO Ro Read more…

Unravel Keeps Tabs on BigQuery Usage Following Pricing Changes

Google Cloud last month changed how it charges for BigQuery, its flagship offering for SQL analytics on structured data and machine learning on unstructured data. Customers concerned about keeping their BigQuery budget o Read more…

Lightup Seeks Data Quality Automation

One of the challenges in data observability is the effort required to develop all the data quality indicators (DQIs) enterprises need to monitor production databases. All too often, companies are left to write their own Read more…

Inside Pandata, the New Open-Source Analytics Stack Backed by Anaconda

Anaconda made some news yesterday when it announced support for Pandata, a new open-source stack. But just what is Pandata, and should it be on your big data radar? According to the Pandata GitHub page, Pandata is a c Read more…

Datanami