Follow Datanami:

Elastic Launches Search AI Lake to Scale Low Latency Search

The rapidly growing scale of data has led to the emergence of data lakes, which offer a centralized repository for the storage of structured and unstructured data at any scale. Data lakes architecture often separates com Read more…

AI Impacting Data Engineering Faster Than Expected, dbt Labs’ Handy Says

We’re in the midst of a revolution thanks to generative AI. There’s no denying that. And while dbt Labs CEO Tristan Handy was expecting the AI revolution to eventually come to the world of big data and analytics engi Read more…

New GenAI Models On Tap from Google, OpenAI

OpenAI and Google released major updates to their AI models this week, including OpenAI’s release of GPT-4o, which adds audio interactions to the popular LLM, and Google’s launch of Gemini 1.5 Flash and Project Astra Read more…

Forrester Slices and Dices the Vector Database Market

The large language model (LLM) revolution has transformed vector databases from obscure search tech into must-have products for AI success. But which vector database features should you look for, and which vendors are in Read more…

DataForge Sets New Standard for the Future of Data Platforms

Data engineering often requires the utilization of SQL scripting for data transformation within the database. However, this can result in lengthy scripts, recurring copy-paste patterns, the need for schema changes across Read more…

Databricks Announces Major Updates to Its AI Suite to Boost AI Model Accuracy

Last year in December, Databricks, a leading provider of data intelligence and AI solutions, announced a new suite of tools to get GenAI applications to production using Retrieval Augmented Generation (RAG). Since then, Read more…

BigID Introduces Industry-First Hybrid Scanning for Cloud Native Workloads

In the era where organizations are looking to accelerate their migration to cloud infrastructure, a new technology advancement for cloud-native workloads has emerged - hybrid scanning. BigID, a data discovery and inte Read more…

StarTree Finds Apache Pinot the Right Vintage for IT Observability

Apache Pinot grew popular among companies like Uber for its capability to serve SQL queries to thousands of external users with sub-second latency. Now the commercial open-source vendor backing Pinot, StarTree, announced Read more…

Anaconda Rejiggers Approach to Boost Growth Under New CEO

Anaconda created a name for itself in the data science community over the past decade by combining hundreds of the most popular Python-based statistical and machine learning packages, such as NumPy, Pandas, and SciPy, in Read more…

GenAI Is Putting Data in Danger, But Companies Are Adopting It Anyway

There are serious questions about maintaining the privacy and security of data when using generative AI applications, yet companies are rushing headlong to adopt GenAI anyway. That’s the conclusion of a new study relea Read more…

What Is the American Privacy Rights Act, and Who Supports It?

The American Privacy Rights Act of 2024 (APRA), a proposed federal data privacy law that was introduced last month by Congresswomen from Washington State, is currently making its way through both halls of Congress. If ap Read more…

Confluent Expands Apache Flink Capabilities to Simplify AI and Stream Processing

Confluent, the data streaming pioneer, announced last month the general availability of Confluent Cloud for Apache Flink, enabling users to experience Apache Kafka and Flink as a unified, enterprise-grade platform.  Read more…

The Semi-Autonomous Agents of Amazon Q

Amazon Web Services (AWS) says business productivity will soar as a result of Amazon Q, its new generative AI service that became generally available this week. In particular, the capability to deploy semi-autonomous AI Read more…

LinkedIn Implements New Data Trigger Solution to Reduce Resource Usage For Data Lakes

With its vast user base and the numerous interactions that occur daily, LinkedIn generates an enormous amount of data every day. The billions of data points fuel various applications, from rankings to search. The additio Read more…

DataRobot ‘Guard Models’ Keep GenAI on the Straight and Narrow

Businesses are eager to deploy generative AI applications, but fears over toxic content, leaks of sensitive data, and hallucinations are giving them pause. One potential solution is to deploy “guard models” alongside Read more…

ASF Unveils the Next Evolution of Big Data Processing With the Launch of Hive 4.0

The recently released Apache Hive 4.0 by Apache Software Foundation (ASF) marks a significant milestone in the progress of data lake and data warehouse technologies.  In the world of big data processing tools, Apache Read more…

The Synergy Between Knowledge Graphs and Large Language Models

Extracting valuable insights from unstructured text is a critical application in the finance industry. However, this task often goes beyond simple data extraction and necessitates advanced reasoning capabilities. A pr Read more…

Datanami