Follow Datanami:

Tag: big data

Putting Your Data On the Table

One of the big breakthroughs in data engineering over the past seven to eight years is the emergence of table formats. Typically layered atop column-oriented Parquet files, table formats like Apache Iceberg, Delta, and A Read more…

Mythbust Your Way to Modern Data Management

Artificial intelligence (AI) – arguably the most data-hungry technology to exist – is roaring into the mainstream. The amount of data AI must crunch to produce content or respond to queries is voracious. Describing t Read more…

The VAST Potential for Hosting GenAI Workloads, Data

There is big data, and then there is VAST Data, which has emerged as one of the world’s hottest tech firms over the past year. The company, which started out as developer of flash storage arrays, has morphed into a ful Read more…

Nvidia Bolsters RAPIDS Graph Analytics with NetworkX Expansion

Nvidia has expanded its support of NetworkX graph analytic algorithms in RAPIDS, its open source library for accelerated computing. The expansion means data scientists can run 40-plus NetworkX algorithms on Nvidia GPUs w Read more…

Hiring GenAI Talent: It’s a Matter of Degree

Companies are scrambling to hire people to build generative AI solutions in 2024, as the GenAI hype rocket roars into the stratosphere. But the hiring is hampered by several factors, including the types of GenAI apps com Read more…

Neon Looks to Light Up Cloud Postgres Market

When it comes to relational databases, Postgres reigns supreme, especially in the cloud. However, running the open source database in the modern cloud manner leaves something to be desired. That’s the functionality gap Read more…

Data Engineering in 2024: Predictions For Data Lakes and The Serving Layer

The data landscape experienced significant changes in 2023, presenting new opportunities (and potential challenges) for data engineering teams. I believe we will see the following this year in the areas of analytics, Read more…

Alternative Data Isn’t So Alternative Anymore

Don’t look now, but alternative data is quickly becoming a requirement for success, at least in the financial services industry. That’s the conclusion of recent studies that find interest in alternative data in the f Read more…

Maximizing AI’s Impact with Master Data Management

When data or IT leaders invest in an AI solution, one of their goals is likely to make their organization’s data more actionable and accessible. However, research suggests many employees feel there is room for improvem Read more…

Vital Lessons Burgeoning Technologies Can Learn From the Open Source Movement

The media landscape has been overwhelmed as of late with headlines about artificial intelligence, quantum computing, the metaverse, and other emerging technologies poised to cause significant disruption to our society. W Read more…

How Broad Is Your Database’s Data Ecosystem? Gartner Takes a Look

The days of databases existing as islands unto themselves are over, according to Gartner, which reports the existence of a strong and growing signal for cloud databases to become part of “broader data ecosystems.” La Read more…

What Will 2024 Bring to Advance Analytics?

As the amount of data continues to grow, so does the potential for advanced analytics to make sense of it all. In 2024, tremendous progress will be made in analytics, according to our merry band of prognosticators. It Read more…

Fourteen Big Data Predictions for 2024

Never before have the challenges of big data--how we store it, manage it, govern it, and use it--been so pressing. Advances in artificial intelligence may be the driving force in 2024, but that doesn’t mean a thing if Read more…

Enterprises Have Already Made Deep Investments in Data Infrastructure; With AI, They’ll Finally See a Return

The rise of generative AI has captured the imagination of tech enthusiasts and enterprise leaders alike. The promise–and risk–of AI is of a world transformed at a pace never seen before. Enterprises, both fledgling a Read more…

Why Samsara Picked Ray to Train AI Dashcams

When the engineers at Samsara began building their first smart dashcam several years ago, they found themselves using a series of different frameworks to collect data from the IoT devices, train the machine learning mode Read more…

Unlocking the Potential of AI and ML in Healthcare Today

The integration of artificial intelligence (AI) and machine learning (ML) in healthcare has brought about remarkable advancements in patient care, diagnosis, and treatment. These cutting-edge technologies have revolution Read more…

It’s Back to the Database Future for Exasol CEO Tewes

When Joerg Tewes last worked in the database business, the world was just becoming aware of the possibilities of non-relational data models. Fast forward 20 years, and NoSQL databases are commonplace across all industrie Read more…

The Five Biggest Threats to Data Democratization

Data democratization is a top priority for many enterprises. When employees have easy access to data, they can make decisions quicker, collaborate better, and gain important insights. Companies around the world are comin Read more…

Databricks Make a CDC Play with Arcion Acquisition

The quicker you can access transactional data directly from the change log of a database, the quicker you can do analytics or AI on it. That’s the basic math behind Databricks’ announcement today that it intends to a Read more…

Tristan Handy’s Audacious Vision of the Future of Data Engineering

Tristan Handy is a lot of things: co-creator of dbt, founder and CEO of dbt Labs, and self-described “startup person.” But besides leading dbt Labs to a $4 billion valuation, he is one more thing: An audacious dreame Read more…

Datanami