Tag: big data
Putting Your Data On the Table
One of the big breakthroughs in data engineering over the past seven to eight years is the emergence of table formats. Typically layered atop column-oriented Parquet files, table formats like Apache Iceberg, Delta, and A Read more…
Mythbust Your Way to Modern Data Management
Artificial intelligence (AI) – arguably the most data-hungry technology to exist – is roaring into the mainstream. The amount of data AI must crunch to produce content or respond to queries is voracious. Describing t Read more…
The VAST Potential for Hosting GenAI Workloads, Data
There is big data, and then there is VAST Data, which has emerged as one of the world’s hottest tech firms over the past year. The company, which started out as developer of flash storage arrays, has morphed into a ful Read more…
Nvidia Bolsters RAPIDS Graph Analytics with NetworkX Expansion
Nvidia has expanded its support of NetworkX graph analytic algorithms in RAPIDS, its open source library for accelerated computing. The expansion means data scientists can run 40-plus NetworkX algorithms on Nvidia GPUs w Read more…
Hiring GenAI Talent: It’s a Matter of Degree
Companies are scrambling to hire people to build generative AI solutions in 2024, as the GenAI hype rocket roars into the stratosphere. But the hiring is hampered by several factors, including the types of GenAI apps com Read more…
Neon Looks to Light Up Cloud Postgres Market
When it comes to relational databases, Postgres reigns supreme, especially in the cloud. However, running the open source database in the modern cloud manner leaves something to be desired. That’s the functionality gap Read more…
Data Engineering in 2024: Predictions For Data Lakes and The Serving Layer
The data landscape experienced significant changes in 2023, presenting new opportunities (and potential challenges) for data engineering teams. I believe we will see the following this year in the areas of analytics, Read more…
Alternative Data Isn’t So Alternative Anymore
Don’t look now, but alternative data is quickly becoming a requirement for success, at least in the financial services industry. That’s the conclusion of recent studies that find interest in alternative data in the f Read more…
Maximizing AI’s Impact with Master Data Management
When data or IT leaders invest in an AI solution, one of their goals is likely to make their organization’s data more actionable and accessible. However, research suggests many employees feel there is room for improvem Read more…
How Broad Is Your Database’s Data Ecosystem? Gartner Takes a Look
The days of databases existing as islands unto themselves are over, according to Gartner, which reports the existence of a strong and growing signal for cloud databases to become part of “broader data ecosystems.” La Read more…
What Will 2024 Bring to Advance Analytics?
As the amount of data continues to grow, so does the potential for advanced analytics to make sense of it all. In 2024, tremendous progress will be made in analytics, according to our merry band of prognosticators. It Read more…
Fourteen Big Data Predictions for 2024
Never before have the challenges of big data--how we store it, manage it, govern it, and use it--been so pressing. Advances in artificial intelligence may be the driving force in 2024, but that doesn’t mean a thing if Read more…
Enterprises Have Already Made Deep Investments in Data Infrastructure; With AI, They’ll Finally See a Return
The rise of generative AI has captured the imagination of tech enthusiasts and enterprise leaders alike. The promise–and risk–of AI is of a world transformed at a pace never seen before. Enterprises, both fledgling a Read more…
Why Samsara Picked Ray to Train AI Dashcams
When the engineers at Samsara began building their first smart dashcam several years ago, they found themselves using a series of different frameworks to collect data from the IoT devices, train the machine learning mode Read more…
Unlocking the Potential of AI and ML in Healthcare Today
The integration of artificial intelligence (AI) and machine learning (ML) in healthcare has brought about remarkable advancements in patient care, diagnosis, and treatment. These cutting-edge technologies have revolution Read more…
It’s Back to the Database Future for Exasol CEO Tewes
When Joerg Tewes last worked in the database business, the world was just becoming aware of the possibilities of non-relational data models. Fast forward 20 years, and NoSQL databases are commonplace across all industrie Read more…
The Five Biggest Threats to Data Democratization
Data democratization is a top priority for many enterprises. When employees have easy access to data, they can make decisions quicker, collaborate better, and gain important insights. Companies around the world are comin Read more…
Databricks Make a CDC Play with Arcion Acquisition
The quicker you can access transactional data directly from the change log of a database, the quicker you can do analytics or AI on it. That’s the basic math behind Databricks’ announcement today that it intends to a Read more…
Tristan Handy’s Audacious Vision of the Future of Data Engineering
Tristan Handy is a lot of things: co-creator of dbt, founder and CEO of dbt Labs, and self-described “startup person.” But besides leading dbt Labs to a $4 billion valuation, he is one more thing: An audacious dreame Read more…