Follow Datanami:

Tag: big data

Has Macrometa Cracked the Code for Global, Real-Time Data?

There are plenty of organizations trying to solve one tough problem: How do you combine real-time and historical data in a distributed context, and trust the results of your queries? Plenty of companies have tried to sol Read more…

Social Listening: The Sweet Spot of Food and Beverage Online Tracking

Remember the days when consumers registered their product thoughts and comments to the manufacturer by dialing an 800 toll-free number? The process was often a frustrating experience that included long hold times and spe Read more…

LinkedIn Donates Feature Store to Linux Foundation

LinkedIn today announced that its open source feature store, dubbed Feathr, is joining LF AI & Data, the Linux Foundation’s umbrella foundation for big data and AI projects. Feathr was originally developed at Li Read more…

How DataOps Strengthens Business Resilience and Agility

Agility is critical for any business looking to grow and remain relevant in today’s complicated industry landscape. Being able to quickly respond and reliably deliver actionable insights is vital for businesses — esp Read more…

The Cloud Is Great for Data, Except for Those Super High Costs

The cloud has revolutionized the fields of advanced analytics and AI, as well as IT as a whole. Companies now have access to practically limitless storage and compute resources for crunching massive datasets and training Read more…

Why AI Alone Won’t Solve Drug Discovery

Verseon is an AI-powered drug company--in theory, anyway. The Bay Area startup does use machine learning to help predict which combination of molecules will yield novel compound to test in the lab. With over a dozen drug Read more…

Cloud Migrations Negatively Impacting Data Estates, Capital One Says

We’re in the midst of a massive migration of data to the cloud at the moment, driven in large part by the promises of advanced analytics and AI and the competitive advantages they can bring. However, before getting thi Read more…

These 15 Data Fabrics Made the Cut in Forrester’s Wave

If you’re in the market for a data fabric, then you might be interested in a recent report from Forrester, which published a Wave report in June detailing the pros and cons of more than a dozen data fabrics offerings. Read more…

Swim Maintains a Steady State Amid Fast-Moving Data

Things move quickly in the world of real-time streaming. In some cases, companies want to track millions of events per second. Staying on top of these data volumes can be extremely challenging for traditional stateless c Read more…

Second Half 2022 Tech Predictions for Data and AI

As we emerge from halftime of the show that is the year 2022, it’s time to take stock of where we’ve come this year in big data, advanced analytics, and AI, and assess where we’re likely to go next. Based on whe Read more…

The History of Data Science: From Cave Paintings to Big Data

It is in the nature of human beings to want to make sense of the world around them. This has led to humans trying to organize things and think in a data-centric way from as early as prehistoric times. Data science is Read more…

What Is Categorical Data?

According to a 2020 Microstrategy survey, 94% of enterprises report data and data analytics are crucial to their growth strategy. And yet, surprisingly, as much as 73% of the data that enterprises collect is never used, Read more…

Data Is Everywhere, But Harvest Your Own for Peak AI Performance

The rapid proliferation of data marketplaces has made it easy for organizations to get their hands on third-party data. And pre-trained deep learning models are also readily available on the Internet. But just as plastic Read more…

Artificial Intelligence in AP Automation – A Look at What Really Works, and What Doesn’t

How the term "artificial intelligence" is defined and whether there can even be a canonical definition at all is currently a matter of debate in information technology, neuroscience, philosophy, and linguistics. Commonly Read more…

Short-Staffed IT Teams Need Unified Observability to Turn Insights into Action

The world has changed around IT teams. The basic formula may be the same—ensure the performance, accessibility and security of their organizations’ systems, services and applications. But the environment surrounding Read more…

Soda Envisions Data Reliability as Code with SodaCL

Soda today announced the general availability of Soda Checks Language (SodaCL), a new domain specific language designed to enable data engineers to deliver data reliability checks as code within Soda Core, a new framewor Read more…

Three Ways Portable Data Skills Provide Job Security In 2022

The global COVID-19 pandemic ushered in many structural changes within our society, chief among them being the Great Resignation. A survey conducted by the Pew Research Center found that the main reasons why employees ha Read more…

Why the Open Sourcing of Databricks Delta Lake Table Format Is a Big Deal

Databricks introduced Delta back in 2019 as a way to gain transactional integrity with the Parquet data table format for Spark cloud workloads. Over time, Delta evolved to become its own table format and also to become m Read more…

Databricks Opens Up Its Delta Lakehouse at Data + AI Summit

Databricks, which had faced criticism of running a closed lakehouse, is open sourcing most of the technology behind Delta Lake, including its APIs, with the launch of Delta Lake 2.0. That was one of a number of announcem Read more…

A/B Test Like You’re Airbnb

A/B testing is a critical and oft-overlooked element of data science at high-flying tech firms like Google, Netflix, and Uber, but it can be difficult to set up a testing infrastructure. Now you can implement A/B testing Read more…

Older Entries
Datanami