Follow Datanami:

Tag: Spark

Aerospike Turbocharges Spark ML Training with Pushdown Processing

Companies that need to access a lot of data in a hurry, such as retraining a machine learning model in Spark, have traditionally had to move that data from the edge to a central repository, such as a cloud data lake. But Read more…

Informatica Accelerates DataOps with Spark, GPUs

Informatica today announced that customers can see up to a 5x performance boost for ETL and data management workloads when they run them under its new cloud-based data integration engine that’s powered by Apache Spark Read more…

Prophecy Spins Up Low-Code Data Pipeline Tool

In recent years, the shortage of data engineers has at times exceeded the shortage of data scientists. To help close the gap, a Silicon Valley startup called Prophecy today unveiled a low-code data engineering tool that Read more…

LinkedIn’s Translation Engine Linked to Presto

An SQL translation engine unveiled this week by LinkedIn is integrated with other open-source SQL query engines like Presto in a combination aimed at bulging data lakes. The Microsoft unit’s Coral engine handles ana Read more…

Data Exchange Maker Harbr Closes Series A

Harbr, a London startup that helps organizations like Moody’s Analytics to create their own custom data exchanges, yesterday announced that it has completed a Series A round of financing, netting $38.5 million for the Read more…

The Past and Future of In-Memory Computing

When Nikita Ivanov co-founded GridGain Systems back in 2005, he envisioned in-memory computing going mainstream and becoming a massive category unto itself within a few years. That obviously didn’t pan out, but on the Read more…

Aerospike Gives Legacy Infrastructure a Real-Time Boost

A database connector upgrade released this week by Aerospike Inc. links open source frameworks like Apache Spark data streaming to existing enterprise data infrastructure. Among the goals is providing backward compati Read more…

Microsoft Now Developing Its Own Hadoop

Hadoop might be dead, but that’s not stopping public cloud providers from using it. The latest to make a move is Microsoft Azure, which in July announced that it would begin developing its own distribution under its HD Read more…

To Centralize or Not to Centralize Your Data–That Is the Question

Should you strive to centralize your data, or leave it scattered about? It seems like it should be a simple question, but it’s actually a tough one to answer, particularly because it has so many ramifications for how d Read more…

Intel Updates Optane, Expands NAND SSD Offerings

Intel Corp. remains persistent in upgrading its Optane persistent memory series. The chip maker (NASDAQ: INTC) said this week its second generation Optane series is tuned to the latest version of its Xeon Scalable proce Read more…

Older Entries
Datanami