Follow Datanami:

Tag: data pipelines

Meet Sean Knapp, a 2021 Datanami Person to Watch

Getting data to the right place at the right time has never been more important than it is now. But for many organizations, the data movement task largely remains a manual affair. Sean Knapp founded Ascend.io because he Read more…

Data Labs Look to Boost ‘Data Fluency’

As the role of the data scientist expands, so too does the “data lab” product category which seeks to merge data science with the enterprise plumbing required for data-driven decision-making. Add to the list a new Read more…

AI Hypervisor Gets a GPU Boost

Sunlight, the U.K.-based specialist in virtualizing data-intensive applications, announced Nvidia GPU support for its “lightweight” hypervisor designed to boost the performance of edge AI deployments. GPU support Read more…

Octopai Brings ETL Reverse-Engineering Tool to Azure Data Factory

If you want to make good data-driven decisions, it’s critical for your data to be as accurate as possible. But ensuring the accuracy of data can be a difficult task in large enterprise environments with thousands of co Read more…

Peering Into the Crystal Ball of Advanced Analytics

The world of advanced analytics was evolving quickly at the end of 2020. And according to our panel of experts who volunteered predictions on the topic, the accelerated pace of change in advanced data analytics will cont Read more…

When it Comes to Data Transfer, 5G is Just the Beginning

If ever there was a technology tailor made for the world we currently live in, it’s 5G. Everything we do seems based on the need for speed and connectivity. High bandwidth and low latency enables hospital employees wor Read more…

Intel Buys Another AI Startup

Intel Corp. has quietly acquired another AI platform developer, Israeli-based Cnvrg.io. The acquisition, confirmed by Intel late Tuesday (Nov. 3) to the web site TechCrunch.com, is the latest in a flurry of deals by t Read more…

Cloud Data Integration Race Heats Up

Fivetran, the up-and-coming data integration specialist, announced a $100 million funding round this week as it sharpens competition with rivals such as Alooma and Stitch to provide integration services for cloud data wa Read more…

Data Lakes Get Structured

The explosion of unstructured and partially structured data has made traditional data lakes harder to manage. Adding to the challenge are “brittle” data pipelines that are time-consuming to create as well as ephemera Read more…

Data Privacy Startup Attracts Investors

BigID, the data privacy startup, announced its latest funding round this week as companies scramble to comply with new regulations on handling customer data. The $50 million funding round announced by BigID on Thursd Read more…

Serverless SQL Engine Targets Cloud Analytics

Qubole Inc., the cloud analytics vendor, has added a serverless engine to its platform aimed at simplifying complex tasks like creating data pipelines and server clusters used to scale analytics workloads in the cloud. Read more…

HPE Folds BlueData into AI Offerings

Hewlett Packard Enterprise is integrating its recently acquired BlueData software with its Apollo infrastructure and other services to offer new AI and analytics capabilities running on hybrid clouds. HPE, which acqui Read more…

Hitachi Ups Game for Managing Unstructured Data

Most enterprise data go unused, and according to some studies very little unstructured data in the form of text, audio and video makes its way into the hands of data analysts. Hence, data integrators see an opportunit Read more…

Databricks, Talend Expand Cloud Access to Spark

Databricks and Talend, the cloud data integration vendor, are joining forces to help data jockeys scale their integration efforts using the Apache Spark analytics engine hosted on Talend’s cloud. Databricks, the cre Read more…

Google Ups its AI Game

Google Cloud is rolling out an “AI Hub” supplying machine learning content ranging from data pipelines and TensorFlow modules. It also announced a new pipeline component for the Google-backed Kubeflow open-source pro Read more…

Rockset, SQL Cloud Service, Emerges from Stealth

An analytics and search startup launched by former Facebook engineers emerged from stealth mode this week with a cloud service that “runs SQL directly on raw data,” offering developers a quicker path from data to app Read more…

SnapLogic Adds GitHub, Container Support

More vendors are offering new integration tools for meeting growing enterprise demand for faster delivery of application software. Among the approaches is automating key elements of the continuous integration and continu Read more…

Google/ASF Tackle Big Computing Trade-Offs with Apache Beam 2.0

Trade-offs are a part of life, in personal matters as well as in computers. You typically cannot have something built quickly, built inexpensively, and built well. Pick two, as your grandfather would tell you. But appare Read more…

Kafka ‘Massively Simplifies’ Data Infrastructure, Report Says

What's behind the rapid rise in Apache Kafka? According to a new survey of Kafka users by Confluent, the commercial venture behind Kafka, the data pipeline's capability to "massively simplify" the IT infrastructure of en Read more…

Google Lauds Outside Influence on Apache Beam

Apache Beam started life as a decidedly Google-ish technology designed to mask the complexity inherent in building sophisticated analytic pipelines that run across distributed systems. But over the course of becoming a t Read more…

Datanami