Follow Datanami:

Tag: data pipeline

Google Doubles Down on Cloud Data Migration

Feb 21, 2019 |

Data integration startups have become prime acquisition targets as cloud analytics vendors look to beef up their migration capabilities.

What that in mind, Google Cloud announced this week it intends to acquire data migration specialist Alooma, a five-year-old Bay Area startup. Read more…

Streamsets Gets $35M for DataOps

Sep 11, 2018 |

StreamSets, which bills itself as the “air traffic control” tasked with preventing collisions from occurring with big data, today announced that it raised $35 million, which it will use to continue building its data operations, or DataOps, platform. Read more…

How to Build a Better Machine Learning Pipeline

Sep 5, 2018 |

Machine learning (ML) pipelines consist of several steps to train a model, but the term ‘pipeline’ is misleading as it implies a one-way flow of data.  Instead, machine learning pipelines are cyclical and iterative as every step is repeated to continuously improve the accuracy of the model and achieve a successful algorithm.   Read more…

Machine Teaching Will Drive Crowdsourced Cognition into the AI Pipeline

Jun 25, 2018 |

Building high-quality artificial intelligence (AI) is hard work. It’s a specialized discipline that historically has required highly skilled specialists, aka data scientists.

Any time you require some highly skilled, highly paid practitioner to accomplish something of value, you’ve introduced a bottleneck into that process. Read more…

How Disney Built a Pipeline for Streaming Analytics

May 14, 2018 |

The explosion of on-demand video content is having a huge impact on how we watch television. You can now binge watch an entire season’s worth of Grey’s Anatomy at one sitting, if that suits your fancy. Read more…

Apache Airflow to Power Google’s New Workflow Service

May 1, 2018 |

Apache Airflow, the workload management system developed by Airbnb, will power the new workflow service that Google rolled out today. Called Cloud Composer, the new Airflow-based service allows data analysts and application developers to create repeatable data workflows that automate and execute data tasks across heterogeneous systems. Read more…

How Netflix Optimized Flink for Massive Scale on AWS

Apr 30, 2018 |

When it comes to streaming data, it’s tough to find a company operating on a more massive scale than Netflix, which streams more than 125 million hours of TV shows and movies —  Read more…

The Cure for Chaos: Automating Your Data Pipeline

Apr 12, 2018 |

The number of SaaS applications companies use has exploded. Most SMBs use at least a dozen, which means customer data are spread across systems and departments.

So while customers can engage with businesses through more channels than ever — Read more…

Orchestrator Emerges to Speed ML Models to Production

Mar 6, 2018 |

As the pace of machine learning model development accelerates, vendors are beginning to offer orchestration tools designed to help data scientists manage the testing, retraining and redeployment of predictive analytics models with short shelf lives. Read more…

The Top Three Challenges of Moving Data to the Cloud

Jul 4, 2017 |

Most data-driven businesses have already or are looking to move their data from on-premises databases to the cloud in order to take advantage of its unlimited, on-demand storage and compute cycles. Read more…

Older Entries

Do NOT follow this link or you will be banned from the site!