Tag: data pipeline

How Disney Built a Pipeline for Streaming Analytics

May 14, 2018 |

The explosion of on-demand video content is having a huge impact on how we watch television. You can now binge watch an entire season’s worth of Grey’s Anatomy at one sitting, if that suits your fancy. Read more…

Apache Airflow to Power Google’s New Workflow Service

May 1, 2018 |

Apache Airflow, the workload management system developed by Airbnb, will power the new workflow service that Google rolled out today. Called Cloud Composer, the new Airflow-based service allows data analysts and application developers to create repeatable data workflows that automate and execute data tasks across heterogeneous systems. Read more…

How Netflix Optimized Flink for Massive Scale on AWS

Apr 30, 2018 |

When it comes to streaming data, it’s tough to find a company operating on a more massive scale than Netflix, which streams more than 125 million hours of TV shows and movies —  Read more…

The Cure for Chaos: Automating Your Data Pipeline

Apr 12, 2018 |

The number of SaaS applications companies use has exploded. Most SMBs use at least a dozen, which means customer data are spread across systems and departments.

So while customers can engage with businesses through more channels than ever — Read more…

Orchestrator Emerges to Speed ML Models to Production

Mar 6, 2018 |

As the pace of machine learning model development accelerates, vendors are beginning to offer orchestration tools designed to help data scientists manage the testing, retraining and redeployment of predictive analytics models with short shelf lives. Read more…

The Top Three Challenges of Moving Data to the Cloud

Jul 4, 2017 |

Most data-driven businesses have already or are looking to move their data from on-premises databases to the cloud in order to take advantage of its unlimited, on-demand storage and compute cycles. Read more…

How Pandora Uses Kafka

May 31, 2017 |

As a big Hadoop user, Pandora Media is no stranger to distributed processing technologies. But when the music streaming service decided to transition its ad tracking system from a batch-oriented system into a real-time one, it brought in a new technological underpinning to serve as the core foundational element. Read more…