Follow Datanami:
May 13, 2014

Concurrent and Databricks Partner

SAN FRANCISCO and BERKELEY, Calif., May 14 — Concurrent, Inc., the enterprise data application platform company, and Databricks, the company founded by the creators of Apache Spark, today announced a strategic partnership to enable Cascading to seamlessly operate over Spark, a next generation Big Data processing engine that supports batch, interactive and streaming workloads at scale. This partnership will enable both companies to meet customer demand for simpler and more flexible enterprise application development and give the thousands of enterprises using Cascading the ability to leverage Spark, which is now a part of all major Hadoop distributions, and also available from enterprise database and NoSQL vendors.

While enterprises are heavily investing in building data-centric applications to operationalize their data, these data applications must be able to meet business requirements that vary in latency, scale and service levels. To meet these requirements, enterprises are leveraging Spark’s unique in-memory computing capabilities and full breadth of functionality to deliver the necessary speed and sophistication required for data processing at scale.

Enterprises looking to run their data applications on Spark will be able to leverage Cascading, the proven framework that simplifies enterprise application development. With more than 150,000 downloads a month, Cascading is the enterprise development framework of choice for building data-centric applications, and can soon be utilized to build robust data applications and deploy them at scale on Spark. This ability provides enterprises the flexibility to easily adapt their data applications to meet business challenges and solve a variety of business problems ranging from simple to complex, regardless of latency or scale.

Concurrent and Databricks are empowering enterprises to simplify their data application development, while providing the flexibility and performance benefits of Spark. Developers can leverage Cascading’s framework for robust, easy and seamless application development with Spark’s execution engine for maximum performance and versatility. These benefits extend to any Cascading-based dynamic programming language, including Scalding, Cascalog, Lingual, Pattern and Driven. With Driven, enterprises will gain operational visibility to their data applications running on Spark, accelerating the time to market for their applications.

Cascading will add Spark support in the near future and both are freely licensable under the Apache 2.0 License Agreement. For more information and notification of availability please visit us at http://www.cascading.org/spark-support/.

Datanami