Bigstep Adds Spark Service to Bare-Metal Cloud
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
October 14, 2019
- Woodbury University Launches Computer Science in Data Analytics Program
- Japanese Researcher Wins Award for Applying Data Mining Tech to Analyze Big Data in Business Marketing
- NFL Launches Second Annual Big Data Bowl Competition
- H2O.ai Announces Additional Speakers for H2O World New York 2019
- SAS Announces Keynote Speakers for Analytics Experience 2019 in Milan
October 11, 2019
- Stanley, Black & Decker Selects DataRobot to Supersize Data Science Efforts
- Talend Cloud Now Available on Microsoft Azure
- Igneous DataProtect Now Available on AWS Marketplace
October 10, 2019
- Diveplane’s GEMINAI Enables Organizations to Safely Share, Sell and Analyze Datasets
- UC Berkeley Launches Data Science Minor Program
- Neo4j Launches Program to Empower Educators
- Hitachi Vantara Expands Lumada Portfolio to Accelerate Data Innovation Through DataOps
- Intelligent Waves Awarded $89M Contract for Crowd-Sourced Data Support
- Domo’s New Solution to Help Merchants with Multiple Square Accounts Unlock Real-Time Business Insights
- Anaconda Appoints Peter Wang as CEO
- Hitachi Vantara Partners with Disney Parks to Advance the Next Generation of Ride and Show Analytics
October 9, 2019
- Syniti Unveils Knowledge-Based Advanced Data Migration Cloud Software
- Kinetica’s Active Analytics Platform is Now Available in the Oracle Cloud Marketplace
- Report: European Companies Moving to Cloud Lagging on Security
- Fujitsu Launches New Stream Data Processing Platform to Accelerate Use of Automotive Big Data
Most Read Features
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Kafka Transforming Into ‘Event Streaming Database’
- Big Data File Formats Demystified
- Is Python Strangling R to Death?
- Cloudera Begins New Cloud Era with CDP Launch
- Can We Stop Doing ETL Yet?
- 10 Big Data Trends to Watch in 2019
- Hadoop Has Failed Us, Tech Experts Say
- How to Build a Better Machine Learning Pipeline
- Is Hadoop Officially Dead?
- More Features…
Most Read News In Brief
- Kafka Spawns Open-Source KarelDB
- California’s New Data Privacy Law Takes Effect in 2020
- HPE Acquires MapR
- War Unfolding for Control of Elasticsearch
- MapR Says It’s Close to Deal to Sell Company
- What to Expect at Strata This Week
- Global DataSphere to Hit 175 Zettabytes by 2025, IDC Says
- Gartner: Augmented Analytics Ready for Prime Time
- Presto Moves Under Linux Umbrella
- IBM Adds Kubernetes Operator for CouchDB
- More News In Brief…
Most Read This Just In
- Datanami Announces 2019 Readers’ and Editors’ Choice Award Winners
- Biogen Chooses Lexalytics to Improve Customer Care with New AI-Based Text Analytics System
- New Cloudera Study Shows Current Enterprise Data Strategies Ineffective
- Aimia Selects H2O.ai Driverless AI for its Customer Loyalty Programs
- TIBCO Announces Beta Program for its Cloud-Native Enterprise Metadata Solution
- DataVisor Named a Global Leader in Cloud Computing
- Aerospike Now Supports Intel Ethernet 800 Series with Application Device Queues Technology
- DataRobot Enhances Enterprise AI Platform, Further Automating the Path from Data to Value
- Syncsort Survey Reveals Disconnect Between Data Trust and Data Quality
- ArangoDB Extends Open Source Solution with ArangoML Pipeline
- More This Just In…
October 20 - October 22Charlotte NC United States
October 23 - October 24Berlin Germany