Bigstep Adds Spark Service to Bare-Metal Cloud
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
December 11, 2019
- Promethium and Starburst Partner for Faster Self-Service Analytics
- WekaFS Selected by Innoviz to Accelerate AI for Autonomous Vehicle Innovations
- Yonder Leverages Snowflake and Zepl Tech to Give Brands Actionable Insights
- SkyWatch to Build AI-Based Autonomous Space Systems and Big Data Analytics for Canadian Space Agency
- TEC Eurolab Doubles Productivity with Data Management Solution
- Wasabi Partners with Globus to Simplify Data Management
- Broadcom Introduces Automation.ai
December 10, 2019
- Alation Extends the Data Catalog to Include Analytics Stewardship for the Enterprise
- Ascend Establishes Council to Explore the Data-Driven Transformation of Business, Technology, and Society
- Data Science Institute Researcher Designs Headphones That Warn Pedestrians of Dangers
- dotData Achieves Advanced Technology Partner Status in Amazon Web Services Partner Network
- Aerospike Announces the General Availability of Aerospike Version 4.8
- Luminoso Launches Responsible AI System for Text Analysis
- GigaIO Selected as Winner of Connect’s 2019 Most Innovative New Product Award for Big Data
December 9, 2019
- TIBCO’s Connected Intelligence Platform Supports FIA Formula One World Drivers’ Championship
- Three Providers of Open Source Object Storage for High Performance Workloads Named IDC Innovators
- Diamanti Introduces GPU Platform to Support Containerized Workloads on Kubernetes
December 6, 2019
- Scalyr Named as a Representative Vendor in AIOps Platforms by Gartner
- Sapience Analytics 6.5 Draws More Faceted Picture with Workforce Data
- Study: Businesses Recognize Importance of Digital Transformation but Struggle with Limited Resources
Most Read Features
- Deep Learning Has Hit a Wall, Intel’s Rao Says
- Big Data File Formats Demystified
- Will Databricks Build the First Enterprise AI Platform?
- How to Build a Better Machine Learning Pipeline
- Confluent Reveals ksqlDB, a Streaming Database Built on Kafka
- 10 Big Data Trends to Watch in 2019
- Kafka Transforming Into 'Event Streaming Database'
- Why Every Python Developer Will Love Ray
- Why Knowledge Graphs Are Foundational to Artificial Intelligence
- Operationalizing Analytics: Conquering the Last Mile
- More Features…
Most Read News In Brief
- California's New Data Privacy Law Takes Effect in 2020
- Global DataSphere to Hit 175 Zettabytes by 2025, IDC Says
- Mobile Coding is a Thing
- War Unfolding for Control of Elasticsearch
- Microsoft Aims for Data Analytics Unification with 'Synapse'
- HPE Acquires MapR
- Machine Learning Market Demonstrates Solid Growth
- Why Gartner Dropped Big Data Off the Hype Curve
- Intel Debuts New VPU Chip at AI Summit
- Gartner Sees AI Democratized in Latest 'Hype Cycle'
- More News In Brief…
Most Read This Just In
- Igneous DataProtect Now Supports Google Cloud Platform Storage
- Informatica Introduces Data Engineering Solution
- Huwei Announces Data infrastructure Strategy and the Open Sourcing of its Data Virtualization Engine HetuEngine
- AWS Announces Nine New Compute and Networking Innovations for Amazon EC2
- Wejo selects Databricks' Analtyics Platform to Help Create a Mobility Data Ecosystem
- Snowflake Launches Private Data Exchange
- TigerGraph Selected to Strengthen Fraud Detection and Credit Risk Assessment
- CockroachDB 19.2 Enables Enterprise to Build Global Applications with Strong Performance
- Striim Announces Incremental Data Capture from Google Cloud Spanner
- Talend Announces Availability of Talend Cloud in AWS Marketplace
- More This Just In…
January 26, 2020 - January 28, 2020Austin TX United States