Bigstep Adds Spark Service to Bare-Metal Cloud
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
August 4, 2020
- Yellowbrick Data and Emtec Enter Partnership
- cnvrg.io AI OS Delivers Accelerated ML Workloads with Support of NVIDIA A100 Multi-Instance GPU
- Domo Enhances its COVID-19 Global Tracker with Google and Apple Mobility Trends
- Quantum ActiveScale Software Verified as Veeam Ready Object Solution
- Striim Expands Cloud Support with the Release of Version 3.10.1
- Azure NetApp Files Now Available to Government Agencies in Microsoft Azure
- Duality Technologies, NumFOCUS to Develop Privacy-Preserving Analysis Platform
- KDD 2020 Announces Special Diversity & Inclusion Track
- Micro Focus Announces the General Availability of ArcSight 2020
- Baffle Unveils New Tableau Integration to Protect Data Analytics Pipeline
- Cyxtera Launches AI/ML Compute-as-a-Service Powered by NVIDIA DGX A100 Systems
August 3, 2020
- Wejo Announces £10M in New Funds to Support Next Stage of Growth
- Kyber Data Science Announces $10M Series A Financing Round
July 31, 2020
- Quantida Launches Complete Data Management and Analytics Solution
- New Tool to Guide Decisions on Social Distancing Uses Hospital Data and Emphasizes Protecting the Vulnerable
- Acrisure Acquires Tulco’s AI Insurance Business
- Talend Named a Leader in Gartner Magic Quadrant for Data Quality Solutions
- Hasura Releases Hasura Cloud
July 30, 2020
- Qumulo’s Cloud File Offerings Now Available in AWS Marketplace for AWS GovCloud (US)
- Entel Chooses OmniSci to Improve Customer Satisfaction
Most Read Features
- Big Data File Formats Demystified
- How to Build a Better Machine Learning Pipeline
- Is Python Strangling R to Death?
- How COVID-19 Is Impacting the Market for Data Jobs
- Is Hadoop Officially Dead?
- To Centralize or Not to Centralize Your Data–That Is the Question
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Understanding Your Options for Stream Processing Frameworks
- Hacking AI: Exposing Vulnerabilities in Machine Learning
- Tracking the Spread of Coronavirus with Graph Databases
- More Features…
Most Read News In Brief
- Researchers Explore Link Between American Individualism and Poor COVID-19 Response
- Left for Dead, R Surges Again
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- HPE Acquires MapR
- Why Gartner Dropped Big Data Off the Hype Curve
- Global DataSphere to Hit 175 Zettabytes by 2025, IDC Says
- Bitnine Looks to Scale PostgreSQL
- War Unfolding for Control of Elasticsearch
- IBM Brings Back a Netezza, Attacks Yellowbrick
- Kepler AutoML Targets Next-Gen Business Analysts
- More News In Brief…
Most Read This Just In
- UBS Launches Big Data Shareholder Activism Tool
- FortressIQ Launches Adaptive Computer Vision-Based Firewall for Data Privacy
- KNIME Analytics Platform 4.2 is Now Available
- Hazelcast, Sorint Expand Partnership to Address In-Memory Computing Adoption
- Privacera Raises $13.5M in Series A Funding
- Syniti Acquires Virtyx Technologies
- BP Invests $5M in Geospatial Analytics Software Company Satelytics
- Qubole Expands Integration with Informatica’s AI-driven Data Engineering Integration
- TileDB Closes $15M Series A to Expand its First Universal Data Engine
- MariaDB Platform X5 Adds New Distributed SQL
- More This Just In…