
Bigstep Adds Spark Service to Bare-Metal Cloud

(phipatbig/Shutterstock)
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
Recent items:
Unraveling Hadoop and Spark Performance Mysteries
Overcoming Spark Performance Challenges in Enterprise Hadoop Environments
January 22, 2021
January 21, 2021
- Narrative Unveils Universal Onboarding Self-Service Solution for Onboarding Offline Customer Data
- VAST Data Unveils Joint Reference Architecture with NVIDIA for Large-scale AI Workloads
- GridGain Continues its Strong Momentum in 2020
- Abu Dhabi Dept of Culture and Tourism Drives Data-driven Digital Transformation with Informatica
January 20, 2021
- GigaSpaces Doubles Annual Recurring Revenues, Fueled by New Product Innovations in 2020
- Emerson Receives 2021 IoT Breakthrough Award for ‘Analytics Platform of the Year’
- John Snow Labs Releases Annotation Lab 1.1 with Improvements to Speed, Accuracy and Productivity
- Behavox Partners with Red Box to Enhance Value of Voice Data Analytics
- UK Enterprises Look for Help with Rising Volume of Data
- PSU Data Science Seed Grant Program Accepting Proposals Until Feb. 1
January 19, 2021
- More US Companies Embracing Analytics to Improve Operations and Grow During COVID-19
- Hot Cloud Storage Provider Wasabi Fuels Continued Growth with $27.5M Funding Round
- ScaleOut Software Announces Tools for its Real-time Digital Twins for Streaming Analytics
- Datatron Releases New Governance Dashboard
- NIH and PhysIQ Complete Initial Phase of COVID-19 Digital Biomarker Development
- Palantir Providing Technology to Enhance Safety of Electric Grid in California
- Fivetran Expands Enterprise Data Integration with Release of New Data Source Connectors
- Splice Machine Launches Feature Store to Simplify Feature Engineering
- Teradata Vantage Now Available on the Google Cloud Marketplace
Most Read Features
- 2021 Predictions: Data Science
- Dremio Officially a ‘Unicorn’ As it Reaches $1B Valuation
- Big Data File Formats Demystified
- Peering Into the Crystal Ball of Advanced Analytics
- The Maturation of Data Science
- Why Data Science Is Still a Top Job
- 2021 Prediction from the Edge and IoT
- Is Python Strangling R to Death?
- Big Data Predictions: What 2020 Will Bring
- Predictive Maintenance Drives Big Gains in Real World
- More Features…
Most Read News In Brief
- Update: Elastic Shifts Licensing Terms, Citing Amazon Moves
- A Virtual Ride Along with John Deere at CES
- War Unfolding for Control of Elasticsearch
- PG&E Deploys Palantir’s Foundry Platform
- Databricks Plotting IPO in 2021, Bloomberg Reports
- Verizon Expands Deal with AWS for 5G Edge Platform
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- AWS Launches Managed Services for Grafana, Prometheus
- ACLU Objects to Expansion of Facial Recognition by CBP
- The Rise and Fall of Qlik
- More News In Brief…
Most Read This Just In
- PrestoSQL Rebranding as Trino
- O’Reilly Announces 2021 Superstream Series Lineup and Dates
- BlackSky Awarded Govt Contract to Develop AI Platform for Global Construction Monitoring
- Datatron Releases New Governance Dashboard
- SAS Fulfills Pledge to Support HBCUs with Software and Partnerships
- New Data-driven Global Climate Model Provides Projections for Urban Environments
- Starburst Secures $100M Series C Financing Led by Andreessen Horowitz
- Datanami Reveals Winners of Fifth Annual Readers’ and Editors’ Choice Awards
- DL Framework ‘SmallTrain 0.2.0’ Released for Professional and Commercial Use
- Veritone and Alteryx Partner to Power the Alteryx Analytic Process Automation Platform with New AI Capabilities
- More This Just In…
Sponsored Partner Content
-
Who wins the hybrid cloud?
-
Making the Business Case for a Data Catalog
-
Hear from William McKnight on everything you need to know to modernize your enterprise data warehouse.
-
Free Whitepaper: The Race for a Unified Analytics Warehouse
-
Move beyond extracts – Instantly analyze all your data with Smart OLAP™
-
CDATA | Universal Connectivity to SaaS/Cloud, NoSQL, & Big Data
Sponsored Whitepapers
Contributors
Featured Events
-
LEAP
February 1 - February 3Saudi Arabia -
AI & Big Data Expo Global 2021
March 17 - March 18Kensington London United Kingdom