
Bigstep Adds Spark Service to Bare-Metal Cloud

(phipatbig/Shutterstock)
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
Recent items:
Unraveling Hadoop and Spark Performance Mysteries
Overcoming Spark Performance Challenges in Enterprise Hadoop Environments
April 9, 2021
- Alteryx Global Inspire 2021 Conference to Showcase New Products in Analytics and Data Science
- Trifacta Announces New Community and Certification Programs for Data Workers
- Gary Hagmueller Joins Dgraph Labs as CEO
- Elastic and Confluent Partner to Develop Enhanced Experience for Kafka and Elasticsearch Users
- New UK Fellowship Programme Will Fund 6 Fellows in AI and Data Science to Support Life Science Research
April 8, 2021
- Full Agenda Released for TigerGraph’s Graph + AI Summit 2021
- AWS Announces General Availability of Amazon Lookout for Equipment
- Collibra and EVO Banco Boost Data-Driven Digital Banking
- Swarm64 and EDB Partner to Extend EDB Postgres Advanced with Faster Query Performance
- Alation Delivers Cloud-Based Platform for Data Intelligence
- Comet Raises $13M Series A for Model Development and Monitoring
- Graphistry and Pavilion Partner to Accelerate Graph Analytics Using RAPIDS and NVIDIA GPUs
- New Services in SAP HANA Cloud Lower TCO in Data-Intensive, Highly Regulated Industries
- Snorkel AI Launches Application Studio, Raises $35M Led by Lightspeed Venture Partners
- Streamlit Transforms How Data Scientists Share Data, Raises $35M Led by Sequoia
April 7, 2021
- OmniSci Announces Opportunities to Accelerate Geospatial, GPU Database Knowledge At GTC 2021
- MinIO Enables IT to Manage Kubernetes-native Object Storage
- Ataccama Report: Nearly 8 in 10 Businesses Struggle with Data Quality
- MANTA Partners with Neo4j to Provide Enhanced Graph Technology for Data Pipeline Analysis
- Qlik Collaborates with AWS to Accelerate Cloud Analytics with SAP Data
Most Read Features
- Big Data File Formats Demystified
- Synthetic Data: Sometimes Better Than the Real Thing
- Experts Disagree on the Utility of Large Language Models
- A ‘Glut’ of Innovation Spotted in Data Science and ML Platforms
- He Couldn’t Beat Teradata. Now He’s Its CEO
- Is Python Strangling R to Death?
- Why Data Science Is Still a Top Job
- Who’s Winning In the $17B AIOps and Observability Market
- Big Data Predictions: What 2020 Will Bring
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- More Features…
Most Read News In Brief
- Can PHP Script a Big Data Comeback?
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- AWS Adds Explainability to SageMaker
- Global DataSphere to Hit 175 Zettabytes by 2025, IDC Says
- AWS Tackles Real-Time Data Transformation with S3 Object Lambda
- The AI Inside NASA’s Latest Mars Rover, Perseverance
- The Union of Salesforce, Tableau Yields Hybrid ‘Business Science’
- Databricks Edges Closer to IPO with $1B Round
- Data Salaries Get a COVID Bump
- Informatica Accelerates DataOps with Spark, GPUs
- More News In Brief…
Most Read This Just In
- Moody’s Analytics Wins Award for Best Use of AI in Banking or FinTech
- Aiven Raises $100M Series C to Expand Global Open Source Innovation
- Alluxio Advances Analytics and AI with NVIDIA Accelerated Computing
- GrafanaCONline Returns June 7-17, CFP Is Open Now
- AWS Announced Strategic Partnership with Hugging Face NLP Startup
- y42 Raises $2.9M to Provide a Scalable and Affordable Data Stack to Companies of All Sizes
- ThoughtSpot Acquires SeekWell to Operationalize Analytics, Push Cloud Data Insights to Business Apps
- PrivaceraCloud’s New Integrations Automate Identity Management Across Multi and Hybrid-Cloud Environments
- New Tool Increases Transparency and Understanding into Machine Behaviors
- MinIO Enables IT to Manage Kubernetes-native Object Storage
- More This Just In…