Bigstep Adds Spark Service to Bare-Metal Cloud
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
June 11, 2021
- Google Analytics Announces New Customer Insight Tools Aiming to Increase Privacy
- StarTree Announces Commercial Availability of User-Facing Analytics Platform
- Cloud Native Geospatial Ecosystem Community Releases SpatioTemporal Asset Catalog
- AtScale Deepens Snowflake Integration with Snowpark for Advanced Automation, Orchestration
- NVIDIA to Acquire DeepMap, Enhancing Mapping Solutions for the AV Industry
June 10, 2021
- Startup’s AI Intersects with US Traffic Lights for Better Flow, Safety
- SAS Delivers Free Analytics Training for COVID Researchers
- Informatica Announces New Data Loading, Advanced ELT Integrations with Snowflake
- Researchers Fine-Tune Control Over AI Image Generation
- DataRobot Delivers Scalable Inference with Snowflake Snowpark
- Prefect Announces $32M Series B Funding for its Dataflow Automation Platform
- AWS Announces General Availability of AWS Proton
- Nutanix, HPE Expanded Partnership to Accelerate Hybrid Cloud Adoption with New DBaaS Offering
- Ohio Supercomputer Center Uses Twitter Data to Analyze Political Polarization
June 9, 2021
- ThoughtSpot Launches Support for Snowpark to Bring Analytics Cloud to AI Workloads
- SnapLogic Becomes Snowflake Premier Partner
- Protegrity Announces Latest Version of Platform with New Dynamic Data Masking Capabilities
- Dataiku Introduces Integration with Snowflake to Enable Support for Advanced Data Functions
- IBM’s Uncertainty Quantification 360 Toolkit Boosts Trust in AI
- John Snow Labs Announces Spark NLP 3.1
Most Read Features
- Newly ‘Headquarterless’ Snowflake Makes a Flurry of Announcements
- Big Data File Formats Demystified
- Three Takeaways from Jay Kreps’ Kafka Summit Keynote
- A Peek At the Future of Data Management, Courtesy of Gartner
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Do Customers Want Open Data Platforms?
- Google Cloud Overhauls AI with Vertex Launch
- Understanding Your Options for Stream Processing Frameworks
- Why Data Science Is Still a Top Job
- Databricks Unveils Data Sharing, ETL, and Governance Solutions
- More Features…
Most Read News In Brief
- Confluent Files to Go Public. Who Could Be Next?
- Confluent S-1 Reveals ‘Reimagining of Business’ Theme
- Lakehouses Prevent Data Swamps, Bill Inmon Says
- PlanetScale Unveils Distributed MySQL Database Service Based on Vitess
- MIT Analytics Reveal How Anti-Maskers Leverage Data Visualization
- Google Cloud Tackles Data Unification with New Offerings
- Google’s ‘Breakthrough’ LaMDA Promises to Elevate the Common Chatbot
- Qualcomm Unveils 5G Modem for IoT
- KAIST Introduces T-GPS, a Tool for Processing a Trillion-Edge Graph on One Computer
- Alteryx Dips Analytics Tools Into Machine Learning Waters
- More News In Brief…
Most Read This Just In
- SAS Named a Leader in Streaming Analytics Per Independent Research Firm
- Relativity Acquires Text IQ to Drive Leadership in AI for e-Discovery, Compliance and Privacy
- Sumo Logic Signs Definitive Agreement to Acquire Sensu to Extend Open Source Strategy
- University of Texas at San Antonio Researchers Collaborate to Improve Computer Vision for AI
- US Air Force RSO Expands Engagement with C3 AI as Strategic AI Platform
- Airbyte’s New Connector Development Kit Commoditizes Data Integration
- Dgraph Rises to the Top Graph Database on GitHub with 11 G2 Badges, 11M Downloads
- Digital Twin Consortium Announces Open-Source Collaboration Community
- New erwin by Quest Research Reveals Data Governance, Operations and Protection Converging
- NEC X and Alchemist Accelerator Announce Partnership to Speed Successful Startup Launch
- More This Just In…