Bigstep Adds Spark Service to Bare-Metal Cloud
A Spark-based analytics engine released last week runs on a low-latency, software-defined bare metal fabric and can scale Spark clusters and the IT infrastructure that supports them.
Bigstep, which has dual headquarters in London and Chicago, said its real-time Spark service is designed to speed deployment of real-time data streaming applications as more Spark implementations shift to the cloud. Among the emerging uses for such implementations are the Internet of Things and algorithm decision-making, Bigstep Founder and CEO Lucas Roh noted in a statement.
Roh added that Bigstep’s bare metal cloud platform would help reduce development requirements for its real-time Spark service. The company also said it would offer a “pay-per-use” container-based Spark cluster optimized for real-time streaming applications that use multiple concurrent Spark contexts.
A rapid prototyping feature includes a built-in Jupyter interface for Scala, Python or R programming languages. Jupyter Notebook is designed to allow data scientists to combine code, graphs, dashboards and descriptive texts within the same document while performing operations interactively.
Meanwhile, real-time data streaming applications run in parallel with other container application clusters.
The company added that its bare-metal fabric could run multiple Spark versions, including Spark 2.0, using the same pool of resources.
The introduction of the Spark platform follows the company’s release in early October of a real-time application container service designed specifically for streaming applications. The company said it container service also targets emerging infrastructure based on micro-services and memory-intensive workloads requiring low latency and higher performance.
The container service is based on Docker and can run distributed streaming applications on the company’s bare metal cloud. Those applications can be built on Spark Streaming, Apache Flink or the Heron streaming replacement for Apache Storm, the company said.
Persistent storage requirements have recently overtaken security as the top barrier to adoption of application containers in production. Hence, Bigstep stressed its real-time container service offers high-end persistent support, including storage volumes that follow containers as they move across clusters.
Meanwhile, the company said customers could deploy its new Spark service alongside either Zoomdata and Bigstep data lakes, or use it with applications deployed on-premises or on its managed container service.
April 20, 2018
April 19, 2018
- IBM Joins NSF’s BIGDATA Program
- UMass Amherst Computer Scientist Awarded Grant to Improve Citizen Science, Big Data Analysis
- Western Digital Introduces Ultrastar DC HC530 14TB Hard Drive
- Purdue University Launches Collaborative ‘Integrative Data Science Initiative’
April 18, 2018
- Maine Pointe Becomes Alteryx Partner
- FICO Showcases Latest Enhancements to FICO Decision Management Suite
- Whitepages Selects Redis Labs to Support Flagship Product
- Loom Systems Launches Predictive Ticketing
April 17, 2018
- WHISHWORKS Partners With Databricks to Drive Business Value With Big Data Analytics
- Qubole Releases First Big Data Activation Report
- DataStax Releases DataStax Enterprise 6
April 16, 2018
- DroneDeploy Launches Auto Pilots Solution for Drone Insights
- Melissa Extends Informatics Capabilities to Its Slate of Active Data Quality Tools and Services
April 12, 2018
- Ride-Hailing App PickMe Deploys iguazio’s Continuous Data Platform
- Hazelcast Announces Hazelcast Jet 0.6
- SIOS Awarded Two New Patents for Advancements in Machine Learning Analytics for IT Operations
- Denodo Announces Release of Denodo Platform 7.0
April 11, 2018
April 10, 2018
- Immuta Introduces Apache Spark Ecosystem Support and Automated Governance Reporting for Data Science Programs
Most Read Features
- Why Knowledge Graphs Are Foundational to Artificial Intelligence
- 9 Must-Have Skills to Land Top Big Data Jobs in 2015
- Which Programming Language Is Best for Big Data?
- Blockchain Starting To Feel Its Way into the Artificial Intelligence Ecosystem
- Why 2018 Will Be The Year Of The Data Engineer
- What’s Fueling Deep Learning’s ‘Cambrian Explosion’?
- Which Machine Learning Platform Performs Best?
- Spark Streaming: What Is It and Who’s Using It?
- Winners and Losers from Gartner’s Data Science and ML Platform Report
- Which Type of SSD is Best: SATA, SAS, or PCIe?
- More Features…
Most Read News In Brief
- Teradata Takes ‘4D Analytics’ to the Edge
- Snap ML Bests TensorFlow in Benchmark, IBM Says
- Why Gartner Dropped Big Data Off the Hype Curve
- Apache Zeppelin Launches Latest Data Science Notebook
- Linux Foundation Launches Open AI Effort
- Infogix Acquires Data Prepper Lavastorm
- Big Data Spreading Everywhere Like Air, Deloitte Says
- Open-Source ML Server Gets Apache Promotion
- Six Big Name Schools with Big Data Programs
- Data Warehouse Market Ripe for Disruption, Gartner Says
- More News In Brief…
Most Read This Just In
- data Artisans Releases Turnkey Real-Time Stream Processing Platform to Power Live Data Applications
- Denodo Announces Release of Denodo Platform 7.0
- Microsoft Announces GA of Azure Databricks
- Yotpo Announces the Launch of A.I.-Powered ‘Insights’
- MemSQL Establishes a New Baseline for Database Speed
- ScyllaDB Introduces Scylla Manager for Greater Centralized Control of Scylla Database Clusters
- SAP Announces Availability of Application Edition of SAP Predictive Analytics
- MapR Announces Upcoming November Presentations
- Dataiku DSS 3.1 Unveiled
- SAP Introduces SAP Predictive Engineering Insights
- More This Just In…