Follow Datanami:
August 18, 2023

Striim Bolsters Cloud Data Integration to Google


Two months after enhancing real-time data connections to Snowflake and Databricks, streaming data integration provider Striim today unveiled an improved, more secure connection to Google Cloud with the launch of Striim Cloud 4.2.

One of the big features launched with today’s unveiling of Striim Cloud 4.2 is support for Google Private Service Connect, which is a Google service that allows users to transfer data using a virtual private cloud, thereby bypassing the public Internet.

According to Google, PSC “allows consumers to access managed services privately from inside their VPC network.” It lets consumers “use their own internal IP addresses to access services without leaving their VPC networks or using external IP addresses,” Google says on its PSC webpage.

Striim says it worked with Google to develop its PSC integration, thereby streamlining the development of integration points among the sources and targets of Google Cloud customers. Striim Cloud customers can now use a “simple GUI” to configure their PSC connections in a matter of minutes, Striim says.

The PSC integration currently supports the following Google Cloud data stores: BigQuery; Cloud SQL for MySQL, Cloud SQL for Postgres, Google Cloud Storage, and Spanner. In addition to Google data stores, Striim Cloud customers can use the PSC connection to bring on-prem data into Striim environment using virtual private networks and subnets, according to Striim documentation.

Striim now supports the creation of data integration in Google Private Service Connect (Image courtesy Striim)

Striim Cloud 4.2 also brings new sources and targets into the data pipelines it creates for customers, bringing the total number of integrations (sources and target) to more than 150, the company says.

New integration points include readers for Google Cloud Storage and Salesforce Pardot (readers are at the end of the data pipelines Striim automatically creates). The company also launched a ServiceNow writer (writers are at the beginning of the pipelines), providing Striim Cloud read and write support. Customers can use this capability to synchronize multiple ServiceNow instances or enrich ServiceNow tickets with external applications and data, the company says.

Integration with PostgreSQL, the world’s most popular cloud database, has also been enhanced with Striim Cloud’s change data capture (CDC) capability. According to Striim, the new “auto-optimizing” CDC capability can now “mine” changes in PostgreSQL involving very large transactions, and at low latencies. This will improve the performance and uptime of pipelines created rom PostgreSQL to cloud data warehouses, Kafka, and other targets, the company says.

SQL Server integration has also been enhanced, thanks to a new capability to read compressed database tables with MSJet,

Additional data integration enhancements: Striim has added support to read SQLServer compressed tables with MSJet, Microsoft’s log-based change data capture reader. Striim  also enhanced its MongoDB Reader to support change streams and document filtering, the company says.Striim

Striim has been at the forefront of streaming data and data integration since it was founded 11 years ago. The Menlo Park, California company develops two versions of software, including Striim Platform, which customers can run on-prem or in their public cloud environments, and Striim Cloud, a fully managed SaaS platform available on Microsoft Azure or Google Cloud Platform.

In June, Striim announced enhanced support for streaming data into Snowflake and Databricks, two of the most popular cloud data warehouse and lakehouse environments.

For its Snowflake integration, Striim documented the capability to send terabytes of data per day into Snowflake with latency in the seconds. Striim touted how its customer, Cienna, is able to move 100 million events in real time into Snowflake every 24 hours.

Meanwhile, its new Striim for Databricks offering gives customers the capability to stream transactional data from hundreds and thousands of tables to Databricks with sub-second end-to-end latencies, the company says.

Security in both Databricks and Snowflake environments has been improved with Striim Cloud 4.2, thanks to support for OAuth authentication mechanism.

Related Items:

Cloud Migration Is a Boon to Operations. But It Creates a Perfect Storm of Data Challenges

Fueled by Kafka, Stream Processing Poised for Growth

People to Watch 2019 – Steve Wilkes, CTO and Co-founder, Striim