Applications » Complex Event Processing

Features

Cast Your Models Into Data Streams and Take Advantage of the IoT

Aug 28, 2015 |

Using data in real-time used to be a challenge. Lengthy extraction, transformation and loading processes make analyzing data an activity more akin to glancing in a rearview window than reading road signs as you pass. And with excitement building around the Internet of Things many just assume that harnessing sensor technology is an IT budget breaker. However, that doesn’t have to be the case. Event stream processing combines high throughput (millions of events per second) and low latency (delays undetectable Read more…

Yahoo Casts Real-Time OLAP Queries with Druid

Aug 4, 2015 |

Yahoo is in the process of implementing a big data tool called Druid to power high-speed real-time queries against its massive Hadoop-based data lake. Engineers at the Web giant say the open source database’s combination of speed and usability on fast-moving data make it ideal for the job. Druid is a column-oriented in-memory OLAP data store that was originally developed more than four years ago by the folks at Metamarkets, a developer of programmatic advertising solutions. The company was struggling Read more…

From Data Lakes to State Analytics

Jul 21, 2015 |

Earlier this year, I published my thoughts around a data lake use case that I called “The Union of the State.” Since this post published, the topic of data lakes and data analytics has become more widely debated than ever before. And the more I’ve thought about it, the more I’ve read and heard from industry influencers such as Dan Woods and Adrian Bridgwater, I’ve come to realize something – there is an entire branch of analytics that no one Read more…

The Real-Time Future of Data According to Jay Kreps

Jul 8, 2015 |

When Jay Kreps helped develop Kafka several years back, the LinkedIn engineer was just happy to replace a batch messaging process with a new data pipeline that worked in real-time. Fast forward to July 2015, and the CEO of Confluent is talking about transforming how businesses think about and use data. If you haven’t heard about Apache Kafka yet, you likely will soon. At the simplest level, the open source software is a next-generation messaging bus for big data, providing Read more…

Inside WebTrends’ Big Data Analytics Pipeline

Jul 1, 2015 |

WebTrends has been collecting and analyzing Web data on behalf of its customers since it was founded way back in 1993. Considering the exponenetial growth of the Net since then, it’s not a stretch to say WebTrends was doing big data before big data was a “thing.” But following the recent creation of a data analytics pipeline built with technologies like Hadoop, Spark, and Kafka, the company is taking its big data analytic services to a whole new level. WebTrends Read more…

News In Brief

Kafka Tops 1 Trillion Messages Per Day at LinkedIn

Sep 2, 2015 |

There is data in motion, and then there is really big data in motion. The folks at LinkedIn gave us a compelling example of the latter today when it announced that it’s using the distributed messaging system Kafka to process more than 1.1 trillion messages per day. Kafka of course was born at LinkedIn. Around the year 2010, the social media company found it was struggling to adequately move data through batch-oriented messaging systems, and so three LinkedIn engineers—Jay Kreps, Read more…

Carlyle Group Acquires Novetta

Aug 31, 2015 |

Privately held Novetta, a provider of an analytics platform designed to help clients sift through huge datasets never intended for analysis together, said it has been sold to the Carlyle Group. Arlington Capital Partners announced the deal to sell Novetta to the Washington, DC-based asset manager on Aug. 27. Novetta, McLean, Va., is best known for its cyber analytic offerings. It moved earlier this year to broaden its reach into the commercial market with a Hadoop-based solution called Novetta Entity Read more…

Riak Taps Mesos for ‘Push Button’ NoSQL Scalability

Aug 20, 2015 |

At the MesosCon conference this week, Basho Technologies and Cisco are demonstrating the Riak key-value store database running atop Apache Mesos, the next-gen cluster manager developed by UC Berkeley’s AMPLab. As Basho CEO Adam Wray tells Datanami, it’s all about making data delivery more scalable. Basho develops a multi-modal NoSQL database that includes a key-value store and an object store, along with hooks into other big data tools like Apache Spark, Redis, and Solr—with graph and columnar analytic capabilities possibly Read more…

Huge Radio Telescope Gets New Database

Aug 10, 2015 |

The world’s largest radio telescope, the Square Kilometer Array (SKA), will be getting a data storage and analytics upgrade thanks to a grant from the organization that operates the telescope and partner (AWS). The Dutch database technology company MonetDB Solutions said Monday (Aug. 10) it would use the grant to develop new storage and analytics techniques for SKA along with partner Centrum Wiskunde & Informatica (CWI), the Dutch research institute for mathematics and computer science. MonetDB Solutions is a spin-off Read more…

Bit Stew, Energy Advisor Partner on Industrial IoT

Aug 6, 2015 |

Consulting firm Blackstone Technology Group, which focuses heavily on the energy sector, is partnering with “software-defined operations” specialist Bit Stew Systems in a bid to extend big data capabilities into global energy and other industrial markets. The partners said their collaboration would help promote adoption of Bit Stew’s analytics platform and other big data applications into the utility along with the oil and gas sectors. That in turn would provide a boost to data analytics targeting the industrial Internet of Read more…

This Just In

DataTorrent Joins the Open Data Platform Initiative, Brings Real-Time Processing of Data-In-Motion to ODP

May 21, 2015 |

SANTA CLARA, Calif., May 21, – DataTorrent, the leader in real-time big data analytics and creator of DataTorrent RTS, the world’s first enterprise-grade unified platform for both stream and batch processing on Hadoop, today announced it joined the Open Data Platform (ODP) as a Silver member. In addition, DataTorrent RTS is certified and immediately available on the ODP Core. DataTorrent is focused on reducing time to market, increasing ROI and enabling success of big data projects. Joining ODP brings DataTorrent’s Read more…

Ryft Open API Library Extends Lightning-Fast Batch and Streaming Analysis to Existing Big Data Environments 

May 21, 2015 |

ROCKVILLE, MD., May 21 — Ryft announced today the availability of the Ryft Open API Library, expanding the company’s Ryft ONE high-performance data analysis capabilities into existing big data environments. Developers can now invoke or extend the Ryft Open API to add hardware-driven acceleration to applications that demand real-time intelligence from all types of batch and streaming data. Now, Ryft combines the flexibility of an open, future-proof 1U platform with the speed, simplicity, scalability and security of a purpose-built analytics accelerator for 100X faster enterprise decision-making Read more…

DataStax Announces DSE 4.7

May 19, 2015 |

May 19, 2015 – DataStax, the company that delivers Apache Cassandra™ to the enterprise, today announced the general availability of DataStax Enterprise 4.7 (DSE 4.7), the leading database platform purpose-built for the performance and availability demands of web, mobile and Internet of Things (IoT) applications. With significant advancements to integrated enterprise search, analytics, security, in-memory computing, and database management and monitoring, DSE 4.7 is the leading distributed database for mixed workload deployments. PERSPECTIVES ON THE NEWS “Enterprise search is an indispensable tool Read more…