Applications » Complex Event Processing

Features

Data Science Operationalization in the Spotlight at Leverage Big Data ’16

Jun 9, 2016 |

How do you create business value from data science? It may be easy to answer from a theoretical standpoint, but actually turning data into business value in the real world is another matter entirely. This week, dozens of the brightest minds from the world of big data attended Datanami‘s third annual Leverage Big Data event to discuss their big data experiences and share tips on how to operationalize data science in the real world. The three-day event was well attended Read more…

Merging Batch and Stream Processing in a Post Lambda World

Jun 1, 2016 |

It wasn’t long ago that developers looked to the Lamba architecture for hints on how to design big data applications that needed elements of both batch and streaming data. But already, the Lamba architecture is falling out of favor, especially in light of a new crop of frameworks like Apache Spark and Apache Flink that can do it all. Nathan Marz, the creator of Apache Storm, first postulated the ideas behind the Lambda architecture in a 2011 blog post titled Read more…

Kafka Creators Tackle Consistency Problem in Data Pipelines

May 24, 2016 |

One of the big questions surrounding the rise of real-time stream processing applications is consistency. When you have a distributed application involving thousands of data sources and data consumers, how can you be sure that the data going in one side comes out the other unchanged? That’s the challenge that Confluent is addressing with today’s launch of new software for Apache Kafka. If you’re moving big data today, you’re probably using Apache Kafka, or at least looking at it. The Read more…

A Big Data App to Help You Travel Safer

Apr 28, 2016 |

Let’s face it: the world is a dangerous place. From terrorist attacks and earthquakes to outbreaks of hemorrhagic fever and pickpockets, there are a thousand ways for an American to stumble into trouble when travelling abroad. Now a new app from Prescient aims to help travelers stay safe by tapping into real-time data feeds, analyzing threats, and sending alerts when users wander too close to danger. Prescient Traveler is a mobile app that functions as a digital concierge for businesspeople, Read more…

Apache Beam’s Ambitious Goal: Unify Big Data Development

Apr 22, 2016 |

If you’re tired of using multiple technologies to accomplish various big data tasks, you may want to consider Apache Beam, a new distributed processing tool from Google that’s now incubating at the ASF. One of the challenges of big data development is the need to use lots of different technologies, frameworks, APIs, languages, and software development kits. Depending on what you’re trying to do–and where you’re trying to do it–you may choose MapReduce for batch processing, Apache Spark SQL for Read more…

News In Brief

AI is Coming, Prompting New IT Security Concerns

Jun 10, 2016 |

Intelligent, often autonomous, systems are making headway in the datacenter as developers seek to offload manual processes and move beyond traditional approaches like prescriptive IT automation as they struggle to keep up. That’s the conclusion of a vendor-backed survey of IT executives about the adoption of intelligent machines and systems based on new AI approaches and other expert systems. Still, the survey sponsored by IT management software specialist Ipswitch notes that early adopters of automated systems are struggling to gauge Read more…

Exascale Storage Targets Big Data Archives

Apr 21, 2016 |

With exascale computing comes the requirement for exascale storage. Such a storage platform has emerged in the form of what is touted as the largest capacity tape storage library aimed initially at media and entertainment companies but also targeting HPC applications. Spectra Logic of Boulder, Colo., unveiled its exascale tape storage system at this week’s National Association of Broadcasters annual trade show—hence, the media emphasis. However, Spectra Logic has previously worked with NASA’s Advanced Supercomputing Division at its Ames Research Read more…

AI Services Firm Bonsai Wins Strata Startup Showcase

Mar 30, 2016 |

An artificial intelligence (AI) startup out of Berkeley, California called Bonsai.ai won the Startup Showcase at the Strata + Hadoop World today. The second and third-place winners were also announced, as was the winner of the audience choice award. Bonsai (bonsai.ai) has created a cloud-based platform where users can build and deploy AI services, as well as a marketplace where the services can be bought and sold. Key components of its platform include the core intelligence server called BRAIN, which Read more…

Streaming Architecture–Why Flow Instead of State?

Mar 27, 2016 |

The way that computing is done is changing dramatically.  Instead of a program with a finite input, we now have programs with infinite streams as inputs. Why does this matter, and why is the change happening now? This matters because life doesn’t happen in neatly defined batches. Neither should your code. By adopting a streaming data architecture, we get a better fit between applications and real life. The advantages of this type of design are substantial: systems become simpler, more Read more…

Gartner Sees Analytics Boom as More Data is Shared

Jan 28, 2016 |

Advanced analytics techniques like data and text mining, machine learning and visualization are poised to shake up entire industries as more enterprises leverage proprietary algorithms along with emerging platforms to securely share more data, a market watcher predicts. In a forecast released Thursday (Jan. 28), Gartner Inc. predicted the red-hot advanced analytics market will grow 14 percent this year to $1.5 billion. By 2018, it predicts more than half of large global enterprises will leverage analytics and proprietary algorithms on Read more…

This Just In

DataTorrent Joins the Open Data Platform Initiative, Brings Real-Time Processing of Data-In-Motion to ODP

May 21, 2015 |

SANTA CLARA, Calif., May 21, – DataTorrent, the leader in real-time big data analytics and creator of DataTorrent RTS, the world’s first enterprise-grade unified platform for both stream and batch processing on Hadoop, today announced it joined the Open Data Platform (ODP) as a Silver member. In addition, DataTorrent RTS is certified and immediately available on the ODP Core. DataTorrent is focused on reducing time to market, increasing ROI and enabling success of big data projects. Joining ODP brings DataTorrent’s Read more…

Ryft Open API Library Extends Lightning-Fast Batch and Streaming Analysis to Existing Big Data Environments 

May 21, 2015 |

ROCKVILLE, MD., May 21 — Ryft announced today the availability of the Ryft Open API Library, expanding the company’s Ryft ONE high-performance data analysis capabilities into existing big data environments. Developers can now invoke or extend the Ryft Open API to add hardware-driven acceleration to applications that demand real-time intelligence from all types of batch and streaming data. Now, Ryft combines the flexibility of an open, future-proof 1U platform with the speed, simplicity, scalability and security of a purpose-built analytics accelerator for 100X faster enterprise decision-making Read more…

DataStax Announces DSE 4.7

May 19, 2015 |

May 19, 2015 – DataStax, the company that delivers Apache Cassandra™ to the enterprise, today announced the general availability of DataStax Enterprise 4.7 (DSE 4.7), the leading database platform purpose-built for the performance and availability demands of web, mobile and Internet of Things (IoT) applications. With significant advancements to integrated enterprise search, analytics, security, in-memory computing, and database management and monitoring, DSE 4.7 is the leading distributed database for mixed workload deployments. PERSPECTIVES ON THE NEWS “Enterprise search is an indispensable tool Read more…