Big Data • Big Analytics • Big Insight

Technologies » Network

Features

Why Kafka Should Run Natively on Hadoop

Dec 2, 2014 |

Apache Kafka has become an instrumental part of the big data stack at many organizations, particularly those looking to harness fast-moving data. But Kafka doesn’t run on Hadoop, which is becoming the de-facto standard for big data processing. Now a group of developers led by DataTorrent are addressing that concern with a new project called KOYA, or Kafka on YARN. Getting Kafka into Hadoop would seem to be a no-brainer. After all, the open source message broker software already plays Read more…

Why Twitter Is the Low-Hanging Fruit of Social Analytics

Nov 19, 2014 |

Nobody is mistaking the Twitter fire hose for a crystal ball. But big companies are increasingly turning to Twitter and other social media outlets for a range analytic tasks, from gauging customer sentiment about bendy smartphones to saving costs during product recalls. Corporations have been analyzing social media since it arrived on the scene year ago. But only recently have they figured out how to really make use of it, according to Katherine Matsumoto of Attensity, a big data analytics Read more…

Hacking Your Way Onto the IoT

Nov 17, 2014 |

Elon “Ironman” Musk raised eyebrows recently when he said we are “summoning the demon” with artificial intelligence. While it’s debatable whether neural networks will give rise to evil spirits, a singularity of a different sort is clearly at hand when it comes to the Internet of Things, which is on the cusp of unleashing torrents of new data moving among consumers, devices, and device manufacturers. If you thought the data you have been dealing with was big, then you’re going Read more…

How Data Analytics Shaped Election Day 2014

Nov 4, 2014 |

Today is Election Day, when political scientists finally get to see the manifestations of their careful calculations. But increasingly, elections are being influenced by data scientists who are experts at wielding big data analytics to achieve an end. President Obama’s re-election campaign took political data science to new heights in 2012. The campaign had a large and well-funded analytics team of 165 people, who worked nearly two years to collect data and segmented and categorized the entire American electorate in Read more…

‘What Is Big Data’ Question Finally Settled?

Oct 29, 2014 |

People have been debating what “big data” means ever since the term appeared in the lexicon. Researchers at Cal Berkeley recently pepper dozens of prominent data scientists and industry leader with the question in hopes of settling the big question once and for all. You’ve undoubtedly heard many definitions for big data over the years. For some, you have big data when it can’t be stored on a single computer, or it’s the combination of volume, velocity, and variety (some Read more…

News In Brief

As Pollution Worsens, China Turns to Big Data

Jul 8, 2014 |

You’ve got to see, smell, feel Beijing’s smog to believe it. Looking out a high window of a tall building, the air is opaque. Despite rules against them, vendors cook and sell food on side streets using charcoal grills. Prevailing winds from the Gobi Desert distribute dust throughout the sprawling capital. The desert dust along with particulates from high-sulfur coal burned in the city’s power plants prompt car owners to brush off their vehicles the way we might clear snow Read more…

Cloudera, Dell, Intel Target ‘Big Data Ecosystem’

Jun 24, 2014 |

Cloudera, Dell and Intel said they plan to launch dedicated Dell In-Memory Appliances for the Cloudera Enterprise as a way to boost real-time analytics performance. The partners said the goal of the engineering partnership is to advance enterprise deployments of Apache Hadoop as well as to integrate hardware and software to help enterprises leverage advanced data analysis. The latter would be enabled through incorporation of real-time data streams into customers’ applications. The partners said the initial effort would be the Read more…

Unsnarling I-95, with Data

Jun 17, 2014 |

Like the weather, everyone whines about traffic. Now, an alliance of transportation agencies, toll authorities, and data analytics vendors are teaming up to apply real-time speed and travel time data to the problem of traffic congestion and the wasted hours and energy it creates. The I-95 Corridor Coalition wants to apply data analytics to reduce congestion on one of the nation’s busiest interstate corridors, I-95, the 2,000-mile-long parking lot that runs from Maine to Florida. Working with the University of Read more…

Making Hadoop Relevant to HPC

May 27, 2014 |

Despite its proven ability to affordably process large amounts of data, Apache Hadoop and its MapReduce framework are being taken seriously only at a subset of U.S. supercomputing facilities and only by a subset of professionals within the HPC community. That in a nutshell is the contention of Glenn K. Lockwood of the San Diego Supercomputer Center, who wonders why Hadoop remains at the fringe of high-performance computing while looking for ways to move it into the HPC mainstream. “Hadoop Read more…

Novel Storage Technique Speeds Big Data Processing

Feb 4, 2014 |

Between the data deluge and the proliferation of uber-connected devices, the amount of data that must be stored and processed has exploded to a mind-boggling degree. One commonly cited statistic from Google Chairman Eric Schmidt holds that every two days humankind creates as much information as it did from the dawn of civilization up until 2003.

This Just In

Indiana University Unveils SciPass

Nov 12, 2014 |

BLOOMINGTON, Ind., Nov. 12 — Networking and IT security experts at Indiana University have joined forces to change the way university networks handle the massive data sets that are crucial to discovery. Their innovation, a software-defined networking (SDN) system called SciPass, makes large data transfers faster and more affordable without sacrificing network security. Like most institutions whose researchers need to generate and analyze large data sets, IU operates a Science DMZ to optimize data transfers while providing appropriate security features. Read more…

A3CUBE Introduces Fortissimo Foundation

Sep 16, 2014 |

SAN JOSE, Calif., Sept. 16 — A3CUBE Inc., a developer of revolutionary communication technology that extends the capability of standard PCIe interconnect to produce industry-leading networked computing and storage solutions, today introduced its Fortissimo Foundation building block software solution. Coupled with A3CUBE’s previously announced RONNIE Express platform, Fortissimo Foundation provides dramatic improvements in application performance and datacenter efficiency, particularly in unstructured, Big Data environments. Fortissimo Foundation works in concert with A3CUBE’s RONNIEE Express data path accelerator and RONNIEE NICs to Read more…

Research and Markets Adds Future of Big Data Analytics Report to Offering

Sep 16, 2014 |

Sept. 16 — Research and Markets has announced the addition of the “The Future of Big Data Analytics – Global Market and Technologies Forecast – 2015-2020″ report to their offering. Big data is data that exceeds the processing capacity of conventional database systems. The data is too big, moves too fast, or exceeds the limits of your database architectures. To gain value from this data, you must choose an alternate way to process it. Many argue that Big Data is all talk and no Read more…

Teradata University Network Recognizes Poster Contest Finalists

Aug 27, 2014 |

ATLANTA, Ga., Aug. 27 — Teradata University Network has announced the kick-off of its Data-Driven Careers program with the selection of 10 finalists for its inaugural Poster Contest on applied analytics. The finalists, and an additional 13 scholarship winners, will attend the Teradata 2014 PARTNERS Conference & Expo in Nashville, Tenn, October 19 – 23. The global conference is sponsored in part by Teradata Corp., the analytic data platforms, marketing applications and services company. The poster finalists and scholarship winners receive free registration to the five-day industry event and Read more…

Zettaset Introduces Fast-PATH

Aug 14, 2014 |

MOUNTAIN VIEW, Calif., Aug. 14 — Zettaset, the leader in Big Data security, today announced Fast-PATH, an advanced software configuration management solution that automates and accelerates Hadoop deployment, significantly reducing the over-reliance on costly and time-consuming professional services that burdens today’s Big Data environment. Hadoop is rapidly evolving, but has not yet reached the level of maturity and sophistication that traditional relational databases offer. As a result, users expecting lower operational costs by using Hadoop software and infrastructure are surprised to find Read more…