Big Data • Big Analytics • Big Insight

Sectors » Other


Spark Smashes MapReduce in Big Data Benchmark

Oct 10, 2014 |

Databricks today released benchmark results for Apache Spark running the Sort Benchmark, a competition for measuring the sorting performance of large clusters. Spark running on Hadoop sorted 100 TB of data in 23 minutes, three times faster than the previous record held by Yahoo using MapReduce on Hadoop. The result, Databricks says, are due to targeted improvements the Spark community made to improve performance, and should lay to rest any concerns about Spark’s scalability. Databricks, which is the commercial outfit Read more…

Top Three Things Not To Do in Excel

Oct 2, 2014 |

Let’s face it: We all have seen a crazy Microsoft Excel spreadsheet or encountered one of its dreaded “Not Responding” messages. Unfortunately, the flexibility and ease of Excel makes it the ideal candidate for inappropriate use and widespread abuse. As the most widely used analytical tool in the world, Excel has indeed come a long way since the days of Visicalc and MultiPlan. Modern Excel 2013 and the latest Power BI add-ins do sizzle in demonstrations, but there are analyses Read more…

Five Steps to Running ETL on Hadoop for Web Companies

Sep 1, 2014 |

Mention ETL (Extract, Transform and Load) and eyes glaze over. The thought goes: “That stuff is old and meant for clunky enterprise data warehouses. What does it have to do with my Internet/Web/ecommerce application?” Quite a lot, actually. ETL did originate in enterprise IT where data from online databases is Extracted, then Transformed to normalize it and finally Loaded into enterprise data warehouses for analysis. Although Internet companies feel they have no use for expensive, proprietary data warehouses, the fact Read more…

Hadoop Labor Update: Cloudera Talks Impala 2.0 as Hortonworks Previews Kafka

Aug 29, 2014 |

Say what you will about Hadoop (and we do), the big data platform is evolving at an incredible rate. This week, two of the biggest Hadoop distributors, Hortonworks and Cloudera, shared how they’re working to improve two key aspects of the platform: real-time data pipelining via Apache Kafka and SQL-based data warehousing via Impala. Let’s start with Cloudera. This week, the Hadoop distributor announced that the upcoming release of Impala 2.0 will add much more complete SQL functionality to CDH, Read more…

How a Top Ad Firm Stopped Fearing Big Data and Learned to Love Analytics

Aug 18, 2014 |

Competition in the $500-billion global advertising industry is brutal, and ad firms that fail to deliver are quickly shown the door by their clients. But in this age of big data analytics, delivering results is not enough, as clients increasingly demand to know exactly how their media buys boosted demand. As the sixth largest media buying and marketing firm in the world, Havas Media has created and executed print, online, display, and TV advertising strategies for some of the world’s Read more…

News In Brief

S. Korea Eyes Big Data to Reduce Car Accidents

Oct 8, 2014 |

Among the many striking features of the bustling city of Seoul, South Korea, are its connectedness, a function of its extensive deployment of broadband networks, and its roaring, non-stop traffic. An electronic sign in the city’s shopping district actually keeps track of the number of Korean auto fatalities. The total seemingly increases by the minute. Hence, the Korean government wants to use spatial, weather and other big data sources to provide drivers with what officials call an accident forecast service Read more…

Twitter Funds MIT ‘Social Machines’ Effort

Oct 3, 2014 |

Machines could become more social thanks to a new Twitter-funded initiative at the Massachusetts Institute of Technology’s vaunted Media Lab that will seek to develop new technologies to make sense of social chatter ranging from tweets to data streams to digital content. MIT Media Lab announced Oct. 1 the creation of a Laboratory for Social Machines using $10 million in funding from Twitter over the next five years. Twitter said it also would provide the new MIT lab with full Read more…

MongoDB Teams with Weather Channel on Digital Alerts

Oct 1, 2014 |

Somebody is finally trying to do something about the weather. The Weather Channel has begun transitioning its digital platforms, including its mobile apps running on iOS and Android, to MongoDB’s database. The new platform will allow the Weather Channel to serve weather alerts and other real-time information to an estimated 40 million users, the database specialist announced Oct. 1. MongoDB said it would serve as the “data store” for all Weather Channel feeds and user information delivered by its digital Read more…

Stinger Initiative Prepares for .next Phase

Sep 4, 2014 |

The Hadoop developer community that recently delivered the final tweaks to the Stinger Initiative, an effort to bring SQL capabilities to Apache Hive, said its effort would focus on further enhancements to SQL for supporting real-time access in Hive along with support for transactional capabilities. In a blog post, Hortonworks developers Alan Gates and Raj Bains reported that 145 developers from 44 companies have contributed 390,000 lines of code over the last 13 months to the Stinger Initiative. They Read more…

Big Data Salaries, Job Offers on the Rise

Sep 3, 2014 |

As demand for predictive analytics professionals grows, median base salaries and retention bonuses continue to rise as more companies in more industries jump on the big data bandwagon. According to a salary survey of predictive analytics professionals released Sept. 3 by Burtch Works, the executive recruiting consultant, median base salaries over the last 12 months ranged from $95,000 for data analysts to $145,000 for managers. Seventy-one percent of data workers surveyed said they were eligible for bonuses while 91 percent Read more…

This Just In

SAS Visual Analytics Updated

Oct 22, 2014 |

LAS VEGAS, Nev., Oct. 22 — Controlling customer churn. Understanding marketplace sentiment. Pulling detailed graphical reports while traveling. Setting and meeting aggressive organizational goals. These challenges and more are met with enhancements to SAS Visual Analytics. “With SAS Visual Analytics, organizations can seamlessly manipulate, analyze and view data of any size, helping them transform it into stronger customer relationships, increased sales and efficiency, even healthier patients,” said Jim Davis, SAS Executive Vice President and Chief Marketing Officer. “Enhancements in the new version Read more…

Cognitive Scale Introduces Cognitive Cloud Platform

Oct 22, 2014 |

AUSTIN, Tex., Oct. 22 — After 18 months focused on product and technology development, Cognitive Scale today emerged from stealth with the industry’s first technology independent cognitive cloud platform, four vertical industry applications, new customers, partnerships with technology titans, and 22 patents filed. The company is on track to close 2014 with multi-million dollars in revenue resulting from several high-value customer contracts. Cognitive Scale is led by a team of serial entrepreneurs and technologists with in-depth enterprise software expertise in cognitive computing, Big Read more…

Kepware Releases Updated Product for Splunk

Oct 21, 2014 |

SAN FRANCISCO — Splunk Inc., provider of the leading software platform for real-time Operational Intelligence, and Kepware Technologies, developer of software solutions for Industrial Automation and Controls, today announced the availability of Kepware’s Industrial Data Forwarder (IDF) for Splunk. The forwarder, a plug-in for the widely deployed KEPServerEX platform, enables customers to send industrial data from sensors, devices and control systems to Splunk Enterprise and Splunk Cloud. Splunk users can easily collect, search and analyze industrial data to improve operations, accelerate troubleshooting, perform Read more…

Attunity Replicate 4.0 Introduced

Oct 20, 2014 |

Oct. 20 — Attunity Ltd., a leading provider of information availability software solutions, introduced today its new certified data integration solution for the Teradata Appliance for Hadoop from Teradata, the big data analytics and marketing applications company. With this rollout, Attunity Replicate has extended its capability to automate data loading and replication to and from Hadoop to the Teradata Database and Teradata Aster Database within the Teradata Unified Data Architecture (UDA), easily and efficiently. The solution, tested and certified with the Teradata Appliance for Hadoop, will Read more…

Teradata Announces New QueryGrid Data Fabric Capabilities

Oct 20, 2014 |

NASHVILLE, Tenn., Oct. 20 — Teradata Corp., the big data analytics and marketing applications company, today announced the data fabric enabled by Teradata QueryGrid which turns multiple best-of-breed solutions into an orchestrated analytical ecosystem. The data fabric weaves together multiple analytics, diverse data repositories, and disparate systems to provide business users a cohesive and uninterrupted analytic ecosystem. Today, companies employ many different technologies for operational and analytical systems, which are sourced from different vendors. Due to the lack of integration, users treat them Read more…