Big Data • Big Analytics • Big Insight

Sectors » Academia


The Rise of Predictive Modeling Factories

Feb 9, 2015 |

So you installed Hadoop and built a data lake that can store petabytes of data. Now what? According to leaders in predictive analytics, the best thing you can do is to build a predictive model factory that automates much of the drudgery out of running machine learning algorithms at scale. “Every data lake needs a predictive modeling factory,” says SriSatish Ambati, the co-founder and CEO of H2O, a developer of in-memory machine learning technology. “Predictive analytics as a whole is Read more…

Will Big Metadata Rat You Out?

Feb 5, 2015 |

Data scientists are usually taught to be cautious with personally identifiable (PII) data and take pains to ensure that it’s properly anonymized and aggregated for authorized uses. But as MIT researchers recently showed, it’s quite possible to “reidentify” a person by analyzing credit card metadata even after it has been anonymized. Writing in the magazine Science, four MIT researchers demonstrated a method that can be used to identify individuals by finding links among relatively course-grained credit card metadata. While the Read more…

9 Places to Get Big Data Now

Jan 29, 2015 |

Discussions of big data often revolve around what new technologies and processes people are using to analyze data. Hadoop, in-memory databases, and machine learning algorithms are getting lots of attention in this regard. But sometimes we tend overlook the most important ingredient in big data analytics: the data itself. Much of big data that organizations want to analyze exists within their own four walls. Relational databases make great repositories for structured data like account records, orders, and customer lists. Depending Read more…

Three Ways Big Data and HPC Are Converging

Jan 27, 2015 |

Big data is becoming much more than just widespread distribution of cheap storage and cheap computation on commodity hardware.  Big data analytics may soon become the new “killer app” for high performance computing (HPC). There is more to big data than large amounts of information.  It also pertains to massive distributed activities such as complex queries and computations (a.k.a analytics).  In other words, deriving value through computation is just as “big” as the size of the data sets themselves.  In Read more…

Rethinking Hadoop for HPC

Jan 26, 2015 |

Hadoop’s momentum has caught the eye of those in the high performance computing (HPC) community, who want to participate and benefit from the fast pace of development. However, the relatively poor performance and high latency of Hadoop applications is a real concern. To address the problem and make Hadoop a better fit for HPC resources, some are exploring how they can rewrite certain components of Hadoop in a more HPC-like manner. Those in the HPC world look at what’s happening Read more…

News In Brief

U.S. Names First Chief Data Scientist

Feb 24, 2015 |

An industry veteran and college math professor who is partially credited with coining the title “data scientist” has been named the nation’s first chief data scientist. The White House announced the appointment of DJ Patil to the new post last week. Patil also will serve as the Obama administration’s deputy chief technology officer for data policy, the White House said. Patil most recently served as a vice president at RelateIQ, a customer relationship management specialist acquired by Salesforce in July Read more…

Watson’s Take on the State of the Union

Jan 29, 2015 |

Every year, as the State of the Union address comes to a close, analysts, political correspondents and politicians alike come forward to offer unique take on the president’s speech. This year, however, one new voice is chiming in: that of IBM’s Watson. Using a recording of President Obama’s address, MSNBC tapped the IBM Watson User Modeling service (one of IBM’s Watson Developer Cloud services) to take a deeper look at the language, tone, and topics covered to compare its outlook Read more…

The Humanist’s Emerging Role in Big Data

Jan 21, 2015 |

The combination of big data and advanced analytics can help us find answers to questions that may otherwise stay unknown. But what questions are we asking of our big data sets, and what data are we using? The answers are important, and point to the need for a humanist’s touch in big data projects. In a recent TED talk and report, Susan Etlinger, a social media analytics expert at the Altimeter Group, elaborated on the need to understand the context Read more…

Kindergarten: The New Big Data Training Ground

Jan 8, 2015 |

A good education, it is often said, starts at home. And according to a new report, big data training should start in kindergarten. The earlier that educators start laying the foundation for the deep analytical skills required for the new data-driven economy, the better positioned tomorrow’s workforce will be to match the looming demand for data scientists. That’s the gist of a new report issued by the Oceans of Data Institute, which cited the 2011 McKinsey report that outlined the Read more…

‘Datathons’ Emerge as Training, Recruitment Tool

Nov 24, 2014 |

As a big data ecosystem begins to flourish, “datathons” are emerging as a way to attract future data scientists since participants are required during competitions to collaborate with team members from other disciplines. The latest example comes from Ireland where a university working with a regional bank recently awarded a “big data prize” to a pair of brothers studying the commercial applications of computer science. The brothers, Sam and Jeremy Bowles, computer science students at the Dublin Institute of Technology Read more…

This Just In

ISC Cloud & Big Data is Now Open for Research Paper Submission

Feb 26, 2015 |

FRANKFURT, Germany, Feb. 26 – The organizers of the inaugural ISC Cloud & Big Data conference are pleased to offer engineers and scientists in academia, industry, and the government the opportunity to be a part of this new forum. The organizers are looking forward to welcoming international attendees – IT professionals, consultants and managers from organizations seeking information about the latest cloud and big data developments. Researchers in these two areas are encouraged to submit research papers, which will be presented to attendees Read more…

CrowdFlower Releases 2015 Data Scientist Report

Feb 13, 2015 |

SAN FRANCISCO, Calif., Feb. 13 – CrowdFlower, the leading data enrichment platform for data scientists, today released its 2015 Data Scientist Report ( Findings revealed that data scientists saw messy, disorganized data as a major hurdle preventing them from doing what they find most interesting in their jobs: predictive analysis and data mining for behavioral patterns and future trends. The majority of data scientists surveyed also acknowledged the skills shortage within their field. Salient findings of the report uncover what is Read more…

IBM Expands Power Systems Academic Initiative

Feb 12, 2015 |

ARMONK, N.Y., Feb. 11 – IBM announced that its Power Systems Academic Initiative (PSAI) has achieved a major milestone by enrolling more than 300 colleges and universities around the globe in the program, providing these institutions with access to IBM Power Systems technology and helping to arm students with skills to handle new workloads like Big Data, cloud, mobile and social, that are crucial in today’s job market. The explosion of data and the cloud has fueled the need for employees with specialized talent. Between now and 2022, the U.S. Bureau Read more…

IBM Expands Global Research Network into South Africa

Feb 6, 2015 |

JOHANNESBURG, South Africa, Feb. 6 – IBM today announced plans to expand IBM Research – Africa with a new laboratory in Johannesburg beginning April 2015.  It will focus on advancing Big Data, cloud and mobile technologies to support South Africa’s national priorities, drive skills development and foster innovation-based economic growth. As part of a 10-year investment program through the Department of Trade and Industry and working closely with the Department of Science and Technology, the new research facility will be based at the University of Witwatersrand Read more…

MapR Unveils Free On-Demand Training Program

Jan 27, 2015 |

SAN JOSE, Calif., Jan. 27 — MapR Technologies, Inc., provider of the top-ranked distribution for Apache Hadoop, today announced the availability of free Hadoop On-Demand Training for developers, analysts and administrators which represents a $50M in-kind contribution to the broad Hadoop community. The Hadoop training program is a multi-course curriculum designed to expand worldwide adoption of Hadoop technology. The curriculum provides engaging and interactive video lessons, hands-on exercises, labs and quizzes, enabling professionals to acquire valuable Hadoop skills and knowledge Read more…