Sectors » Academia

Features

TPC Crafts More Rigorous Hadoop Benchmark From TeraSort Test

Aug 18, 2014 |

While Moore’s Law has made computing and storage capacity less expensive with each passing year, the amount of data that companies are storing and the number and sophistication of the algorithms that they want to employ on that data to perform analytics is growing faster than the prices are dropping. And that means the bang for the buck of the underlying hardware and the analytics software that runs atop it matter. The trouble is that benchmarking systems takes far too Read more…

AMPLab’s Tachyon Promises to Solidify In-Memory Analytics

Aug 14, 2014 |

U.C Berkeley’s AMPLab first landed on the radar screens of data scientists with Apache Spark, which promises to provide an in-memory data processing framework to replace or augment MapReduce. More recently, the tech wizzes at AMPLab have whipped up Tachyon, a new distributed file system that sits atop HDFS and aims to allow multiple Hadoop or Spark applications and jobs to access the same data at memory speeds without fears of corrupting it. The rapid rise of Apache Spark demonstrates Read more…

Masters of Big Data: New Graduate Programs Debut at U.S. Universities

Aug 12, 2014 |

This fall, thousands of budding data scientists around the country will begin their march toward advanced degrees–and the near certainty of multiple job offers upon graduation. At least seven new graduate-level programs are set to fire up at colleges and universities around the country, while a handful of new undergraduate programs are also popping up to give data scientists a head start on their schooling. The demand for data scientists remains extremely high as companies across all industries race to Read more…

Slicing and Dicing Music Data for Fun and Profit

Jul 21, 2014 |

The advent of big data analytics promises to have a profound impact on many aspects of human life, including how we work and play. Big data is even influencing the arts, where the field of music data science is rearranging our relationship with music. We’re in the midst of a boom in music data science that can be traced back to 1999, when two important events occurred. First, Shawn Fanning unleashed Napster to the world, thereby giving people the power Read more…

Get Your Big Data Analytic Competition On

Jul 8, 2014 |

Are you interested in proving your big data analytic worth to a doubtful world? There may be no better way than participating in an officially sanctioned analytic competition, which will let you see how your skills stack up in pursuit of big data glory and cash prizes. AlgoMost is putting $15,000 on the table in a competition to see who can most accurately predict which publicly traded companies will get acquired through the end of the year. The Russian data Read more…

News In Brief

Climate Researchers Crunch Data on Weather Extremes

Aug 5, 2014 |

Few data science problems can top weather forecasting and climate modeling for sheer complexity. Hence, big data is playing a key role in tracking changes in global climate and, with it, weather and climate extremes. The application of data analysis to decades of weather and climate data can provide insights that inform billion-dollar investments in agriculture, commodities, insurance and the financial sector, experts stress. More insights could be drawn from recent research at Northeastern University in Boston that used climate Read more…

Can the ‘SP Machine’ Straighten Out Big Data?

Jun 30, 2014 |

A form of artificial intelligence variously referred to as “information compression” or the SP theory of intelligence promises to help solve some of the most vexing challenges associated with increasingly fragmented big data. In a recent article published in the journal IEEE Access, researcher Gerry Wolff of CognitiveResearch.org argues that the human brain in the form of what he calls an “SP machine” could help sift through the mountains of disparate scientific, business, social media and other forms of data Read more…

Big Data Forcing Update of SQL Standard

Jun 25, 2014 |

A proposed standard would extend the SQL database language to accommodate multidimensional “data cubes” generated by scientists and engineers. The effort promises to launch a new technology dubbed “array databases.” Proponents of the new standard, dubbed SQL/MDA, for “multidimensional array,” said it is needed because big data in science and engineering is structured differently from, say, business data often structured as simple tables. Multidimensional big data includes sensor outputs, imagery, simulations and statistical data. The proposed International Organization for Standards Read more…

Humanitarian Project Culls Data to Forecast Disasters

Jun 20, 2014 |

A research project sponsored by the National Science Foundation is attempting to apply the tools of big data to humanitarian efforts like forecasting force migrations of populations whether by natural or man-made disasters. One goal is to leverage data analytics to forecast humanitarian disasters in an attempt to mitigate the consequences of mass displacements caused by conflicts or disasters. “Early warning has been the holy grail of the humanitarian community for decades,” Jeff Crisp, senior director for policy and advocacy Read more…

Climate Data Being Analyzed to Predict California Droughts

Jun 10, 2014 |

California’s prolonged drought and the threat it poses to the Golden State’s huge agricultural sector has prompted some technology companies to harness big data as a way of gauge future water supplies across the parched state. Meanwhile, a new NASA climate probe is expected to generate a database of information about the Earth’s carbon sinks and emissions. The climate situation on the U.S. West Coast is becoming so dire that California’s Central Valley is even experiencing declines in a local Read more…

This Just In

Former CMU Computer Science Dean Assisting in White House Policy Office

Aug 21, 2014 |

PITTSBURGH, Penn., Aug. 21 — Randal E. Bryant, who finished a decade of service as dean of Carnegie Mellon University’s School of Computer Science on June 30, has begun a temporary assignment in the White House’s Office of Science and Technology Policy (OSTP) to provide analysis and advice on Big Data. Bryant, who is on sabbatical from his position as University Professor of Computer Science, expects to spend 10-12 months in the OSTP’s Technology and Innovation Division, where he is working as an Read more…

ASU Using NSF Grant to Form Data Analytics Program

Aug 19, 2014 |

MONTGOMERY, Ala., Aug. 19 – Big data is a term increasingly used in technology sectors, referring to a volume of data so massive and complex that it becomes difficult to process using standard database and software techniques. IT experts around the world say that big data is changing the way people work together, and now ASU will play a major role in making that change more manageable. Alabama State University’s Department of Mathematics and Computer Science has received a $399,976 grant Read more…

Speakers Announced for EnterpriseHPC’14 Summit

Aug 18, 2014 |

CARLSBAD, Calif., Aug. 18 – The EnterpriseHPC’14 summit, the world’s first live event dedicated to exploring the emergence of advanced scale enterprise computing, today announced the line-up of speakers for the program, including keynotes Vince Gennaro, President of the Society for American Baseball Research (SABR), Ren Wu, Distinguished Scientist, Baidu IDL, Pete Ungaro, CEO of Cray, Inc., and Paul Bloch, President & Co-founder of DataDirect Networks, Inc. The summit takes place September 7-9, 2014 in Carlsbad, CA, and is dedicated to Read more…

University Adds New Supercomputing Center

Aug 13, 2014 |

ARMONK, N.Y. and LAKELAND, Fla., Aug. 13 –  Florida Polytechnic University, Flagship Solutions Group, and IBM today announced a new supercomputing center at the University composed of IBM high performance systems, software and cloud-based storage, to help educate students in emerging technology fields. Florida Polytechnic University is the newest addition to the State University System of Florida and the only one dedicated exclusively to science, technology, engineering and mathematics (STEM). Florida Polytechnic University will welcome its inaugural class of 500 students in August. Read more…

IU Develops New Suite of Data Provenance Software Tools

Aug 6, 2014 |

BLOOMINGTON, Ind., Aug. 6 — The Indiana University Data to Insight Center (D2I) has released a new suite of software tools, Komadu, designed to help researchers track and verify digital data, a crucial step in computational research. As today’s researchers deal with ever-expanding data sets and share them with colleagues around the world, it’s increasingly important for that data to have a documented history, proving its validity and quality. Called “data provenance,” this history reveals the origins of each data Read more…