Sectors » Academia

Features

Tape Gets Second Wind as Big Data Mounts

Sep 16, 2014 |

Think tape is dead in our big data world? Think again. This week, the National Center for Supercomputing Applications (NCSA) announced that it bought 20PB of tape capacity to expand the world’s biggest data archive. Meanwhile, the LTO Program has plotted out a roadmap for the next decade that will eventually see a single LTO tape cartridge storing 120 TB of data. While tape is looked down upon in our speed-obsessed culture, the old standby has proven its relevance in Read more…

Big Data Challenges in Social Sciences & Humanities Research

Sep 8, 2014 |

One commonly mentioned benefit of the study of history is that we may gain insight into the thoughts and behavior of our ancestors. Learning where we came from can help us better prepare for where we are going. At the launch of this age of Big Data, we are only now well positioned to accomplish that ambition. Armed with Big Data Analytics, we can improve the well-being of ourselves and our offspring, particularly in Social Sciences & Humanities Research. In Read more…

Rise of the Big Data Engineer

Sep 8, 2014 |

Over the past three years, businesses have scrambled to hire data scientists who can spin big data into gold. But it turns out the person best equipped to get data analytics applications into production may be a good data engineer. The surge in demand for data scientists over the past few years has been well documented. McKinsey set the ball rolling with a report in 2011 that found the US faced a massive shortage of data scientists and others with Read more…

Charting Safe Passages Through the Urban Jungle with Big Data

Sep 5, 2014 |

When you visit a big American city for the first time, you probably wonder where it’s safe to go, and what areas it would be best to avoid. Wouldn’t it be great to have an app that advised you? Researchers recently demonstrated the viability of using big public data and innovative algorithms to recommend the safest, shortest passages through the city. Three researchers from the University of Pittsburgh and Boston University recently published a paper titled “Safe Navigation in Urban Read more…

TPC Crafts More Rigorous Hadoop Benchmark From TeraSort Test

Aug 18, 2014 |

While Moore’s Law has made computing and storage capacity less expensive with each passing year, the amount of data that companies are storing and the number and sophistication of the algorithms that they want to employ on that data to perform analytics is growing faster than the prices are dropping. And that means the bang for the buck of the underlying hardware and the analytics software that runs atop it matter. The trouble is that benchmarking systems takes far too Read more…

News In Brief

Gauging Human Emotions at the Stroke of a Key

Aug 22, 2014 |

Indian researchers using text pattern analysis and “keystroke dynamics” claim they have designed a computer program that can accurately recognize a computer user’s emotions. “Depending on the emotion,” the researchers claimed, they accurately recognized and “emotional states” most of the time, indeed with great precision: 87 percent. Writing in the journal Behavior & Information Technology, a team of Indian researchers asked volunteer typists to note their emotional state after typing “fixed” text along with prescribed intervals of regular computer use. Read more…

Climate Researchers Crunch Data on Weather Extremes

Aug 5, 2014 |

Few data science problems can top weather forecasting and climate modeling for sheer complexity. Hence, big data is playing a key role in tracking changes in global climate and, with it, weather and climate extremes. The application of data analysis to decades of weather and climate data can provide insights that inform billion-dollar investments in agriculture, commodities, insurance and the financial sector, experts stress. More insights could be drawn from recent research at Northeastern University in Boston that used climate Read more…

Can the ‘SP Machine’ Straighten Out Big Data?

Jun 30, 2014 |

A form of artificial intelligence variously referred to as “information compression” or the SP theory of intelligence promises to help solve some of the most vexing challenges associated with increasingly fragmented big data. In a recent article published in the journal IEEE Access, researcher Gerry Wolff of CognitiveResearch.org argues that the human brain in the form of what he calls an “SP machine” could help sift through the mountains of disparate scientific, business, social media and other forms of data Read more…

Big Data Forcing Update of SQL Standard

Jun 25, 2014 |

A proposed standard would extend the SQL database language to accommodate multidimensional “data cubes” generated by scientists and engineers. The effort promises to launch a new technology dubbed “array databases.” Proponents of the new standard, dubbed SQL/MDA, for “multidimensional array,” said it is needed because big data in science and engineering is structured differently from, say, business data often structured as simple tables. Multidimensional big data includes sensor outputs, imagery, simulations and statistical data. The proposed International Organization for Standards Read more…

Humanitarian Project Culls Data to Forecast Disasters

Jun 20, 2014 |

A research project sponsored by the National Science Foundation is attempting to apply the tools of big data to humanitarian efforts like forecasting force migrations of populations whether by natural or man-made disasters. One goal is to leverage data analytics to forecast humanitarian disasters in an attempt to mitigate the consequences of mass displacements caused by conflicts or disasters. “Early warning has been the holy grail of the humanitarian community for decades,” Jeff Crisp, senior director for policy and advocacy Read more…

This Just In

Databricks and O’Reilly Media Launch Apache Spark Developer Certification Program

Sep 18, 2014 |

BERKELEY, Calif., Sept. 18 — Databricks, the company founded by the creators of the popular open-source Big Data processing engine Apache Spark, and O’Reilly Media, the leading voice in Data Science, today announced the launch of the first, global Apache Spark Developer Certification program. Databricks’ Spark experts and O’Reilly’s editorial team are creating a program — consisting of a formal exam and subsequent certification — that establishes the industry standard for measuring and validating Spark technical expertise. As enterprises increasingly focus on Read more…

Research and Markets Adds Future of Big Data Analytics Report to Offering

Sep 16, 2014 |

Sept. 16 — Research and Markets has announced the addition of the “The Future of Big Data Analytics – Global Market and Technologies Forecast – 2015-2020″ report to their offering. Big data is data that exceeds the processing capacity of conventional database systems. The data is too big, moves too fast, or exceeds the limits of your database architectures. To gain value from this data, you must choose an alternate way to process it. Many argue that Big Data is all talk and no Read more…

UA Partners with Lockheed Martin to Create Data Analytics Lab

Sep 10, 2014 |

TUSCALOOSA, Ala., Sept. 10 — Imagine saving companies hundreds of thousands of dollars by having college students find cost-saving measures in bits of data as part of a class project. As a leader in business analytics education since 2002, The University of Alabama’s Culverhouse College of Commerce has been doing just that. Now, it’s expanding on this innovative approach by partnering with advanced technology company Lockheed Martin to combine academia and industry to create a first-of-its-kind data analytics laboratory to help Read more…

Big Data Partnership Selected as Databricks Accredited Apache Spark Training Partner

Sep 9, 2014 |

LONDON, U.K., Sept. 9 — Big Data Partnership, the leading big data services company, today announced an expansion of its curriculum and a partnership with Databricks to offer Europe’s first Apache Spark training programme. Big Data Partnership provides vendor-agnostic big data consulting, training and support for diverse industries including web, financial services, telecoms, utilities, defence and media. Its extensive client list boasts several leading Fortune 500 companies. Big Data Partnership offers a unique breadth of knowledge of open source big data technologies, which is reflected Read more…

Toshiba Collaborates with Johns Hopkins on Big Data Healthcare Research

Sep 8, 2014 |

TOKYO, Japan, Sept. 8 — To further the potential of Big Data to predict and prevent illness, Toshiba Group has established the Toshiba Center for Big Data in Healthcare at the Science + Technology Park at Johns Hopkins in Baltimore, Md. The Center’s principal project is a collaboration with the Johns Hopkins radiation oncology department to study treatment pathways and outcomes in head and neck and lung cancer patients. Combining the expertise from Johns Hopkins’ world-renowned clinical research institution and its Big Data Read more…