Sectors » Science

Features

‘What Is Big Data’ Question Finally Settled?

Oct 29, 2014 |

People have been debating what “big data” means ever since the term appeared in the lexicon. Researchers at Cal Berkeley recently pepper dozens of prominent data scientists and industry leader with the question in hopes of settling the big question once and for all. You’ve undoubtedly heard many definitions for big data over the years. For some, you have big data when it can’t be stored on a single computer, or it’s the combination of volume, velocity, and variety (some Read more…

Here’s Another Option for Hadoop Enterprise Search

Aug 8, 2014 |

The software stacks of many Hadoop distributions feature Apache Lucene and Solr as the enterprise search component. But the folks at the French firm Sinequa say Hadoop customers will get more actual work done–and quickly analyze massive amounts of poly-structured data from dozens of other sources in multiple languages–by using its enterprise search solution. Hadoop, machine learning algorithms, and graph databases may get most of the headlines in our big data world, but good old search engines continue to be Read more…

Ersatz Thinks Up a GPU-Powered Neural Network

Jun 11, 2014 |

If you want to use neural networks to build models that can learn from data in human-like ways, but are having trouble figuring out where to start, you may want to check out Ersatz, the name of the new GPU-powered deep learning platform officially unveiled today by Ersatz Labs. The domain of machine learning is advancing very quickly at the moment, driven by humankind’s rather sudden (and entirely insatiable) desire to keep and understand all data. There are also big Read more…

Array Databases: The Next Big Thing in Data Analytics?

Apr 9, 2014 |

There’s no lack of database choices when it comes to building your next big data analytics platform. Relational data stores, column-oriented databases, in-memory data grids, graph databases, scale-out NewSQL systems, and Hadoop will all get time in the sun. But according to database pioneer Mike Stonebraker, none of these hold a candle to array databases when it comes to running complex analytics on big data sets.

The 2013 Big Data Year in Review

Dec 20, 2013 |

While still in its infancy, the big data technology trend has made a lot of substantial progress since it gained traction at the beginning of this decade. The year 2013 was a big year with advances being made in virtually every quarter of the space. In this feature, we take a look at some of the significant trends that have crossed our desks in the past year — wrapped up and presented to you with a pretty bow. Out with the old, in with the new — it’s the Datanami 2013 Year in Review!

News In Brief

Google Launches Bigtable Hosting Service

May 7, 2015 |

Google yesterday announced the beta launch of Google Cloud Bigtable, a hosted version of its wide-column NoSQL database. The service is accessible via the standard HBase API–making it instantly integrated with the Hadoop stack–and blows away other hosted NoSQL offerings in terms of latency and throughput, the company claims. You might know Bigtable as the database at the heart of many Google offerings, including Gmail, Google Search, YouTube, Google Earth, and Google Analytics. But the technology, which Google engineers Jeff Read more…

Smart Grid Gets Smarter With Analytics Platform

Apr 13, 2015 |

Among the growing set of tools for the emerging smart grid are data analytics platforms designed to provide utilities with a real-time picture of what is happening in the power delivery system. As more renewable energy sources are plugged into the smart grid, analytics is expected to play a larger roll in how utilities integrate these new energy sources to meet daily peak demand. As utilities look for ways to improve grid reliability and their relationship with ratepayers, companies like Read more…

Data Companies Work With Citizen Scientists on Climate

Dec 11, 2014 |

Storage vendor EMC Corp. is joining forces with big data and cloud specialist Pivotal and the EarthWatch Institute in an effort to apply analytical tools to the study the impact of climate change. The partners along with Schoodic Institute at Acadia National Park will study the interactions between nature and climate as part of a broader effort to promote citizen science using big data lakes, analytical tools and visualizations, the partners said. The “Big Data vs. Climate Change” initiative was Read more…

Google, Wireless Partner Look to Merge Cloud, IoT

Dec 2, 2014 |

Google Cloud Platform and Telit Wireless Solutions, an “enabler of the Internet of Things,” are joining forces to sponsor an IoT competition aimed at encouraging technology innovation around connected consumers and their devices. The IoT Big Data Challenge will encourage developers to submit new applications in business, consumer and “social well-being” categories. That third category includes new applications that would benefit society. The competition requires contestants to create web-based and mobile apps based on data from a wide variety of Read more…

‘Datathons’ Emerge as Training, Recruitment Tool

Nov 24, 2014 |

As a big data ecosystem begins to flourish, “datathons” are emerging as a way to attract future data scientists since participants are required during competitions to collaborate with team members from other disciplines. The latest example comes from Ireland where a university working with a regional bank recently awarded a “big data prize” to a pair of brothers studying the commercial applications of computer science. The brothers, Sam and Jeremy Bowles, computer science students at the Dublin Institute of Technology Read more…

This Just In

Planet OS Joins AWS in Data Discovery for NOAA’s Big Data Project

Apr 22, 2015 |

SUNNYVALE, Calif., April 22 — Planet OS is honored to join Amazon Web Services (AWS) as a member of their Data Alliance within NOAA’s Big Data Project announced today. The company will work together with The Weather Company and ESRI under the Cooperative Research and Development Agreement (CRADA) to research and test solutions for bringing NOAA’s vast information to the cloud where both the public and industry can easily and equally access, explore, and create new products from it, thus fostering new Read more…

Teradata Delivers Analytics Innovation for Life Sciences

Apr 21, 2015 |

BOSTON, Mass., April 21 — Teradata, the big data analytics and marketing applications company, today announced the newest analytic innovation for pharmaceutical companies. The Teradata Analytics Framework for Life Sciences helps organizations integrate and analyze data from areas such as Research and Early Discovery (RED), clinical analysis, Real-World Evidence (RWE), and finance. By fusing data from multiple, relevant sources, companies can benefit by bringing safer, more effective treatments to market quickly while also optimizing value chain economics. The Teradata Analytics Framework for Life Sciences is based on Read more…

DESY and IBM Develop Big Data Architecture for Science

Aug 21, 2014 |

ARMONK, N.Y. and HAMBURG, Germany, Aug. 21 — IBM today announced it is collaborating with Deutsches Elektronen-Synchrotron (DESY), a leading national research center in Germany, to speed up management and storage of massive volumes of x-ray data. The planned Big Data and Analytics architecture based on IBM software defined technology can handle more than 20 gigabyte per second of data at peak performance and help scientists worldwide gain faster insights into the atomic structure of novel semiconductors, catalysts, biological cells and other samples. DESY’s 1.7 Read more…

DDN Reports Results for First Half of 2014

Aug 19, 2014 |

SANTA CLARA, Calif., Aug. 19 — DataDirect Networks (DDN) today announced impressive revenue traction for the first six months of 2014, demonstrating a strong trajectory of profitable growth for the company heading into the second half of the year. The company added more than 20 net new petabyte-class customers including one of world’s largest banks, a leader in global oil and gas exploration, and a major Japan-based automobile manufacturing company, increasing the storage capacity sold year-to-date to over 250PBs. In the first Read more…

NCAR Enhances Big Data Services for Climate and Weather Researchers

Aug 6, 2014 |

BOULDER, Colo., Aug. 6 — The National Center for Atmospheric Research (NCAR) has recently implemented an enhanced data sharing service that allows scientists increased access to data as well as improved capabilities for collaborative research. In addition to data sharing, NCAR has significantly upgraded its centralized file service, known as the Globally Accessible Data Environment (GLADE). Managed by NCAR’s Computational and Information Systems Laboratory (CISL), both GLADE and the data sharing service are important upgrades for the high-performance computing (HPC) Read more…