Technologies » Systems

Features

Who IBM’s Server Group Turns To for Machine Data Analytics

Aug 28, 2014 |

IBM’s engineering prowess is second to none, and its Systems and Technology Group builds the computers that run the world’s biggest companies. But when IBM’s STG unit went looking for a way to predict failures by analyzing log data returned by its customers’ servers and storage arrays, it looked externally to a little-known machine data analytics startup from Santa Clara. Glassbeam got its start five years ago, before the Internet of Things (IOT) became the industry’s hottest buzzword and out-hyped Read more…

How to Move 80PB Without Downtime

Aug 25, 2014 |

When the online photo company Shutterfly decided to move its entire data center recently, the possibility of downtime was a big issue. After all, the company had 80 petabytes of customer data spread across tens of thousands of spinning disks, and those disks wouldn’t be spinning while being physically moved. Months later, after the last deliver made its way to Shutterfly‘s new data center, not one piece of data was lost or even temporarily unavailable from the company’s website. How Read more…

AMPLab’s Tachyon Promises to Solidify In-Memory Analytics

Aug 14, 2014 |

U.C Berkeley’s AMPLab first landed on the radar screens of data scientists with Apache Spark, which promises to provide an in-memory data processing framework to replace or augment MapReduce. More recently, the tech wizzes at AMPLab have whipped up Tachyon, a new distributed file system that sits atop HDFS and aims to allow multiple Hadoop or Spark applications and jobs to access the same data at memory speeds without fears of corrupting it. The rapid rise of Apache Spark demonstrates Read more…

3D Visualizer Goes from Cybersecurity to Open Source

Aug 4, 2014 |

A 3D visualization tool developed by the network security firm OpenDNS to identify malicious websites and domains will soon be available to anybody via open source license. While OpenGraphiti was developed to solve problems in the security realm, the GPU-powered software can be used to visualize large datasets for any use case. OpenDNS security researcher Thibault Reuille started developing OpenGraphiti about a year ago to help the firm ferret out malicious websites and domains, and identify the cybercriminals controlling them. Read more…

Now and Then: The Evolution of In-Memory Computing

Jul 29, 2014 |

The history of data warehousing, big data, and analytics can be described as a constant challenge to process and analyze ever-increasing volumes of data in shorter amounts of time. Fundamentally, the single biggest factor that affects our ability to process data is the speed at which we can access it, and then do something with it. Data warehousing architectures have addressed this over the years by adopting massively parallel processing (MPP) designs, but the lower latency of in-memory computing combined Read more…

News In Brief

Data Tools Help Researchers Tackle Pediatric Cancer

Sep 10, 2014 |

A genomic data analysis platform being installed at the National Cancer Institute will deliver rapid analysis of billions of data points required when sequencing human DNA and other genomic data. Translational Genomics Research (TGen) said Sept. 10 it is providing the National Cancer Institute with high performance computing and bioinformatics support along with specialized tools designed to support pediatric cancer research programs. Those efforts include personalized medicine trial for pediatric cancer patients being conducted by the Neuroblastoma and Medulloblastoma Translational Read more…

Survey: Big Data Deployments Reaching ‘Tipping Point’

Sep 8, 2014 |

Most big data deployments are still being evaluated but may be approaching a “tipping point” as they move toward production, according to big data market researcher Wikibon. Wikibon analysts stressed that much of its recent survey data represents the sentiments of early adopters of big data analytics, adding that analytics technologies are still “relatively immature.” Another Wikibon survey last year concluded that nearly half of big data practitioners had yet to realize a return on their data analytics investment. Despite Read more…

EnterpriseDB Throws Down PostgreSQL Gauntlet

Aug 29, 2014 |

A new database development environment released earlier this month has been tweaked to leverage the NoSQL capabilities in PostgreSQL, the open source object-relational database tool, to build next-generation web applications. EnterpriseDB, the Postgres specialist based in Bedford, Mass., said its Postgres Extended Datatype Development Kit would allow application developers to use Postgres for the types of applications that previously required a specialized NoSQL-only tool. To enable this, the kit is said to expand Postgres capabilities for handling document databases with Read more…

Selfies Spawn Photo Analytics

Aug 21, 2014 |

An estimated 1.8 billion photos are shared on social media each day. Current “social listening tools” can’t analyze all this data. Enter Ditto Labs Inc., which touts its proprietary “visual recognition engine” that locates brand names in social media posts, then turns the information over to marketing geniuses. It’s the brave new world of “photo analytics,” according to Ditto, that uses its recognition engine to scan photos for corporate logos that might hint at how consumers “interact” with products and Read more…

From Data Wrangling to Data Harmony

Aug 18, 2014 |

More and better automation tools such as machine-learning technologies are needed to free data scientists from mundane “data-wrangling” chores. Those tools would allow scientists to focus on gleaning insights from prepared data, a range of experts told the New York Times in a recent survey of the state of big data. The newspaper reported that data scientists spend from 50 percent to 80 percent of their time organizing data, or “data janitor work,” before they could begin sifting through it Read more…

This Just In

Zenoss Introduces New ZenPacks for Big Data

Sep 16, 2014 |

AUSTIN, Tex., Sept. 16 — Zenoss Inc., the leading provider of unified monitoring and analytics solutions for physical, virtual, and cloud-based IT infrastructure and applications, today announced new ZenPacks for Big Data technologies including Apache Hadoop, Apache HBase, and Apache ZooKeeper. “Big Data challenges exist in every enterprise because today’s complex infrastructures generate more data than ever. Storing and properly analyzing that data can yield significant operational benefits if done correctly. Apache Hadoop, HBase, and ZooKeeper are the emerging market leaders, Read more…

Univa Releases New Version of Grid Engine

Sep 2, 2014 |

HOFFMAN ESTATES, Ill., Sept. 2 – Univa, the Data Center Automation Company, announced today that Univa Grid Engine is prepared to meet the needs of tomorrow for the HPC and Big Data communities. The company released version 8.2.0 of Univa Grid Engine, the most widely distributed resource management software platform. “This version of Univa Grid Engine is a result of the feedback and consumer-driven requests we have received from clients since Univa became the sole commercial provider of Grid Engine last fall,’’ Read more…

IBM Announces Advances in Watson’s Cognitive Computing Capabilities

Aug 28, 2014 |

NEW YORK, N.Y., Aug. 28 – IBM today announced significant advances in Watson‘s cognitive computing capabilities that are enabling researchers to accelerate the pace of scientific breakthroughs by discovering previously unknown connections in Big Data. Available now as a cloud service, IBM’s Watson Discovery Advisor is designed to scale and accelerate discoveries by research teams. It reduces the time needed to test hypotheses and formulate conclusions that can advance their work — from months to days and days to just hours — bringing new levels of Read more…

IBM and Inspur to Advance Big Data and Analytics Innovation in China

Aug 26, 2014 |

ARMONK, N.Y. and JINAN, China, Aug. 26 — IBM and Inspur today announced the companies are committing to make Big Data and Analytics and transaction processing solutions available to customers and ISVs in China, giving them the ability to access and make sense of huge volumes of information in real-time. The two companies have collaborated and enabled IBM DB2 and IBM WebSphere Application Server software to operate on Inspur TS K1 Systems. In addition, Inspur will leverage an OpenPOWER Foundation reference design and capabilities to create innovative system solutions. Read more…

IBM to Add Power Systems Linux Services to Innovation and Client Centers

Aug 22, 2014 |

CHICAGO, Ill., Aug. 22 – At the LinuxCon North America conference today, IBM announced it is tapping into its global network of over 50 IBM Innovation Centers and IBM Client Centers to help IBM Business Partners, IT professionals, academics, and entrepreneurs develop and deliver new Big Data and cloud computing software applications for clients using Linux on IBM Power Systems servers.   Last year IBM committed $1 billion in new Linux and open source technologies for its Power Systems servers including the opening of five new Read more…