Tag: big data

Big Data and the Cloud: Uncover New Insights Hiding in Your Data

May 30, 2016 |

Modern data science can unlock new innovation in healthcare, bioinformatics, genetic research, and other related fields. New personalized medicine programs, for instance, can identify previously unrecognized disease risk factors by applying analytics to vast amounts of genomic and clinical data. Hospitals can pore through EMR and operational data to pinpoint sources of infection. Public health agencies can use longitudinal population data to more accurately inform policy. These are just a few examples. But all depend on one basic premise: many Read more…

Data is the only Vertical

May 30, 2016 |

In the past few years we’ve seen software giants like Alphabet’s Google and Amazon.com penetrate more and more industry verticals. Google began as a search bar but now plays in the mobile (Android), media (YouTube), hardware (Motorola), transportation (Waze) and IoT (Nest) spaces as well. Likewise, Amazon.com was originally a site to sell books online, but now sells every product under the sun and operates the world’s largest public cloud through Amazon Web Services (AWS). In addition to the behemoths Read more…

Kafka Creators Tackle Consistency Problem in Data Pipelines

May 24, 2016 |

One of the big questions surrounding the rise of real-time stream processing applications is consistency. When you have a distributed application involving thousands of data sources and data consumers, how can you be sure that the data going in one side comes out the other unchanged? That’s the challenge that Confluent is addressing with today’s launch of new software for Apache Kafka. If you’re moving big data today, you’re probably using Apache Kafka, or at least looking at it. The Read more…

Cray Bakes Big Data Software Framework Into Urika-GX Analytics Platform

May 24, 2016 |

Cray continued its courtship of the advanced scale enterprise market with today’s launch of the Urika-GX, a system that integrates Cray supercomputing technologies with an agile big data platform designed to run multiple analytics workloads concurrently. While Cray has pre-installed analytics software in previous systems, the new system takes pre-configuration to a new level with an open software framework designed to eliminate installation, integration and update headaches that stymie big data implementations. Available in the third quarter of this year, the Read more…

Big Data Doesn’t Always Mean Better Business

May 24, 2016 |

There is an unprecedented volume of data being created, with an unprecedented number of people around the world regularly producing and storing data. Research shows that 90 percent of the data in the world today was created in the last two years alone. This may not be news to those of us who plan for, manage, or process this barrage of data, but questions still remain about best practices when taking on infrastructure changes to address big data in a big Read more…

Biotech Crop Discovery Poised for Fast Growth Thanks to Big Data

May 19, 2016 |

Big agriculture companies have been using HPC techniques to understand and manipulate the genes of food staples like corn and soy for many years. Now, thanks to the big data revolution, that kind of fine-grained genetic control will soon be wielded by smaller firms targeting a much wider swath of biotech crops. One of the companies on the cutting edge of biotech crops is Benson Hill Biosystems. The company, which came out of the Donald Danforth Plance Science Center in Read more…

Why Winning Politics Is Now Tied to Big Data Analytics

May 10, 2016 |

One of the storylines in this year’s presidential election is how both major political parties are using big data analytics to inform their decisions and try to get ahead. But what you may not realize is how pervasive big data has become up and down the ticket. Here’s an inside look at how two of the leading analytic firms are helping their parties win with analytics. In the last two general elections, the capability of Barack Obama’s campaign team to Read more…

What Lies Beneath Development

May 6, 2016 |

The world is all abuzz talking about big data and using analytics to help improve business results. Ironically, software teams rarely use data to analyze and improve their own processes. Many internal software teams today don’t track fairly simple metrics including: how often code is submitted, by whom and the quality impact. By monitoring basic activities and others, software teams can identify patterns of behavior and best practices. That’s not to say that engineering managers don’t see the need for Read more…

How Credit Card Companies Are Evolving with Big Data

May 3, 2016 |

As overseers of our digitized marketplaces, credit card companies have a bird’s eye view of what we buy. If you want to know what American consumers are interested in, there’s perhaps no better way that to examine their purchase histories, so it’s no wonder that credit card companies, such as American Express, Capital One, JP Chase Morgan, and Citibank are at the forefront of big data mining. One of the credit card companies doing a lot of work in this Read more…

How Big Data Improves Logging and Compliance

May 2, 2016 |

Compliance has never been easy. Organizations have to meet a myriad of external regulations, frameworks, and internal mandates such as PCI, HIPAA, FISMA, NERC, ISO and the EU Data Directive, many of which have a long list of required technical controls. Many large organizations have five or more regulations or mandates they must comply with. Organizations face many challenges to meet these requirements including experiencing difficulty complying with the technical controls required by the regulations and mandates, especially: Requirements around Read more…