Follow Datanami:

Tag: performance

Dr. Elephant Leads the Performance Parade

Jan 12, 2018 |

I started working on big data infrastructure in 2009 when I joined Cloudera, which at the time was a small startup with about 10 engineers. It was a fun place to work. Read more…

Big Performance Gains Seen Across SQL-on-Hadoop Engines

Oct 18, 2016 |

You can’t really go wrong these days when it comes to picking a SQL-on-Hadoop engine. As long as you stick to the mainstream open source products like Hive, Impala, Spark SQL, and Presto, your SQL queries are likely running 2-4x faster than they did earlier this year, without changing your queries or buying more hardware. Read more…

Unraveling Hadoop and Spark Performance Mysteries

Sep 13, 2016 |

What do you do when your Spark or Hive job runs like molasses? If you’re like most end-users who lack in-depth technical skills, the answer is “not much.” Now a startup named Unravel Data is working to show you what’s actually going on in the cluster, and provide some configuration recommendations and automatic fixes as well. Read more…

Does InfiniBand Have a Future on Hadoop?

Aug 4, 2015 |

Hadoop was created to run on cheap commodity computers connected by slow Ethernet networks. But as Hadoop clusters get bigger and organizations press the upper limits of performance, they’re finding that specialized gear, such as solid state drives and InfiniBand networks, can pay dividends. Read more…

The GPU “Sweet Spot” for Big Data

Sep 11, 2012 |GPUs have stirred some vicious waves in the supercomputing community, and these same performance boosts are being explored for large-scale data mining by a number of enterprise users. During our conversation with NVIDIA's Tesla senior manager for high performance computing, Sumit Gupta, we explored how traditional data... Read more…

This Week’s Big Data Big Seven

Jun 15, 2012 |We wrap up this week with news about a new high performance, data-intensive supercomputer from SGI, new Hadoop announcements, including those from Hortonworks, Datameer, and Karmasphere, some software enhancements for big data infrastructure from ScaleOut and some other startup goodness--all with an eye on next week's International.... Read more…

ParAccel Lifts Hood on CARFAX Overhaul

Jun 13, 2012 |In the wake of their competitors being gobbled up by giants and their announcement today of a new connector to Hadoop, we step back and look at how analytical platforms like ParAccel's are handling large amounts of complex data for companies like CARFAX, which recently put the company in the driver's seat following limitations from their legacy.... Read more…

Analytics Power Solar Energy Boost

Mar 27, 2012 |While solar energy pioneers are still seeking ways to tweak the price performance issue, others are focusing on less obvious potential solutions. One such group of solar cell researchers at MIT is addressing the problem of current solar technolo.... Read more…

Oracle Flags Down R Users with Analytics Option

Feb 9, 2012 |Today Oracle announced a new piece to its enterprise analytics capabilities via the addition of an option to include the open source R statistics language within bundles of its enterprise R and data mining offerings that the company... Read more…

Do NOT follow this link or you will be banned from the site!