Features

LinkedIn Donates Feature Store to Linux Foundation

LinkedIn today announced that its open source feature store, dubbed Feathr, is joining LF AI & Data, the Linux Foundation’s umbrella foundation for big data and AI projects. Feathr was originally developed at Li Read more…

LinkedIn Open Sources Tech Behind 10,000-Node Hadoop Cluster

LinkedIn last week open sourced DynoYARN, a key piece of technology that allows it to predict how appliacation performance will be impacted as it scales Hadoop to gargantuan proportions, including one 10,000-node cluster Read more…

LinkedIn’s Translation Engine Linked to Presto

An SQL translation engine unveiled this week by LinkedIn is integrated with other open-source SQL query engines like Presto in a combination aimed at bulging data lakes. The Microsoft unit’s Coral engine handles ana Read more…

LinkedIn Open Sources Dagli to Simplify ML Pipeline Building

LinkedIn yesterday announced that it has open sourced Dagli, a Java-based framework for building and deploying machine learning pipelines. While the number and quality of tools for developing machine learning models h Read more…

The Future of Labor in an AI World

What will you be doing on Labor Day in 2030? How about five years from today? Will your job still be available? What skills will your employer demand? Nobody can forecast the future with total certainty, but a conservati Read more…

LinkedIn Unveils Open-Source Toolkit for Detecting AI Bias

As AI becomes increasingly integrated in our day-to-day lives, the implications of bias in AI grow more and more worrisome. Training data that appears impartial is often influenced by historical and socioeconomic factors Read more…

Navigating the AI and Analytics Job Market During COVID-19

The market for AI and analytics jobs has not been spared from the wrath of COVID-19, which has directly led to the loss of more than 30 million American jobs over the past four months. It may not appear to be an ideal ti Read more…

LinkedIn Open Sources Kube2Hadoop

Hadoop and Kubernetes have fundamentally different ways of authenticating users, exposing a security gap for organizations that want to access HDFS data from Kubernetes-based applications. Thanks to the new Kube2Hadoop t Read more…

Weighing the Impact of a Facial Recognition Ban

Should facial recognition technology be banned? That question is getting renewed interest in the wake of revelations about Clearview AI’s use and potential abuse of the technology. But the debate over banning facial re Read more…

When Not to Use a Database, As Told by Jun Rao

Databases are powerful abstractions that allow people and programs to manipulate large amounts of data in a predictable, repeatable way. There's a good reason why SQL is so important to modern data processing. But in som Read more…