Follow Datanami:

Tag: open data

Open Table Formats Square Off in Lakehouse Data Smackdown

If you’re constructing a data lakehouse today, you’ll need a table format to build on. But which open table format should you choose: Apache Iceberg, Databricks Delta Table, or Apache Hudi? A good place to start is i Read more…

Snowflake, AWS Warm Up to Apache Iceberg

Apache Iceberg, the table format that ensures consistency and streamlines data partitioning in demanding analytic environments, is being adopted by two of the biggest data providers in the cloud, Snowflake and AWS. Custo Read more…

It Takes a (Data Science) Village: How GRMDS Fosters an Open Ecosystem

Openness is one of the hallmarks of modern data science – openness of data, of code, and of methods. By sharing our successes and failures with others, we raise our collective intelligence level beyond what we could ea Read more…

U.S., China Jockey for AI ‘Lead’

The U.S. is maintaining its lead in AI development as China hustles and spends to catch up, outpacing its rivals in areas like AI funding, adoption and access to data. Still, a report released this week by the Center Read more…

Augmented Analytics Driving ‘Smart’ Data Market

Emerging tools like augmented analytics are expected to drive the “smart data” market to more than $30 billion over the next several years, a market forecaster predicts. Frost & Sullivan pegs the smart data an Read more…

U.S. Open Data Push Advances

The push for open government data got a boost this week with passage of a budget bill that includes language codifying open data requirements for the federal government. Senate passage of the Defense Department spendi Read more…

Exploring Governments’ Civic Data Connections

An individual data point is practically worthless by itself. Only when combined with other pieces of data can it contribute to the emergence of the bigger picture. For those in knowledge extraction industries, one of the Read more…

TaxBrain Brings Open Data Science to Federal Models

Some of the most important decisions made in Washington D.C. are influenced heavily by sophisticated computer models refined over the course of decades. However, most of the models are proprietary, which hinders the abil Read more…

New Platform Visualizes Open U.S. Data

Federal agencies are sitting on tons of data, particularly in areas like healthcare, employment, weather and education. A new initiative called Data USA seeks to unleash this trove via a free and open platform that colle Read more…

Peering In On the Pols with Big Open Data

It's no secret that our government is using big data technologies to track and monitor the activities of regular citizens, ostensibly to protect our freedom. But data analytics can also be used to keep track of what our Read more…

Schools Get a Leg Up on Terrorists with Big Data

Governments around the world spend billions of dollars each year trying to prevent terrorist attacks, with varying degree of success. When preventative efforts fail, the next best option is to help potential victims prep Read more…

Three Ways Open Data Could Make California Golden

While California is widely regarded as the high-technology hub of the world, the state lacks a cohesive open data policy. Last week, a non-profit think tank in the Golden State released a report detailing why the state g Read more…

Will Big Metadata Rat You Out?

Data scientists are usually taught to be cautious with personally identifiable (PII) data and take pains to ensure that it's properly anonymized and aggregated for authorized uses. But as MIT researchers recently showed, Read more…

‘Liquid’ Data Seen as Engine of Economic Growth

The free flow of data, especially government data, on open platforms could generate more than $1 trillion in annual U.S. economic activity, according to a recent global survey. That forecast depends however on greater in Read more…

Charting Safe Passages Through the Urban Jungle with Big Data

When you visit a big American city for the first time, you probably wonder where it's safe to go, and what areas it would be best to avoid. Wouldn't it be great to have an app that advised you? Researchers recently demon Read more…

Commerce Department to Hire Data Czar

In an effort to make greater use of government data, the U.S. Commerce Department is hiring its first chief data officer and convening an industry panel to make agency data more accessible. Several agencies within the Read more…

Big Data Practitioners Ponder Privacy Issues

A panel of big data executives acknowledged the need for trust, privacy and transparency in the handling of consumer information and called for rules of the road to ensure that privacy concerns do not derail technology i Read more…

Enigma.io Claims to Demystify Data; Receives Round

Enigma.io says that they have sanitized and curated over 100,000 streams of publicly available data and have reportedly been granted $1.1 million dollars in venture equity seed money to take their big data project to the next level. Read more…

New York City Calls in the Code Corps

In his State of the City Address, New York City Mayor, Michael Bloomberg sounded the call for a volunteer "Code Corps" to help make use of the city's ever growing pipeline of data. Read more…

Datanami