Researchers Turn Data into Dynamic Demographics
Aside from showing off how their travel, culinary and nightlife habits, users of the geolocated “check-in” service Foursquare could shed light on the character of a particular city and its neighborhoods.
Researchers at Carnegie Mellon University’s School of Computer Science say that instead of relying on stagnant, unyielding census and neighborhood zoning data to take the temperature of a given community, Foursquare checkin data can provide the much –needed layer of dynamic city life.
The researchers have developed developed an algorithm that takes the check-ins generated when foursquare members visit participating businesses or venues, and clusters them based on a combination of the location of the venues and the groups of people who most often visit them. This information is then mapped to reveal a city’s Livehoods, a term coined by the SCS researchers.
All of the Livehoods analysis is based on foursquare check-ins that users have shared publicly via social networks such as Twitter. This dataset of 18 million check-ins includes user ID, time, latitude and longitude, and the name and category of the venue for each check-in.
“Our goal is to understand how cities work through the lens of social media,” said Justin Cranshaw, a Ph.D. student in SCS’s Institute for Software Research.
The researchers analyzed data from foursquare, but the same computational techniques could be applied to several other databases of location information. The researchers are exploring applications to city planning, transportation and real estate development. Livehoods also could be useful for businesses developing marketing campaigns or for public health officials tracking the spread of disease.
For now, however, it’s being used to get a grip in the cultural and even class distinctions present in a community. For instance, in their study of Carnegie Mellon’s home in Pittsburgh, the researchers found that the Livehoods they identified sometimes spilled over existing neighborhood boundaries, or identified several communities within a neighborhood. The Pittsburgh analysis was based on 42,787 check-ins by 3,840 users at 5,349 venues.
For instance, “they found that the upscale neighborhood of Shadyside actually had two demographically distinct Livehoods — an older, staid community to the west and a younger, “indie” community to the east. Moreover, the younger Livehood spilled over into East Liberty, a neighborhood that long suffered from decay but recently has seen some upscale development.”
And how does this match up to the class and cultural viewpoints of a human observer? Right on… “That makes sense to me,” observed a 24-year-old resident of eastern Shadyside, one of 27 Pittsburgh residents who were interviewed by researchers to validate the findings. “I think at one point it was more walled off and this was poor (East Liberty) and this was wealthy (Shadyside) and now there are nice places in East Liberty and there’s some more diversity in this area (eastern Shadyside).”
Speaking of class divides, the limitations of the research shine through as a viable point of study themselves. Foursquare users tend to be young, urban professionals with smartphones. Consequently, areas of cities with older, poorer populations are nearly blank in the Livehoods maps—an indication of the class makeup—something potentially valuable when seeking new dwellings or pricing real estate, for instance.
Maps for New York (first map above), San Francisco (just above) and Pittsburgh are available on the project website, http://livehoods.org/. The team has added voting for the next city to be “checked.”
August 24, 2016
- KAYAK Selects Talena to Protect Critical Big Data Assets
- Teradata Announces New Deployment Options for Aster Analytics
- New Venture Software Partners With Logi Analytics
- Nimble Storage Predictive All Flash Arrays Achieve Certified Integration With SAP HANA
August 23, 2016
- Caringo Unveils SwarmNFS
- Fujitsu Launches DMP Integration Service
- Syncsort Completes Acquisition of Cogito
- Avere Systems and Cycle Computing Announce Technology Integration
- Tableau Appoints Adam Selipsky as New CEO
August 22, 2016
August 18, 2016
- Hortonworks Announces Hadoop Summit Melbourne
- NetApp Reports First Quarter Fiscal Year 2017 Results
- Basho Announces New Roadshow
August 17, 2016
- Cleo Certifies on Cloudera Enterprise 5
- Snaplogic Unveils Summer Release of Elastic Integration Platform
- Tableau 10 Now Available
- Inspur’s High Performance Servers Certified for SAP HANA
- Cloudera Assists Sky Bet
August 16, 2016
Most Read Features
- 9 Must-Have Skills to Land Top Big Data Jobs in 2015
- Python Eats Into R as SAS Dominance Fades
- How GPU-Powered Analytics Improves Mail Delivery for USPS
- What Pokémon GO Means for Big Data
- Which Type of SSD is Best: SATA, SAS, or PCIe?
- Solr or Elasticsearch–That Is the Question
- Big Data A to Z
- Spark Streaming: What Is It and Who’s Using It?
- 9 Ways Retailers Are Using Big Data and Hadoop
- IBM Seeks to Simplify Graph with New Titan Service
- More Features…
Most Read News In Brief
- Six Big Name Schools with Big Data Programs
- Why Gartner Dropped Big Data Off the Hype Curve
- Talend Set for IPO This Week
- Tableau Automates K-Means Clustering in V10 Refresh
- Workday Nabs Platfora as Big Data Consolidates
- Open Source Tool ‘Rethinks’ Databases
- Quantum Researchers Eye AI Advances
- Flash Memory Gives Databases a Jolt
- Search Engines Get a Machine Learning Boost
- Another Self-Service Database Tool Emerges
- More News In Brief…
Most Read This Just In
- MapR Converged Data Platform Recognized by Gartner
- MapR Closes $50M in Funding
- Hortonworks Reports Second Quarter 2016 Financial Results
- The Linux Foundation Announces Big Data Platform for Network Analytics
- Hewlett Packard Enterprise to Acquire SGI
- MapR Converged Data Platform Utilized by RiskIQ
- Apache Spark 2.0 Now Available on the Databricks Just-in-Time Data Platform
- AWS Releases Amazon Kinesis Analytics
- XSEDE Project Successfully Tests Scheduled Networking of Big Data
- Zaloni Launches New Data Lake 360° Solution
- More This Just In…
September 8 - September 9Boston MA United States
September 19 - September 20Malaysia
September 19New York NY United States
September 26 - September 29New York United States
September 26 - September 27New York United States
October 23 - October 27New York United States