New Tool Focuses on Links Within Networks
Community detection algorithms used to evaluate how groups are clustered or partitioned are being used to determined how similar groups tend to either bind closer together or break apart. That capability is critical for data analysts trying to understand the structure of complex networks.
A new computational tool described by researchers at the University of Southern California’s Viterbi School of Engineering promises to streamline the ability to identify hidden connections among groups and individuals.
Social networks are among the best examples of community structures containing diverse connections. The USC researchers recently reported on a geometric approach to community identification in complex networks using a method called Ollivier-Ricci Curvature. “Ollivier-Ricci curvature which offers a natural method to discover inherent network community structures,” lead author Jayson Sia said.
The researchers extended the method for measuring curved surfaces such as Earth to networks. In their experiment, “positively curved” edges formed a “well connected” community—a sort of Pangaea of interrelationships.
By contrast, “negatively curved” edges were interpreted as “bridges” between communities. Breaking those links would isolate and block the flow of information between communities.
The application of O-R curvature to graphs is said to uncover the structure and geometry of a community via “optimal transport,” the researchers noted—as in the fastest way between two points on a map is a straight line. Among the goals of community detection is identifying a “robust transport of information” within a network, whether social or wireless.
Indeed, the researchers noted that the approach has been applied to areas such as quantum computing, network analysis and wireless networking architectures.
The community detection approach using O-R curvature was able to capture a pair of structural properties of complex networks. First, it identified a network edge and encoded its “shortest path characteristics.”
Second, it graphed the frequency of network edges.
Additional research will focus on how the O-R curvature method can be used to discern the building blocks of complex networks and whether the curvature method can “provide algorithmic hints towards solving the hard problem of community identification,” the researchers said.
Among the practical applications are helping neuroscientists determine which parts of the brain are working on the same functions—an insight that would allow other parts of the brain to assume functions from injured tissue. Other emerging applications include predicting potential drug side effects or interactions that currently require years of experimentation.
The USC researchers have released the code for their community detection code here.
Separately, MIT researchers have proposed a community detection algorithm that combines existing search strategies that include merging two communities, splitting a single community into two and moving nodes between two distinct communities.
July 30, 2021
- Alteryx Becomes Elite Partner in Snowflake Partner Network to Accelerate Data Science Automation
- Registration Open for KDD 2021 Data Science Virtual Conference, Aug. 14-18
- Alteryx, PwC Expand Relationship Globally to Address Analytics Automation Demand
- Coralogix Closes $55M Series C Funding Round
July 29, 2021
- FUJIFILM Object Archive, Tiger Bridge Solutions Partner to Provide Long-Term, Scalable Storage Management
- SAS Charts Path to IPO-Readiness
- AtScale AI-Link Connects Business Intelligence and Enterprise AI with Semantic Layer to Scale Augmented Analytics, Data Science
- Domino Data Lab Announces New Partner Network
- Dynatrace Extends AIOps Capabilities to Further Support Open-Source Observability
- Sumo Logic Supercharges Observability Solution to Accelerate Innovation, Ensure Application Reliability
July 28, 2021
- Lifesight Customer Intelligence Data Now Available on Narrative’s Data Streaming Platform
- Novel Techniques Extract More Accurate Data from Images Degraded by Environmental Conditions
- Informatica Appoints Elizabeth Rafael to Board of Directors
- Open Source Technology lakeFS Prompts $23M in Funding for Data Lake Lifecycle Management
- Cloud Native Computing Foundation Announces Grafana Labs Upgrades Membership to Platinum
- KDD 2021 Data Science Conference Welcomes Singapore Senior Minister for Opening Address
- CoreStack Launches FinOps, SecOps and CloudOps Governance Solutions on Google Cloud
- BlueConic Customer Data Platform Offers a Data Clean Room Solution
- Renesas and Syntiant Develop Voice-Controlled AI Solution Combining Vision, Voice
July 27, 2021
- Big Data File Formats Demystified
- Tuplex Gives Python UDFs a Performance Boost
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Who’s Winning In the $17B AIOps and Observability Market
- The Data Mesh Emerges In Pursuit of Data Harmony
- Why Data Scientists and ML Engineers Shouldn’t Worry About the Rise of AutoML
- How Coke Bottlers Save Millions with AI
- The Multiple Faces of Digital Twins
- Cost Overruns and Misgovernance: Two Threats to Your Cloud Data Journey
- Beyond Dashboards: The Importance of Storytelling with Data
- More Features…
- Hiring, Pay for Data Science and Analytics Pros Picks Up Steam
- Why Is SAS Going Public?
- Starburst Backs Data Mesh Architecture
- Confluent Raises More Than $800M in IPO
- Off the Couch: Database Maker Seeks $160 Million In IPO
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- Why Young Developers Don’t Get Knowledge Graphs
- Let It Go: The Financial Benefits of Data Deletion
- AI Takes the Stage at the Summer Olympics
- Qumulo Debuts QaaS, a File Lake on the Azure Cloud
- More News In Brief…
- Splunk Launches New Security Cloud
- Red Hat Expands Workload Possibilities Across Hybrid Cloud with Latest Version of OpenShift
- Alluxio v2.6 Release Brings Performance, Ease of Use Improvements to AI/ML Workloads
- Vertica Announces Vertica 11, Delivering on Vision of Unified Analytics
- SAS Charts Path to IPO-Readiness
- DDN Selected by Bytesnet to Provide ‘Pay-Per-Use’ Storage for Data-Intensive Organizations
- Dremio Launches SQL Lakehouse Service to Accelerate BI and Analytics
- Observable Introduces Data Visualization Stack for the Enterprise
- Alation Supports Next Generation of Data Enthusiasts, Provides Free Software and Training
- Immuta Becomes First Data Access Control Solution for Snowflake Partner Connect
- More This Just In…
Sponsored Partner Content
August 25 @ 12:00 pm - 5:00 pm
November 29 - December 3
December 6 - December 10San Diego CA United States