The Enlightening Side of GDPR Compliance
If the upcoming General Data Protection Regulation (GDPR) is like most government mandates, the thinking goes, it will be a tax on business and a hindrance to productivity. But if you take the right approach, some experts say, the GDPR could actually be a boon to analytics.
By now you’re probably aware that in just 38 days, the European Union begins enforcing GDPR, which was passed two years ago to harmonize a hodge-podge of privacy laws across Europe. The new regulation was designed to, among other things, give EU citizens control over their personal data by imposing stiff penalties for any organizations that use their personal data without consent. It also requires organizations to take certain measures to protect citizens’ personal data, which will (hopefully) reduce the severity and impact of major data breaches.
The law protects the data of 740 million Europeans, more than 10% of the Earth’s population. In other words, when it comes to big global corporations that sell goods and services around the planet, the days of playing fast and loose with peoples’ data are over. While we don’t have an American version of the GDPR (at least not yet), essentially the gig is up for the Wild West days of “anything goes” in the analytics arena.
In that regard, the GDPR is a significant wakeup call for organizations to mature their data management and analytic practices – and to do so quickly. While no corporate leader likes being ordered how to run her company, the prospect of losing up to 4% of annual revenue per GDPR violation provides a compelling incentive to accelerate data management initiatives.
The new regulation is also a boon for software companies that have the experience in building the types of consent-management systems that GDPR requires. The folks at MarkLogic, which develops a multi-model database management system, have been busy with GDPR remediation engagements and have noticed some patterns emerging from the work.
David Gorbet, SVP Engineering for MarkLogic, says GDPR finally caught up with people. “For a long time, they were unprepared,” he tells Datanami. “They didn’t underhand how it impacted them. They thought it was a Europe-only thing. A lot of people didn’t know how to get started.”
GDPR represents a very complex set of requirements that are vastly different from other regulations that impact the collection, storage, and use of data, such as HIPAA or PCI DSS, according to Gorbet: You can’t prove compliance by generating the correct reports. “It’s not a reporting regulation,” he says. “It’s an operationalization regulation. It’s about how you change your operation in order to be compliant with GDPR.”
That makes things tougher, to say the least. Being GDPR compliant requires an organization to understand where all their data resides and what it’s used for, Gorbet says. Then they need to relate that data to potentially millions of individuals, and then create consent management systems to control access to that data. “That’s a lot trickier than a typical compliance operation,” he says.
Over the years MarkLogic’s professional services arm has developed many of these types of consent management systems. It’s software manages consents for big publishing houses that need to understand which customers have legal authority to specific songs and movies. The system helps answer questions like, Is this iTunes consumer entitled to play this song, or is this the director’s commentary for this boxed set of Stephen Spielberg movies entitled to be distributed in this particular region?
Gorbet points out that consent management was also a big part of MarkLogic’s involvement in the development of Healthcare.gov, the much-maligned Obamacare website. Specifically, the MarkLogic database was used to create a Data Services Hub that reached out to databases hosted by the IRS, the Social Security Administration, and others to see whether or not a given citizen is eligible for a specific insurance program.
This is the sort of consent system that every large organization will ultimately need to comply with GDPR, Gorbet says, but building it is not easy. In some cases, customers will move all the relevant data into MarkLogic’s NoSQL database, which features a flexible schema. In other cases, a MarkLogic system will create a virtual layer controlling access to data that lives in other physical data stores, which could include relational databases, Hadoop file stores, object file systems, and mainframe flat files.
Staying on top of what people consent an organization to use their data for and what they do not is also a big challenge. “With GDPR, organizations can ask for consent at whatever level they want… and GDPR allows you to revoke them any time,” Gorbet says. “It’s not just a Boolean yes or no. It can be quite a complex thing.”
So for instance, a customer may give an organization the okay to use his email address to contact him about a certain product, concern, or event, but not allow the organization to use his phone number for them. This personally identifiable information (PII) is some of the most sensitive data that an organization stores on behalf of its customers, but it’s also some of the most valuable data, from an analytics perspective.
According to Gorbet, that level of complexity surrounding the individual permissions in a GDPR project actually jibes well with the capabilities of graph or semantic database, which is one of MarkLogic’s modalities. “Semantic is a great way to traverse that graph, to figure out if a particular entity [is entitled to something],” he says. “Performance is faster. Traceability is better. But in order to apply your policy to the data, you may want to apply it through a ontology.”
GDPR is forcing organizations to get smart about how they store PII data in order to protect the privacy of individuals. But that work also brings side benefits to the organization in the form of better organized data and a finer-grained view of their customers, too.
“Now for the first time ever, they can understand their exposure to a particular individual, which is a really big business benefit,” Gorbet says. “With a data hub they don’t have to [repeat the process]. Subsequent use cases are actually cheaper because the data is all in one place.”
The better organizations are at adhering to the new requirements under GDPR, the better organized their customer data will be, and the more analytical options will open up to them, Gorbet says.
“The smart companies are not seeing GDPR as a tax that they have to pay,” he says. “They’re seeing it as a reason to finally build that customer 360 view that they always wanted.”
March 1, 2021
- TripleBlind Secures $8.2M Seed Funding, Support for Data Privacy Approach
- NetApp Joins Aston Martin Cognizant Formula One for Data-Driven Racing
February 26, 2021
- NVIDIA Deep Learning Institute Releases New Accelerated Data Science Teaching Kit
- Privacera Announces Partnership with Talend for Rapid Cloud Data Integration, Governance
- Google Cloud Announces BigQuery Features for Performance, Efficiency
- DataRobot Introduces ContagionNET, Uniting Human and Machine Intelligence to Defeat Pandemics
- Scaleway Presents Breakathon on Mar. 25 to Stress-Test Kubernetes Kapsule’s Performance
February 25, 2021
- Cloudera Launches Applied ML Prototypes in CML for Jumpstarting AI Use Cases
- Acxiom Everywhere: Acxiom Data Enrichment and Real Identity Accessible via Exponea CDP
- DataStax Astra Shatters Serverless Database-as-a-Service Barrier
- C3 AI Awarded Robust Omnibus US Patent for End-to-End Enterprise AI Platform
- Enhanced Reveal Business Intelligence Platform Offers Integrated Data Visualizations
- New Off-the-Shelf Datasets from Appen Accelerate AI Deployment
- Next Pathway Announces New Capabilities to Crawler360 and SHIFT for Cloud Migration
- Logi Analytics Research Finds Disconnect Between Value of Analytics with Current BI Tools
- The AI Infrastructure Alliance Launches with 25 Members
February 24, 2021
- dotData Launches Cloud for BI Teams to Quickly and Easily Fully Automate AI/ML Development
- Fivetran Doubles Revenue and Customers in 2020
- Seagate Unveils Lyve Cloud Built to Store, Activate, and Manage the Massive Surge in Data
- Pliops Closes $65M Funding Round for Datacenter Efficiency
Most Read Features
- He Couldn’t Beat Teradata. Now He’s Its CEO
- Big Data File Formats Demystified
- Who’s Winning the Cloud Database War
- Why Data Science Is Still a Top Job
- Apache Iceberg: The Hub of an Emerging Data Service Ecosystem?
- Big Data Predictions: What 2020 Will Bring
- Snowflake: Not What You May Think It Is
- Understanding Your Options for Stream Processing Frameworks
- Empowering the Data Consumer: Living, and Breathing Data Governance, Security, and Regulations
- One Model to Rule Them All: Transformer Networks Usher in AI 2.0, Forrester Says
- More Features…
Most Read News In Brief
- Databricks Edges Closer to IPO with $1B Round
- Researchers Use Deep Learning to Plow Through NASA Snow Radar Data
- Databricks Plotting IPO in 2021, Bloomberg Reports
- The AI Inside NASA’s Latest Mars Rover, Perseverance
- Soda Launches Open Data Monitoring
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- The Rise and Fall of Qlik
- Momentum Builds to Break Elasticsearch Licensing Deadlock
- Databricks Now on Google Cloud
- Update: Elastic Shifts Licensing Terms, Citing Amazon Moves
- More News In Brief…
Most Read This Just In
- Cal Poly Team Working on Cross-disciplinary Data Science and Analytics Effort
- UCL Reports: Online Search Activity Can Help Predict Peaks in COVID-19 Cases
- SingleStore Strengthens Executive Team with Oliver Schabenberger as Chief Innovation Officer
- Collibra Acquires Predictive Data Quality Vendor OwlDQ
- DataRobot Announces Feature Discovery Integration with Snowflake
- Sinequa Announces Strong Momentum and Fiscal Year 2020 Results Amid COVID-19 Pandemic
- Wharton Research Data Services Expands RavenPack Analytics
- SAS Establishes Opioid Analytics Users Group
- Nebula Graph Debuts for Big Data Analytics Discovery
- 100% of Customers Recommend Snowflake for Fourth Consecutive Year in Dresner Report
- More This Just In…