P7: Insufficient Data Quality
Same name, different person, one account.
What Is P7: Insufficient Data Quality?
Matching people on a name and a date of birth looks safe until an old import leaves the date blank and the job treats the blank as a match. You'll follow a wrong merge from the complaint to the code, stop automatic merges and send verified matches to review, split the merged record with the merge log, and give customers a verified way to correct their own data. You'll finish able to spot weak matching before it discloses anyone's data.
What You'll Learn in P7: Insufficient Data Quality
- Names and dates of birth do not identify a person, and even a shared verified email only nominates a pair for review.
- A missing value is unknown, never a match.
- Fixing a rule does not undo past merges: split them and repair what flowed from them, from a log that kept what was overwritten.
- Customers need a fast, verified way to correct their own data.
P7: Insufficient Data Quality — Training Steps
-
Someone Else's Prescription
A customer has written to Pellora's support team about an order confirmation she should never have seen. The order is real. It belongs to another customer with the same name. Support has forwarded it to Alice, because the email went out from the customer record itself.
-
Open the Account on Staging
Alice keeps a staging phone with the Pellora app on it. This morning's staging copy of the database includes customer C-104382, so she can see the account the way the Leeds customer sees it, without touching production.
-
Whose Details Are These?
The account page shows the details Pellora holds for C-104382, the Leeds customer.
-
She Cannot Fix It Herself
If the Leeds customer spots the wrong address, the app should let her correct it.
-
Connect to the Replica
Alice connects to the read-only replica of the production database to see how two customers became one record.
-
Two People, One Row
Alice looks up every customer called Nadia Okafor.
-
Why They Matched
Pellora runs a nightly job that merges duplicate customer accounts. Its log keeps the evidence each merge was decided on. The two women are different people, so a rule of name plus date of birth should never have joined them. Alice reads the log to see what the job actually compared.
-
Knowledge Check
-
Open the Matcher
The rule lives in one function of the merge job. Alice opens it beside the query results.
-
Spot the Flaw
The function decides whether two records are the same person. Look at what it accepts as proof.
Security Framework Coverage
OWASP Privacy Top 10
- P7 Insufficient Data Quality
CWE
- CWE-1023 Incomplete Comparison with Missing Factors
CIS Controls
- CIS 3 Data Protection
NIST CSF
- PR.AT-02 Individuals in specialized roles are provided with awareness and training so that they possess the knowledge and skills to perform relevant tasks with cybersecurity risks in mind
- PR.DS Data Security
NICE Framework
- DD-WRL-003 Secure Software Development
- OG-WRL-008 Privacy Compliance
GDPR
- Art. 5 Principles relating to processing of personal data (accuracy)
- Art. 16 Right to rectification
CCPA/CPRA
- 1798.106 Right to correct inaccurate personal information