Independent and not affiliated with the FDA, MHRA, ISPE, PDA, or any agency. Get the appgoutham@madhadi.com
madhadi.comData Integrity & GxP Quality
Browse all topics → Articles Templates & Procedures Learning paths GlossaryScenariosToolsRegulatory ReferencesLearning PathsTopics About Start here
Advanced Data Integrity

Data Integrity Gap Assessment: A Methodology That Actually Finds Something

A working methodology for a GxP data integrity gap assessment: how to scope it, evaluate each system layer, classify and score findings, write a defensible report, and sequence remediation. Written for DI program leaders and quality directors.

A data integrity gap assessment is a structured evaluation of how well a regulated organization’s computerized systems, manual processes, and quality culture protect GxP data across its full lifecycle, from the moment data is generated to the point it is archived or destroyed. It is the starting point for building or improving a data integrity (DI) program, and it is, in effect, what an inspector does during a DI-focused inspection. Doing it yourself first, honestly, is the entire point.

The methodology is what separates a useful assessment from a box-ticking exercise. An assessment that reviews only audit trail configurations but ignores the procedural controls around them, or that covers GMP lab systems but not clinical or pharmacovigilance data, or that produces a flat list of findings with no remediation priority, gives you very little you can act on. The approach below covers all of it, and it is written to be run by an internal team or commissioned externally.

If you are new to the underlying principles, read Data Integrity Foundations and the ALCOA+ principles in detail first. This article assumes you already know what attributable, legible, contemporaneous, original, and accurate mean, and that you want to find where your organization falls short of them.


Why a Gap Assessment Is Expected, Not Optional

No single regulation says “thou shalt run a data integrity gap assessment.” The expectation is built into the data governance obligations that several guidances spell out. The relevant texts:

  • MHRA “GXP Data Integrity Guidance and Definitions” (March 2018) states that organizations should design and operate a system that provides an acceptable state of control based on data integrity risk, and that this requires periodic review and self-inspection. A gap assessment is the mechanism that produces that review.
  • PIC/S PI 041-1 “Good Practices for Data Management and Integrity in Regulated GMP/GDP Environments” (July 2021) asks for a documented data governance system that includes a risk assessment of data criticality and an understanding of where vulnerabilities lie. You cannot demonstrate that understanding without having looked, which is what a gap assessment is.
  • WHO Technical Report Series, Annex on Data Integrity (TRS, published 2021) expects management to ensure resources are applied to data governance and that data integrity risks are identified and mitigated.
  • ICH Q9(R1) Quality Risk Management (2022 revision) provides the risk methodology that the assessment uses to rank what it finds.
  • ICH Q10 Pharmaceutical Quality System places the obligation on the quality system to detect and correct weaknesses, of which DI gaps are one class.

The risk rationale is simpler than the citations. GxP decisions, releasing a batch, reporting a clinical endpoint, closing a deviation, rest on data being trustworthy. If the controls that keep data trustworthy have holes, the decisions sitting on top of that data are unreliable, and the organization will not know it until an inspector finds the hole first. A gap assessment is the cheapest way to find your own holes before someone with subpoena power does.


Why Gap Assessments Fail Before They Start

Most weak assessments fail for one of three reasons. The scope is set to what is easy to look at rather than what is risky. The assessor accepts documentation as evidence instead of looking at the live system. Or the output is a report that nobody can prioritize, so nothing gets fixed and the same gaps reappear at the next inspection.

The discipline that fixes all three is the same: decide what you are assessing against, look at the actual configuration and the actual behavior of people, and produce findings that are ranked by risk rather than by the order you happened to find them. Everything that follows is built around those three habits.


Roles and Responsibilities

Decide who does what before the assessment starts, and write it into the scope document. A vague ownership model is how assessments stall halfway and how findings end up with no owner.

RoleResponsibility in the assessment
Assessment sponsor (usually Head of Quality or QA Director)Charters the assessment, sets the boundary of what is in scope, removes obstacles, owns the result at management review
Lead assessorDesigns the methodology, schedules the work, runs the system reviews and interviews, writes the report, defends the classifications
Assessors / SMEsCover specific system types: a lab SME for CDS and LIMS, an automation SME for MES and historians, a clinical QA SME for EDC and CTMS, an IT SME for infrastructure
System ownersProvide configuration access, user lists, and procedures for their systems, and answer how the system is actually used
Process owners (lab managers, production supervisors, clinical operations leads)Make staff and live operations available for work-practice observation
IT / infrastructureProvide evidence on network segregation, backup logs, recovery tests, and clock synchronization
QA / document controlMaintains the report as a controlled record and feeds findings into the CAPA and management review systems

The single most important boundary: the people being assessed do not classify the findings about their own area. The lead assessor owns classification, so that a system owner cannot quietly downgrade a Critical to a Minor on the system they are responsible for.


Assessment Scope

Define the scope in writing before anyone touches a system. A scope that drifts during execution produces a report nobody trusts, because the reader cannot tell what was excluded by design and what was simply missed.

Systems in scope. Every computerized system that generates, stores, processes, or transmits data used in GxP decisions. In a typical organization this includes the laboratory information management system (LIMS), the chromatography data system (CDS, for example Waters Empower or Agilent OpenLab), the electronic lab notebook (ELN), the manufacturing execution system (MES), the electronic quality management system (eQMS), the electronic document management system (EDMS), the clinical trial management system (CTMS), the electronic data capture (EDC) platform, process historians, SCADA and PLC layers on equipment, individual instrument workstations, and standalone spreadsheets used for GxP calculations.

Standalone spreadsheets deserve their own line of attention. Many sites carry dozens of Excel files used for out-of-specification (OOS) recalculations, analytical result summaries, stability slope calculations, or yield reconciliation that are uncontrolled, unvalidated, and have no audit trail. They are a recurring source of inspection observations precisely because they sit outside the validated estate. Treat each as a system in its own right. The mechanics of bringing them under control are covered in Infrastructure Qualification and Spreadsheet Validation.

Processes in scope. The procedural controls that surround data: raw data review and second-person verification, audit trail review procedures, access provisioning and deprovisioning, backup and recovery, data retention and archival, and the DI awareness training program. A system can be configured perfectly and still fail if nobody reviews its audit trail.

People in scope. A DI assessment is not only about systems. It includes observation of work practices, interviews with the people who do the work, and review of training records. The question is not only whether a control exists but whether people use it the way the procedure says they should.

Regulatory frameworks. Confirm which regulations actually apply to the organization’s activities, then assess against all of them. For drug and biologic products, that usually means the FDA predicate rules in 21 CFR Parts 210 and 211, electronic records and signatures under 21 CFR Part 11, and the EU GMP requirements with EudraLex Volume 4 Annex 11 for computerized systems. Only where the product is a combination product or a device constituent does the device quality system regime become relevant, in which case the FDA Quality Management System Regulation (21 CFR Part 820, harmonized to ISO 13485 under the QMSR final rule effective February 2, 2026) and the combination-product cGMP requirements in 21 CFR Part 4 come into scope. The MHRA “GXP Data Integrity Guidance and Definitions” (March 2018), the WHO “Guideline on data integrity” (Technical Report Series, 2021), and the PIC/S PI 041 “Good Practices for Data Management and Integrity in Regulated GMP/GDP Environments” guidance are the practical references inspectors reason from, alongside ICH Q9(R1) for risk and ICH Q10 for the quality system. A useful side reference is the 21 CFR Part 11 and EU Annex 11 comparison, because the two frameworks diverge in ways that matter for global sites.

Time period and depth. State how far back the review reaches. An audit trail review that samples only last week tells you little about a problem that has been running for two years. Decide the sampling window for each evidence type up front: configuration is current-state, but audit trail review records, access reviews, and training records should be sampled across the prior 12 to 24 months.

A scope document that names the in-scope systems, the excluded systems with the reason for exclusion, the frameworks assessed against, the period covered, and the roles is the first deliverable. It is what a later reader uses to judge whether the assessment was honest about its own boundaries.


How to Run the Assessment, Step by Step

The framework below has five evaluation layers, but the execution is a sequence. Run it in this order.

  1. Charter and scope. The sponsor signs the scope document. Without a signed boundary, the assessment expands or contracts on whoever is in the room that day.
  2. Build the system inventory. Reconcile the validated-system list, the IT asset register, and the instrument register against each other. The systems missing from one list but present in another are usually the highest-risk: the uncontrolled spreadsheet, the legacy instrument workstation nobody validated.
  3. Pre-read documentation. Pull the DI policy, the audit trail review procedure, the access management procedure, validation summary reports, and the prior assessment if one exists. Read before you walk in, so floor time is spent verifying, not orienting.
  4. Review configuration on the live system. Sit at each system with the system owner and look at the actual settings. This is Layer 1 and Layer 2 work. Capture screenshots or printouts of the audit trail settings, the user and role list, the password policy, the session timeout.
  5. Review procedural evidence. For each procedure, pull the records that prove it ran: audit trail review records, access reconciliation records, training completions. This is Layer 3.
  6. Observe live operations. Be on the floor and in the lab during real work, ideally across more than one shift. This is Layer 4 and it cannot be done from a conference room.
  7. Interview. Talk to analysts, operators, system owners, and a member of leadership. This is Layer 5 and it cross-checks everything the documents claimed.
  8. Record findings as you go. Populate the per-system matrix during the review, not from memory afterward. Memory loses the specific event type that was not captured.
  9. Classify and prioritize. The lead assessor assigns class and priority once the evidence is in.
  10. Draft, review, issue. Write the report, walk the system owners through their findings for factual accuracy (not for negotiation of class), then issue it as a controlled document.

The whole cycle for a mid-size site typically runs four to eight weeks. Rushing the floor-observation and interview steps is the most common way to produce a report that looks complete and missed the real problems.


Assessment Framework: The Five Layers

A complete DI gap assessment evaluates five layers. Most organizations have gaps at several of them at once, and the distribution of gaps tells you something useful: gaps concentrated in configuration usually mean a young program, while gaps concentrated in work practice and culture usually mean a program that wrote good procedures and never embedded them.

Layer 1: Physical and Infrastructure Controls

Does the underlying infrastructure support data integrity at all?

  • Network architecture: are GxP systems on segregated networks with controlled access, or do they sit on the general business network?
  • Physical security: are instrument workstations in controlled-access areas, and are servers in locked facilities with logged entry?
  • Backup and recovery: are GxP data stores backed up on a defined schedule, is recovery actually tested rather than assumed, and is the verification documented? Validation expectations for this are in Backup, Restore and Disaster Recovery Validation.
  • Clock synchronization: are all GxP system clocks synchronized to a reliable time source over NTP?

Clock synchronization is consistently undervalued until an inspection forces the issue. When an investigator lines up timestamps across systems and finds the CDS workstation clock running 35 minutes behind the LIMS server, every timestamp in both systems becomes arguable, and arguable timestamps undermine the “contemporaneous” leg of ALCOA+. This is cheap to fix and expensive to ignore. The controls and validation for it are in Time Stamps and System Clock Control.

Acceptance criteria for this layer: GxP systems are on a controlled network segment, server and workstation physical access is restricted and logged, backups run on a defined schedule with at least one documented and successful restore test in the review period, and every in-scope clock is synced to a common reliable source with measured drift inside the system’s tolerance.

Layer 2: System Configuration Controls

Does each system’s live configuration enforce the requirements, not just claim to?

  • Audit trail enabled for all GxP-relevant event types, including the ones people forget, such as integration parameter changes, sample reprocessing, and method edits.
  • Audit trail completeness: event, user identity, timestamp, old value, new value, and reason where required.
  • Audit trail protection: can any user, including an administrator, delete, disable, or overwrite the trail?
  • User authentication: a unique account per person, with shared or generic logins eliminated or at least detectable.
  • Password controls: minimum complexity and expiration enforced by the system.
  • Session timeout: inactive sessions locked automatically.
  • Access control: least privilege enforced, with a clear answer to whether anyone with administrative rights can also create or modify GxP data.

For each system, verify the configuration by looking at the configuration, not the document that describes it. Open the audit trail settings inside the CDS and confirm the trail is on and scoped correctly. Pull the user list and the role definitions. Do not accept “yes, it is enabled” as evidence. The design and review of audit trails specifically is covered in Audit Trail Design and Review.

A common configuration gap that is easy to miss: an account that has both data-entry and administrative privileges. This breaks segregation of duties because the same person can both create a record and change the controls that protect it. Flag it even when there is no evidence of misuse, because the inspector will.

Acceptance criteria for this layer: the audit trail is on and captures every GxP-relevant event type with the full data element set, no role (administrator included) can edit or delete the trail, every active account maps to one named person, password and timeout controls are enforced by the system rather than by procedure alone, and no GxP-data-creating account also holds administrative rights over the controls.

Layer 3: Procedural Controls

Do the procedures that govern DI activities exist, are they adequate, and is there evidence they are followed?

  • Is there a DI policy, and does it cover every GxP system rather than only the lab?
  • Is there an audit trail review procedure that states how often, by whom, and what the reviewer is looking for? A procedure that says “review periodically” with no trigger and no checklist is a gap.
  • Is there a procedure for correcting records that requires the prior value to be preserved and a reason recorded?
  • Is there a procedure for access management covering both provisioning and, importantly, deprovisioning when someone leaves or changes role?
  • Is there a procedure defining what counts as raw data for each system, and who may access it? This matters most where the raw data is electronic and the printout is only a representation of it.

Review the procedures, then look for the implementation evidence behind each one: training records showing people were trained on the current version, audit trail review records showing the review actually happened and what it found, and access reviews showing the user list was reconciled. The supporting discipline here is Good Documentation Practices, which governs how all of this evidence is created and corrected. The audit trail review procedure in particular is detailed in Operationalizing Audit Trail Review.

Acceptance criteria for this layer: each required procedure exists, is current, names a frequency and an owner, is specific enough to execute without interpretation, and has dated records demonstrating it ran during the review period and that people were trained on the version that was in force when they did the work.

Layer 4: Work Practice Verification

What do people actually do? This is where procedure-versus-practice gaps surface, and it is the layer most internal assessments skip because it requires being on the floor during live operations.

  • Data entry: are analysts recording results directly as they are generated, or writing them on informal paper first and transcribing later? Transcription introduces a window where the original can be lost or altered.
  • Corrections: when an error is made in an electronic record, does the analyst follow the correction procedure, or delete and retype?
  • Instrument access: is each person logging in individually, or is a shared instrument account left open all shift?
  • OOS handling: when a result looks wrong, what is the first instinct, to investigate or to quietly rerun and keep the passing result? The expected behavior is governed by the OOS investigation process, and the gap between the procedure and the instinct is exactly what this layer is meant to expose.

Work practice observation cannot be done from a desk. It requires watching real operations, ideally across more than one shift, because the night shift and the day shift do not always work the same way.

Acceptance criteria for this layer: observed practice matches the procedure. Results are recorded contemporaneously and directly into the controlled record, corrections follow the documented method with the prior value preserved, each person uses an individual login, and reruns and reprocessing follow the investigation path rather than a quiet-replace path. Any divergence between what the procedure says and what people do is a finding, even where the divergence has not yet caused a bad record.

Layer 5: DI Awareness and Culture

Do people understand what data integrity means and why it matters, and does the organization make it safe to do the right thing?

  • Can an analyst explain ALCOA+ in their own words, not recite it from a slide?
  • Can a lab manager describe the audit trail configuration of the system they own?
  • Does leadership visibly back DI expectations, or is there quiet pressure to produce data that passes?
  • Is there a route for someone to raise a DI concern without fear of being punished for it?

Culture assessment is qualitative and it is the hardest layer to score, but it is also the most predictive. A site where DI violations always end in retraining and never in a systemic fix has a culture problem dressed up as a training problem. The relationship between culture and the failures it produces is examined in Quality Culture and DI Failures. Treat repeated identical findings across audits as a culture signal, not a coincidence.

Acceptance criteria for this layer: front-line staff can explain the principles in their own words and connect them to their daily task, system owners understand the controls on their systems, leadership can articulate the DI expectation and the consequences are not purely punitive, and a confidential escalation route exists and people know about it. Because this layer resists a clean pass/fail, score it on a maturity scale and back the score with what interviews and observations actually showed.


System-by-System Evaluation Matrix

For each system in scope, populate an evaluation matrix that scores it against the Layer 1 through Layer 4 controls relevant to that system type. The matrix is what turns observations into a structured, defensible output.

Control categoryCriterionStatusEvidencePriority
Audit trail enabledAll GxP events capturedGapAudit trail off for integration events on instrument AU-04Critical
User authenticationIndividual accounts requiredCompliantUser list review confirms no shared accountsN/A
Access controlLeast privilege enforcedGap3 users hold admin rights with no documented business needMajor
Audit trail reviewProcedure exists and is performedGapNo procedure for routine audit trail reviewMajor
Backup and recoveryDaily backup, recovery testedCompliantBackup logs reviewed, recovery test documentedN/A
Clock synchronizationSynchronized to NTPGapAU-04 clock not synced, 12-minute drift measuredMajor
Segregation of dutiesData role separate from admin roleGapOne account has both entry and admin rightsMajor

One matrix per in-scope system gives you the raw material for the report and for prioritization. Keep the evidence column specific. “Access control weak” is not evidence. “Three users hold admin rights with no documented business need” is, and it is what the eventual CAPA will need to act on.

A short worked example shows why specificity matters. Suppose the CDS that generates release-testing chromatograms is found with the audit trail capturing manual integrations but not method changes. On paper the trail is “enabled.” In practice, an analyst could alter an integration method, requalify a failing peak, and leave no record of the method change. That is a Critical finding on a release-critical system, and the matrix entry should say exactly that, naming the event type that is not captured, so nobody can later argue the trail was fine because it existed. The system-specific risks for chromatography are covered in Chromatography Data System Integrity.

Tailoring the matrix to the system type

The control set is not identical across systems. A short cross-reference of what to look hardest at, by system family:

System familyHighest-risk controls to verifyWhere the gaps usually hide
CDS (chromatography)Method-change audit, reprocessing audit, manual integration trail, no “results not saved” pathReprocessing and method edits not in the trail
LIMS / ELNResult-entry audit, e-signature binding, raw-data definitionCalculated fields with no traceable source data
MES / EBRStep-level audit, recipe version control, override loggingManual overrides recorded outside the system
Process historianData-not-overwritable, tag configuration change auditAggregated data presented as raw
EDC / CTMS (clinical)Audit trail on data changes, source data verification trail, access by roleQuery resolution that loses the original value
Standalone spreadsheetExistence of any audit trail at all, cell protection, validation statusThe whole file: usually uncontrolled

Use the matrix family that fits the system, and note in the report which control set was applied to which system, so the coverage is auditable.


Finding Classification

Classify every finding so the reader can act on it. Use a consistent four-level scale and tie each level to a remediation timeframe. This scheme is consistent with how findings are graded elsewhere in the quality system, covered in Audit Finding Classification.

ClassDefinitionTypical examplesTarget timeframe
CriticalA gap that directly compromises GxP record integrity with no compensating controlAudit trail disabled on a release-critical system, data deletable without trace, results modifiable by an unrestricted userImmediate, in parallel with formal CAPA
MajorA significant gap creating real risk of an undetected DI violationNo audit trail review procedure, shared accounts in a lower-risk area, backup without recovery testing30 to 90 days
MinorA procedural or documentation gap with limited direct impactTraining record omits the DI policy version, password expiration not enforced on a non-critical system90 to 180 days
ObservationA condition that warrants attention but is not yet a findingAudit trail review procedure exists but not updated for a recent configuration changeTracked as continuous improvement

The line between Major and Critical is usually drawn by whether a compensating control exists and by what the system feeds. The same configuration gap can be Major on a raw-material tracking system and Critical on the system that generates release data, because the consequence of corrupted data is different. Classification is a judgment about consequence, not just about the control.

A useful test for the Critical line: ask whether the gap, if exploited, would leave no trace. A gap that allows undetectable alteration or deletion of a GxP record is Critical almost by definition, because it defeats the ability to ever reconstruct the truth. A gap that allows a bad action but leaves a trace is a serious finding, but it is usually Major, because the action remains detectable. The data-criticality reasoning behind these calls is in Data Criticality and Data Risk.


Prioritizing Remediation

A real assessment generates more remediation items than any organization can address at once. Prioritization has to be risk-based or it becomes whoever-shouts-loudest based.

Rank findings against four criteria:

  1. Patient safety impact. What happens if this gap lets a quality decision be made on corrupted data?
  2. Regulatory risk. How likely is this gap to become an observation if seen during inspection?
  3. Scope. Does the gap affect one system or many? A platform-level access control weakness multiplies.
  4. Effort. Some high-priority gaps close in a day, such as enabling NTP. Others take months, such as migrating off an unvalidated spreadsheet estate.

A Critical gap in a CDS audit trail that feeds product release testing is Priority 1. A Minor procedural gap in a system used only for raw-material inventory is Priority 4. Plot the findings on impact against effort and the early wins become obvious: high-impact, low-effort items get done first while the high-impact, high-effort items move into a planned program.

A worked prioritization grid makes the sequencing concrete:

FindingImpactEffortPrioritySequencing
Audit trail off for method changes on release CDSHighLow (config change + revalidation)1Contain now, fix this week
Three users hold unneeded admin rights on LIMSHighLow (remove rights)1This week
No audit trail review procedure existsHighMedium (write, train, start)2This month
40 uncontrolled GxP spreadsheetsHighHigh (validate or replace)2Planned program, staged
Password expiration off on a label-printing PCLowLow4Batch with other config fixes

Build the result into a remediation roadmap, a time-sequenced plan naming the gap, the owner, the due date, and the verification method for each item. The roadmap is a QA-approved controlled document, tracked through the CAPA system, and reported at management review so that resourcing decisions are made by people who can actually allocate resources. For larger efforts, the roadmap becomes the backbone of a formal DI remediation program.


The Assessment Report

The assessment report is a controlled document. It has to be specific, factual, and actionable, and it has to be written so that a senior reader and a remediation owner can both use it. The writing standard for it is covered in Technical Writing for GxP.

What it contains:

  • Scope: what was assessed, what was deliberately excluded, and why.
  • Methodology: what was reviewed, who was interviewed, what was observed, and over what period.
  • Summary findings by system and by finding class, with a count table so the reader sees the shape of the problem at a glance.
  • Finding detail: the specific gap, the evidence observed, the applicable regulation or guidance, the classification, and the recommended remediation.
  • Risk summary: the overall DI risk profile of the organization in plain language.
  • Remediation prioritization: the recommended sequence and rationale.
  • Appendices: the per-system evaluation matrices, interview notes, and the list of documents reviewed.

A single finding entry, written to standard, looks like this:

Finding 07, Major. System: LIMS (production environment). Observation: a review of the active user list against the HR leavers report identified four accounts belonging to staff who left the organization between three and eleven months ago and that remained active with data-entry rights. Evidence: user list export dated 14 Mar, HR leavers report for the prior 12 months, no deprovisioning records found for the four accounts. Applicable reference: the access management expectation in EudraLex Annex 11 clause on security and the MHRA 2018 guidance on user access control. Risk: an active account for a departed user is an unattributable-access risk and undermines the “attributable” principle. Recommended remediation: disable the four accounts immediately, run a full user-list-to-HR reconciliation, and add a deprovisioning trigger to the leavers process with a defined service-level time.

That level of specificity is the difference between a finding a CAPA owner can act on and a finding that generates a meeting about what the finding meant.

What it is not. It is not a validation document, it is not a certificate of compliance, and it is not a score to be defended. It is a current-state assessment, and its value is in the accuracy and completeness of the findings, not in how flattering the result is. A report with no Critical or Major findings on a site that has never run a DI assessment before should make the reader more suspicious, not less.

Pair the full report with a one-page executive summary. The technical report serves the remediation owners. The one-pager, framed around inspection risk and patient safety, is what actually moves budget.


External vs. Internal Assessment

Internal assessment. Run by the organization’s own quality or DI team. The advantage is that the assessors know the systems, the people, and the history. The disadvantage is blind spots, both from familiarity (you stop seeing the workaround you walk past every day) and from institutional drift about what counts as acceptable.

External assessment. Run by a qualified outside party. The advantage is a fresh view with no institutional bias, and if the assessor has inspection experience, an output that maps closely to what a regulator would write. The disadvantage is that an external assessor starts with no context and needs orientation time, which costs schedule and money.

Hybrid. The internal team runs the preliminary assessment, and an external reviewer checks the findings and does targeted follow-up on the highest-risk systems. This keeps the cost of full external coverage down while still buying an independent view of the parts that matter most. It also tends to surface the gaps the internal team rationalized away, because the external reviewer has no reason to rationalize.

For an organization with a recent DI-related finding, or one preparing for a significant inspection, an external or hybrid assessment is the safer choice. The cost of an honest outside opinion is small next to the cost of a warning letter and the remediation an agency will then dictate. How to read the difference between regulators is covered in FDA vs EMA inspection dynamics.


Common Mistakes and Inspection-Finding Patterns

These are the recurring failure modes, both in how assessments are run and in the gaps they should catch. None is tied to any single company; all show up across published inspection trends and warning-letter themes.

  • Document-only review. The assessor reads the validation summary that says the audit trail is enabled and ticks the box, without opening the system. Inspectors routinely find audit trails that a document claimed were on and that were, in fact, off or scoped to miss the events that matter.
  • Scope set to the comfortable systems. The lab gets a thorough look and the clinical, pharmacovigilance, and manufacturing systems are quietly left out. DI obligations span all GxP, not just the lab, and a partial scope leaves the riskiest data unexamined.
  • Ignoring the spreadsheet estate. The validated systems are reviewed and the dozens of uncontrolled Excel files doing real GxP calculations are not. This is one of the most common sources of inspection observations precisely because it sits outside the validated boundary.
  • Shared and orphaned accounts. Generic logins left open all shift, and active accounts for people who left months ago, both break attributability. A user-list-to-HR reconciliation catches the second; floor observation catches the first.
  • Audit trail review that exists on paper only. A procedure that says “review periodically” with no frequency, no trigger, and no defined scope, and no records that any review actually happened. Inspectors ask to see the review records, not the procedure.
  • Findings with no priority. A flat list of 47 issues, ranked by the order they were found, with no risk-based sequencing. The organization cannot act on it, nothing closes, and the same gaps reappear at the next assessment.
  • Soft classification. A Critical downgraded to a Minor because the honest classification was uncomfortable. The inspector will apply the honest classification anyway, and the soft one then reads as an attempt to minimize.
  • The flattering report. A first-ever assessment that finds nothing. This almost never means the site is clean; it means the assessment did not look hard enough, and that is its own finding.
  • No closure loop. The report is treated as the deliverable. The deliverable is closed CAPAs and a follow-up that confirms the fixes held.

Interview-Ready: Questions You Will Be Asked

These come up in interviews for DI and quality roles and from inspectors during a DI-focused inspection. Short, direct answers follow each.

How would you scope a data integrity gap assessment? Start from the data, not the systems. Identify every place GxP data is generated, processed, stored, or transmitted, including standalone spreadsheets and instrument workstations, then assess against the predicate rules plus Part 11 or Annex 11, the device QMSR where relevant, and the MHRA, PIC/S, and WHO DI guidances. Write the scope down, name what is excluded and why, and set the time period the evidence sampling covers.

Why is looking at the live configuration better than reviewing the document that describes it? Because documents drift from reality. The validation summary can say the audit trail is enabled while the trail is actually off or scoped to miss method changes and reprocessing. The only reliable evidence is the live setting, so I open the system, capture the audit trail configuration, pull the user and role list, and verify rather than accept.

How do you decide whether a finding is Critical or Major? Two tests: does a compensating control exist, and what does the data feed. A gap that allows undetectable alteration or deletion of a GxP record, with no compensating control, on a release-critical system, is Critical. The same configuration gap on a low-consequence system with a compensating control is Major. Classification is a judgment about consequence, not just about the control being absent.

What is the difference between a procedural control gap and a work-practice gap? A procedural gap is a missing or inadequate procedure. A work-practice gap is people not following an adequate procedure. You only find the second by being on the floor during live operations, across shifts. The two need different fixes: the first needs a procedure, the second needs supervision, training, and sometimes a culture intervention.

You find an audit trail disabled on a QC chromatography system. What do you do first? Contain before you wait for governance. Restrict access, start enhanced second-person review of the affected data, and assess whether previously generated data is reliable, all in parallel with opening the formal CAPA. Waiting for a roadmap to be approved before stopping ongoing irreversible-data-loss risk is itself a finding.

How do you assess data integrity culture, which you cannot configure or document? Through interviews and observation, scored on a maturity scale. I ask analysts to explain the principles in their own words, ask system owners to describe their own controls, ask whether a confidential escalation route exists and whether people know about it, and I read the pattern of past findings: repeated identical findings that always end in retraining and never in a systemic fix are a culture signal.

An assessment finds no Critical or Major findings on a site that has never been assessed. What is your reaction? Suspicion, not relief. A first-ever assessment that finds nothing almost always means the assessment did not look hard enough, most often because it was a document review that never opened the live systems or never went to the floor. I would re-examine the methodology before I trusted the result.

What makes a gap assessment report defensible to an inspector? Specific evidence, honest classification, and a closure record. Every finding names the exact gap and the evidence, not a vague characterization. Classifications are consistent and not softened. And the report is tied to CAPAs that are actually closing, with a follow-up assessment that confirmed the fixes held.


Post-Assessment: Turning Findings into Improvement

The assessment is only worth the effort if it drives change. A few principles separate programs that improve from programs that just keep generating reports.

Do not over-document findings while under-addressing them. A 200-page report with 47 findings, none closed within a year, is worse than a 30-page report with 15 findings that are systematically resolved. The report is a means, not the deliverable. Closure is the deliverable.

Act on Critical findings immediately. If the assessment finds the audit trail disabled on a QC CDS, do not wait for the roadmap to be approved. Initiate containment, such as restricting access and starting enhanced manual review, while the formal CAPA is set up. Waiting for governance to start an irreversible-data-loss fix is itself a finding.

Communicate to leadership in their language. DI improvement needs resources, and resources come from people who think in risk and cost, not in audit trail event types. The one-page summary framed around inspection exposure and patient safety does more for funding than the technical appendix ever will.

Reassess after remediation. A follow-up assessment 12 to 18 months later confirms that the fixes held and catches the new gaps that appeared in the meantime, often introduced by the system changes made during remediation. That cycle, assess, remediate, verify, reassess, is what a mature DI program looks like, and it is what the DI program architecture is built to sustain. A standing self-check between full assessments, using a DI self-audit checklist, keeps the program honest in the gaps between formal reviews.

A gap assessment that finds something uncomfortable and leads to durable fixes is a success, even when the report reads badly. One that finds nothing on a program that has never looked before has usually failed to look hard enough.

Use madhadi.com as an app Full screen, works offline, one tap from your home screen.