Skip to content
Analysis and evidence Explainer

What makes a customer insight evidence-backed?

A clear evidence chain for separating source material, observations, patterns, insights and useful next actions.

Scattered paper fragments resolve into linked evidence paths and one amber point, representing observations becoming a defensible insight.

A polished sentence can sound true long before it is trustworthy. “Customers need more control,” “teams want automation,” and “onboarding creates anxiety” are plausible interpretations. An evidence-backed insight lets another reader inspect how the interpretation was formed, where it applies, and what remains uncertain.

Traceability does not make an interpretation automatically correct. It makes the reasoning reviewable.

GOV.UK's analysis guidance separates raw research material, observations, grouped patterns, findings and actions analysis guidance.

Nielsen Norman Group describes thematic analysis as a systematic process of coding qualitative observations and comparing those codes until defensible themes emerge thematic-analysis guidance.

Use an evidence chain

  1. Source material — notes, recordings, transcripts or other captured research.
  2. Observation — what a participant did or said, without adding an explanation.
  3. Pattern — related observations that recur or illuminate the same mechanism.
  4. Insight — the interpretation that explains why the pattern matters.
  5. Action — the decision, experiment or follow-up question the insight supports.

Each step changes the material. Problems arise when a team skips a step and presents interpretation as if it were a direct quote from reality.

Follow one example through the chain

Consider an illustrative study about first-time workspace administrators inviting colleagues.

Source material: a transcript records an administrator opening the invitation panel, checking the role descriptions, messaging a colleague about access, closing the panel, and returning two days later.

Observation: the administrator paused at role selection, sought confirmation from a colleague, and deferred the invitation.

Pattern: across several relevant sessions, administrators understood the benefit of collaboration but delayed when they could not predict what an invited person would be able to see.

Insight: for these first-time administrators, uncertainty about the consequences of access—not lack of interest in collaboration—can interrupt the first invitation.

Action: test whether clearer, context-specific permission consequences improve confidence at the invitation decision point, while keeping alternative mechanisms visible.

The example is intentionally bounded. It does not claim that all administrators behave this way, that permissions explain every invitation delay, or that a particular interface change will solve it.

Separate observation from interpretation

Use different sentence shapes:

  • Observation: “Three participants opened a second document while preparing the update.”
  • Interpretation: “The existing report may not provide enough context for them to explain changes.”

The word “may” is not the important difference. The observation describes something in the research material. The interpretation proposes meaning. Both can be valuable, but a reader should be able to tell which is which.

When an observation contains hidden causality—“the participant was confused by the navigation”—rewrite it. What did the participant do or say? Perhaps they opened three sections, returned to the starting page, and said they expected the setting under Account. Those details allow more than one explanation to remain possible.

Build patterns without counting mentions blindly

A pattern is not simply a popular word. Five participants can say “manual” while describing different mechanisms. One may be copying data, another waiting for approval, and another correcting inconsistent labels. Group evidence by the process, constraint, or consequence it reveals—not just by vocabulary.

Frequency can matter, but qualitative evidence also gains weight from specificity, relevance to the decision, clarity of mechanism, and the consequence of being wrong. A rare but severe access-risk mechanism may deserve attention even if it is not the most repeated theme. Scope the language honestly rather than turning the observation into a prevalence claim.

Check the chain before publishing

CheckHealthy signal
TraceabilityThe insight points back to specific observations
SeparationObservation and interpretation are visibly distinct
ScopeThe wording does not claim more than the evidence supports
UsefulnessA decision-maker can see what to do or learn next

Add four harder checks:

CheckQuestion
Rival explanationsWhat else could produce the same observations?
ContradictionsWhich relevant cases do not fit the pattern?
Audience boundaryWhich people or situations does this evidence represent?
Decision boundaryWhat action does the evidence support, and what does it not yet justify?

An insight becomes stronger when it survives those questions without becoming grander than its evidence.

Keep uncertainty visible

Evidence can be strong without pretending to be complete. Record where participants differed, which audience the finding applies to, and what remains untested.

Useful confidence language is concrete:

  • “Observed consistently among first-time administrators in this study” says more than “high confidence.”
  • “One detailed case; investigate before prioritising” says more than “weak signal.”
  • “The mechanism appeared in both small and larger teams, but the study did not estimate prevalence” protects the boundary between qualitative explanation and population measurement.

Avoid decorating every insight with a precise score unless the score has a defined method and consequence. A number can conceal judgement instead of clarifying it.

Preserve the evidence trail

For every published insight, keep a small reviewable record:

  1. The insight statement
  2. Audience and situation
  3. Supporting observation IDs
  4. Links to permitted source material
  5. Contradicting or qualifying observations
  6. Analyst reasoning
  7. Supported next decision
  8. Open question or review trigger

This record helps a colleague challenge the reasoning without rereading an entire corpus. It also makes later correction possible: if an observation was misclassified or new evidence changes the boundary, the team can identify which insight and decision were affected.

Do not let a memorable quote carry the finding

Quotes can preserve customer language and make an experience vivid. They should illustrate an evidence chain, not replace it. Before using one, ask:

  • Is the surrounding context preserved?
  • Does the quote represent the mechanism described?
  • Are we using it because it is diagnostic or because it is dramatic?
  • Would the insight still stand if this sentence were removed?

If the last answer is no, the analysis may depend too heavily on one rhetorical fragment.

Turn insight into a bounded action

“Improve onboarding” is not a bounded action. A better next step connects the mechanism to a decision: “Test whether showing role consequences at the invitation point improves first-time administrators’ confidence, and watch for cases where approval—not comprehension—still blocks progress.”

This does not pretend the solution has already been validated. It states what the current evidence supports and what the next test must distinguish.

A review template

Before sharing an insight, complete these prompts:

We observed: [specific actions, statements, or artifacts]

Among: [audience and situation]

We interpret this as: [mechanism and why it matters]

Because: [linked observations and pattern]

But: [contradictions, boundary, uncertainty]

This supports: [bounded decision or next test]

If a field cannot be completed, the right response may be to return to the source material, narrow the insight, or describe the item as an open question rather than a finding.

Evidence-backed does not mean exhaustive, mathematical, or immune to revision. It means the path from material to meaning is visible enough to inspect—and disciplined enough to guide a decision without outrunning what was learned.

The quality of the chain begins in the interview. Use the follow-up ladder in How to ask customer interview questions that move beyond surface answers.

Sources

  1. Analyse a research sessionGovernment Digital ServicePublished . Accessed .
  2. How to Analyze Qualitative Data from UX Research: Thematic AnalysisNielsen Norman GroupPublished . Accessed .