Skip to content
Dmitry FabushevHEAD OF SEO
← All cases/SEO diagnostics
Pilot on real data

SEO diagnostics: data first, hypothesis second

When a cluster drops, SERPs, assortment, pricing, pages and competitors can all change at once. One chart shows the symptom, not the cause. I bring those signals into one investigation so the specialist gets a testable explanation with evidence — not polished AI prose.

Case at a glance
Why it matters

A wrong hypothesis costs real SEO, content and engineering time: the team can start fixing something that was never the cause.

What I owned

Designed the diagnostic logic: which data to verify, how to separate facts from hypotheses and what counts as enough evidence for the next step.

What we know so far

The first real-data evaluation covered up to ~100 clusters and showed that input-data quality is currently the main constraint. That shifted the priority from “more reasoning” to source validation and quarantine.

From data to a testable hypothesis
01Data→02Check→03Hypothesis→04Specialist decision

Data is checked before the explanation. AI does not declare the cause; it helps assemble a version a specialist can test.

Why this matters

A wrong diagnosis can waste the time of several teams

SERPs, assortment, pricing, content and technical state can move at the same time. The value is therefore not an AI confidently naming a cause, but a testable hypothesis with visible evidence. The first pilot exposed exactly that: input-data quality mattered more than adding more reasoning.

Key finding
04

What the first real-data evaluation showed

The first evaluation showed that source quality and consistency are the main constraint. The next priority is better data validation before scaling the analysis.

01

Why one chart is not enough

Rankings, SERPs, demand, assortment, pricing, content, site performance and competitors can all move at once. One chart shows a symptom but rarely explains the cause.

The workflow therefore checks source quality before forming an explanation.

02

How the diagnostic flow works

Check the observations first, then build the explanation.

01

Collect the signals

Bring rankings, SERPs, pages, assortment, pricing, content and other inputs together around the same cluster.

02

Check the data

Find missing periods, inconsistent inputs and contradictions. Keep questionable data separate from trusted inputs.

03

Review possible causes

Look at SERP movement, page relevance, assortment, semantic gaps and other explanations separately.

04

Tie the hypothesis to facts

Show what supports the explanation, what conflicts with it and what is still missing.

05

Define the check

Before changing the site, decide what next step could confirm or reject the hypothesis.

03

What makes a hypothesis useful

AI can connect observations, but a useful conclusion still needs clear supporting data and a next check.

What supports it

The supporting observations, object and time period are explicit.

What is still uncertain

Missing or questionable inputs and alternative explanations remain visible.

How to test it

There is a next step that can confirm or reject the hypothesis before action.

05

What to measure next

Hypothesis acceptance, repair and rejection rates; time to diagnosis; and how many accepted hypotheses reach implementation and confirmation.

06

What the real-data pilot has already taught us

The pilot was useful not only for hypotheses: it exposed where the analytical workflow itself can create false confidence.

Up to ~100 clusters

The system has already been run on real categories and clusters, not only synthetic examples.

Five analysis lenses

URL relevance, SERP/competitors, page/technical, semantics, and business context are reviewed separately before the final hypothesis.

Main bottleneck: input data

The first evaluation showed that strong reasoning on dirty or inconsistent sources still produces unreliable output.

The next priority became clearer

The focus moved from “more reasoning” to source-quality checks, quarantine, and reproducible evidence.

Context & measurement
Context
MVP on real SEO data
Scale / period
up to ~100 real clusters in the first evaluation

Next step

Expand the real-data pilot and measure hypothesis quality, diagnostic time and the path from a conclusion to a confirmed task.

SEO diagnostics

Facing a similar challenge?

Tell me where SEO is blocked by product, engineering or data.

DiscussOther cases