Cluster Validation (SERP Overlap)

Cluster Validation (SERP Overlap) is the fourth step in the clustering pipeline that verifies clusters by measuring SERP Overlap between the canonical query and randomly sampled keywords from the cluster. When over 50% of the top 10 search results overlap between a canonical query and its cluster keywords, this confirms the cluster represents a unified topic.

SERP overlap below 30% indicates the cluster mixes unrelated topics and should be split. The validator also examines SERP Coherence within the cluster—measuring how consistently keywords return similar results—to ensure cluster integrity. Based on this analysis, the system makes one of three decisions: OK (cluster is coherent), MERGE (combine with another cluster), or SPLIT (divide the cluster).

While using a SERP data API is optional, the pipeline can fall back to LLM-only mode, though this loses the ability to validate search intent. To maintain efficiency and prevent content creation for poorly defined clusters, budget 15–28 SERP queries per pipeline run using graceful degradation to manage costs.