CKO-006Validation & EvaluationStrong evidence
What is generalisability?
Generalisability is the extent to which AI performance remains reliable across different settings, topics and review contexts.
In more detail
An AI tool may perform well in one domain but poorly in another. Validation evidence should therefore be assessed in relation to language, geography, evidence type and review topic. Generalisability determines whether evidence from one context can support use in another.
Why it matters
Many AI failures occur when tools are applied outside their validated context.
Decision rule
Do not assume validation in one context applies elsewhere.
Common misconception
“Validated once equals validated everywhere.”
At a glance
- Evidence strength
- Strong
Related concepts
Key takeaway
A validated tool is not automatically a transferable tool.