What AI search cites for UK health questions

citewatch asked 2 AI search models 100 pre-registered questions in 2 runs, and recorded every source they cited and how recently each page was updated.

What this study found

Scope

This study measures sourcing: which websites 2 AI search models cite when asked UK health questions, and how recently those pages were updated. It does not judge whether any answer or page is medically accurate. 100 pre-registered questions across 5 intents, asked twice (runs 1, 2) of Claude Sonnet 5.5, GPT-6.1 Sol with web search, from London, GB: findings are directional for this setup, not a verdict on AI search in general. Every percentage carries its count and 95% interval.

How far to trust these numbers

CheckResultWhat it measures
Date coverage89% (745/841; 95% CI 86%–91%)cited URLs with a resolved date or a logged reason; the study's 90% target (below target)
Date check67% (18/27; 95% CI 48%–81%)parser within 7 days of the checked date; agent-checked, owner-approved (OWNER D-63)
Support: Claude Sonnet 5.5 cited, judged by claude-opus-5-567% (16/24; 95% CI 47%–82%)cited page states the claim (AI judge)
Support: Claude Sonnet 5.5 cited, judged by gpt-6.1-sol67% (16/24; 95% CI 47%–82%)cited page states the claim (AI judge)
Support: GPT-6.1 Sol cited, judged by claude-opus-5-557% (13/23; 95% CI 37%–74%)cited page states the claim (AI judge)
Support: GPT-6.1 Sol cited, judged by gpt-6.1-sol43% (10/23; 95% CI 26%–63%)cited page states the claim (AI judge)
Support: Claude Sonnet 5.5 cited, owner's check100% (24/24; 95% CI 86%–100%)owner-labelled (OWNER D-62)
Support: GPT-6.1 Sol cited, owner's check100% (25/25; 95% CI 87%–100%)owner-labelled (OWNER D-62)

Errors: Claude Sonnet 5.5: 200 answers, 0 refusals, 0 transport errors, 48 over the 150-word limit asked for (kept and scored); GPT-6.1 Sol: 200 answers, 0 refusals, 0 transport errors, 0 over the 150-word limit asked for (kept and scored). Date check: 17 dated pages showed the checker no date and 7 did not load; none is scored.

Who gets cited

Claude Sonnet 5.5GPT-6.1 Sol
0%25%50%75%100%nhs.uknhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 5.0%–16%)nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 5.0%–16%)nhs.uk · GPT-6.1 Sol: 83% (83/100; 95% CI 75%–90%)nhs.uk · GPT-6.1 Sol: 83% (83/100; 95% CI 75%–90%)england.nhs.ukengland.nhs.uk · Claude Sonnet 5.5: 13% (13/100; 95% CI 7.0%–20%)england.nhs.uk · Claude Sonnet 5.5: 13% (13/100; 95% CI 7.0%–20%)england.nhs.uk · GPT-6.1 Sol: 15% (15/100; 95% CI 8.0%–22%)england.nhs.uk · GPT-6.1 Sol: 15% (15/100; 95% CI 8.0%–22%)gov.ukgov.uk · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)gov.uk · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)gov.uk · GPT-6.1 Sol: 23% (23/100; 95% CI 15%–31%)gov.uk · GPT-6.1 Sol: 23% (23/100; 95% CI 15%–31%)nhsinform.scotnhsinform.scot · Claude Sonnet 5.5: 17% (17/100; 95% CI 10%–25%)nhsinform.scot · Claude Sonnet 5.5: 17% (17/100; 95% CI 10%–25%)nhsinform.scot · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)nhsinform.scot · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)bhf.org.ukbhf.org.uk · Claude Sonnet 5.5: 7.0% (7/100; 95% CI 3.0%–12%)bhf.org.uk · Claude Sonnet 5.5: 7.0% (7/100; 95% CI 3.0%–12%)bhf.org.uk · GPT-6.1 Sol: 7.0% (7/100; 95% CI 2.0%–12%)bhf.org.uk · GPT-6.1 Sol: 7.0% (7/100; 95% CI 2.0%–12%)icb.nhs.ukicb.nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 5.0%–16%)icb.nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 5.0%–16%)icb.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)icb.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)nhsbsa.nhs.uknhsbsa.nhs.uk · Claude Sonnet 5.5: 1.0% (1/100; 95% CI 0%–3.0%)nhsbsa.nhs.uk · Claude Sonnet 5.5: 1.0% (1/100; 95% CI 0%–3.0%)nhsbsa.nhs.uk · GPT-6.1 Sol: 7.0% (7/100; 95% CI 2.0%–12%)nhsbsa.nhs.uk · GPT-6.1 Sol: 7.0% (7/100; 95% CI 2.0%–12%)nice.org.uknice.org.uk · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)nice.org.uk · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)nice.org.uk · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)nice.org.uk · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)wales.nhs.ukwales.nhs.uk · Claude Sonnet 5.5: 7.0% (7/100; 95% CI 2.0%–12%)wales.nhs.uk · Claude Sonnet 5.5: 7.0% (7/100; 95% CI 2.0%–12%)wales.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)wales.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)nih.govnih.gov · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)nih.gov · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)nih.gov · GPT-6.1 Sol: 4.0% (4/100; 95% CI 1.0%–8.0%)nih.gov · GPT-6.1 Sol: 4.0% (4/100; 95% CI 1.0%–8.0%)uk.comuk.com · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)uk.com · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)uk.com · GPT-6.1 Sol: 4.0% (4/100; 95% CI 1.0%–8.0%)uk.com · GPT-6.1 Sol: 4.0% (4/100; 95% CI 1.0%–8.0%)clevelandclinic.orgclevelandclinic.org · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)clevelandclinic.org · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)clevelandclinic.org · GPT-6.1 Sol: 1.0% (1/100; 95% CI 0%–3.0%)clevelandclinic.org · GPT-6.1 Sol: 1.0% (1/100; 95% CI 0%–3.0%)scot.nhs.ukscot.nhs.uk · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)scot.nhs.uk · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)scot.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)scot.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)uhsussex.nhs.ukuhsussex.nhs.uk · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)uhsussex.nhs.uk · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)uhsussex.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)uhsussex.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)blog.gov.ukblog.gov.uk · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)blog.gov.uk · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)blog.gov.uk · GPT-6.1 Sol: 2.0% (2/100; 95% CI 0%–5.0%)blog.gov.uk · GPT-6.1 Sol: 2.0% (2/100; 95% CI 0%–5.0%)
Run 1: share of answers citing each publisher at least once (presence share), top 15 publishers, 95% intervals.
Table: top 30 publishers, run 1
PublisherClaude Sonnet 5.5GPT-6.1 Sol
nhs.uk10% (10/100; 95% CI 5.0%–16%)83% (83/100; 95% CI 75%–90%)
england.nhs.uk13% (13/100; 95% CI 7.0%–20%)15% (15/100; 95% CI 8.0%–22%)
gov.uk2.0% (2/100; 95% CI 0%–5.0%)23% (23/100; 95% CI 15%–31%)
nhsinform.scot17% (17/100; 95% CI 10%–25%)6.0% (6/100; 95% CI 2.0%–11%)
bhf.org.uk7.0% (7/100; 95% CI 3.0%–12%)7.0% (7/100; 95% CI 2.0%–12%)
icb.nhs.uk10% (10/100; 95% CI 5.0%–16%)0% (0/100; 95% CI 0%–0%)
nhsbsa.nhs.uk1.0% (1/100; 95% CI 0%–3.0%)7.0% (7/100; 95% CI 2.0%–12%)
nice.org.uk2.0% (2/100; 95% CI 0%–5.0%)6.0% (6/100; 95% CI 2.0%–11%)
wales.nhs.uk7.0% (7/100; 95% CI 2.0%–12%)0% (0/100; 95% CI 0%–0%)
nih.gov2.0% (2/100; 95% CI 0%–5.0%)4.0% (4/100; 95% CI 1.0%–8.0%)
uk.com2.0% (2/100; 95% CI 0%–5.0%)4.0% (4/100; 95% CI 1.0%–8.0%)
clevelandclinic.org4.0% (4/100; 95% CI 1.0%–8.0%)1.0% (1/100; 95% CI 0%–3.0%)
scot.nhs.uk5.0% (5/100; 95% CI 1.0%–10%)0% (0/100; 95% CI 0%–0%)
uhsussex.nhs.uk5.0% (5/100; 95% CI 1.0%–10%)0% (0/100; 95% CI 0%–0%)
blog.gov.uk2.0% (2/100; 95% CI 0%–5.0%)2.0% (2/100; 95% CI 0%–5.0%)
curatehealth.co.uk4.0% (4/100; 95% CI 1.0%–8.0%)0% (0/100; 95% CI 0%–0%)
gloshospitals.nhs.uk3.0% (3/100; 95% CI 0%–7.0%)1.0% (1/100; 95% CI 0%–3.0%)
gov.scot2.0% (2/100; 95% CI 0%–5.0%)2.0% (2/100; 95% CI 0%–5.0%)
guysandstthomas.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)2.0% (2/100; 95% CI 0%–5.0%)
healthwatch.co.uk4.0% (4/100; 95% CI 1.0%–8.0%)0% (0/100; 95% CI 0%–0%)
healthystart.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)2.0% (2/100; 95% CI 0%–5.0%)
mayoclinic.org3.0% (3/100; 95% CI 0%–7.0%)1.0% (1/100; 95% CI 0%–3.0%)
nhs.wales4.0% (4/100; 95% CI 1.0%–8.0%)0% (0/100; 95% CI 0%–0%)
nottsapc.nhs.uk3.0% (3/100; 95% CI 0%–7.0%)1.0% (1/100; 95% CI 0%–3.0%)
parliament.uk3.0% (3/100; 95% CI 0%–7.0%)1.0% (1/100; 95% CI 0%–3.0%)
patient.info4.0% (4/100; 95% CI 1.0%–8.0%)0% (0/100; 95% CI 0%–0%)
pharmaceutical-journal.com4.0% (4/100; 95% CI 1.0%–8.0%)0% (0/100; 95% CI 0%–0%)
accessdoctor.co.uk3.0% (3/100; 95% CI 0%–7.0%)0% (0/100; 95% CI 0%–0%)
azurewebsites.net2.0% (2/100; 95% CI 0%–5.0%)1.0% (1/100; 95% CI 0%–3.0%)
cheshireandmerseyside.nhs.uk3.0% (3/100; 95% CI 0%–7.0%)0% (0/100; 95% CI 0%–0%)
Claude Sonnet 5.5GPT-6.1 Sol
0%25%50%75%100%nhs.uknhs.uk · Claude Sonnet 5.5: 13% (13/100; 95% CI 7.0%–20%)nhs.uk · Claude Sonnet 5.5: 13% (13/100; 95% CI 7.0%–20%)nhs.uk · GPT-6.1 Sol: 84% (84/100; 95% CI 77%–91%)nhs.uk · GPT-6.1 Sol: 84% (84/100; 95% CI 77%–91%)gov.ukgov.uk · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)gov.uk · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)gov.uk · GPT-6.1 Sol: 25% (25/100; 95% CI 17%–34%)gov.uk · GPT-6.1 Sol: 25% (25/100; 95% CI 17%–34%)england.nhs.ukengland.nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 4.0%–16%)england.nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 4.0%–16%)england.nhs.uk · GPT-6.1 Sol: 11% (11/100; 95% CI 5.0%–17%)england.nhs.uk · GPT-6.1 Sol: 11% (11/100; 95% CI 5.0%–17%)nhsinform.scotnhsinform.scot · Claude Sonnet 5.5: 14% (14/100; 95% CI 8.0%–21%)nhsinform.scot · Claude Sonnet 5.5: 14% (14/100; 95% CI 8.0%–21%)nhsinform.scot · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)nhsinform.scot · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)bhf.org.ukbhf.org.uk · Claude Sonnet 5.5: 7.0% (7/100; 95% CI 3.0%–13%)bhf.org.uk · Claude Sonnet 5.5: 7.0% (7/100; 95% CI 3.0%–13%)bhf.org.uk · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)bhf.org.uk · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)icb.nhs.ukicb.nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 5.0%–16%)icb.nhs.uk · Claude Sonnet 5.5: 10% (10/100; 95% CI 5.0%–16%)icb.nhs.uk · GPT-6.1 Sol: 1.0% (1/100; 95% CI 0%–3.0%)icb.nhs.uk · GPT-6.1 Sol: 1.0% (1/100; 95% CI 0%–3.0%)nhsbsa.nhs.uknhsbsa.nhs.uk · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)nhsbsa.nhs.uk · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)nhsbsa.nhs.uk · GPT-6.1 Sol: 7.0% (7/100; 95% CI 2.0%–12%)nhsbsa.nhs.uk · GPT-6.1 Sol: 7.0% (7/100; 95% CI 2.0%–12%)nice.org.uknice.org.uk · Claude Sonnet 5.5: 3.0% (3/100; 95% CI 0%–7.0%)nice.org.uk · Claude Sonnet 5.5: 3.0% (3/100; 95% CI 0%–7.0%)nice.org.uk · GPT-6.1 Sol: 8.0% (8/100; 95% CI 3.0%–14%)nice.org.uk · GPT-6.1 Sol: 8.0% (8/100; 95% CI 3.0%–14%)wales.nhs.ukwales.nhs.uk · Claude Sonnet 5.5: 8.0% (8/100; 95% CI 3.0%–14%)wales.nhs.uk · Claude Sonnet 5.5: 8.0% (8/100; 95% CI 3.0%–14%)wales.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)wales.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)nih.govnih.gov · Claude Sonnet 5.5: 1.0% (1/100; 95% CI 0%–3.0%)nih.gov · Claude Sonnet 5.5: 1.0% (1/100; 95% CI 0%–3.0%)nih.gov · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)nih.gov · GPT-6.1 Sol: 6.0% (6/100; 95% CI 2.0%–11%)mayoclinic.orgmayoclinic.org · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)mayoclinic.org · Claude Sonnet 5.5: 2.0% (2/100; 95% CI 0%–5.0%)mayoclinic.org · GPT-6.1 Sol: 4.0% (4/100; 95% CI 1.0%–8.0%)mayoclinic.org · GPT-6.1 Sol: 4.0% (4/100; 95% CI 1.0%–8.0%)patient.infopatient.info · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)patient.info · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)patient.info · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)patient.info · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)scot.nhs.ukscot.nhs.uk · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)scot.nhs.uk · Claude Sonnet 5.5: 5.0% (5/100; 95% CI 1.0%–10%)scot.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)scot.nhs.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)clevelandclinic.orgclevelandclinic.org · Claude Sonnet 5.5: 3.0% (3/100; 95% CI 0%–7.0%)clevelandclinic.org · Claude Sonnet 5.5: 3.0% (3/100; 95% CI 0%–7.0%)clevelandclinic.org · GPT-6.1 Sol: 1.0% (1/100; 95% CI 0%–3.0%)clevelandclinic.org · GPT-6.1 Sol: 1.0% (1/100; 95% CI 0%–3.0%)healthwatch.co.ukhealthwatch.co.uk · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)healthwatch.co.uk · Claude Sonnet 5.5: 4.0% (4/100; 95% CI 1.0%–8.0%)healthwatch.co.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)healthwatch.co.uk · GPT-6.1 Sol: 0% (0/100; 95% CI 0%–0%)
Run 2: share of answers citing each publisher at least once (presence share), top 15 publishers, 95% intervals.
Table: top 30 publishers, run 2
PublisherClaude Sonnet 5.5GPT-6.1 Sol
nhs.uk13% (13/100; 95% CI 7.0%–20%)84% (84/100; 95% CI 77%–91%)
gov.uk4.0% (4/100; 95% CI 1.0%–8.0%)25% (25/100; 95% CI 17%–34%)
england.nhs.uk10% (10/100; 95% CI 4.0%–16%)11% (11/100; 95% CI 5.0%–17%)
nhsinform.scot14% (14/100; 95% CI 8.0%–21%)6.0% (6/100; 95% CI 2.0%–11%)
bhf.org.uk7.0% (7/100; 95% CI 3.0%–13%)6.0% (6/100; 95% CI 2.0%–11%)
icb.nhs.uk10% (10/100; 95% CI 5.0%–16%)1.0% (1/100; 95% CI 0%–3.0%)
nhsbsa.nhs.uk4.0% (4/100; 95% CI 1.0%–8.0%)7.0% (7/100; 95% CI 2.0%–12%)
nice.org.uk3.0% (3/100; 95% CI 0%–7.0%)8.0% (8/100; 95% CI 3.0%–14%)
wales.nhs.uk8.0% (8/100; 95% CI 3.0%–14%)0% (0/100; 95% CI 0%–0%)
nih.gov1.0% (1/100; 95% CI 0%–3.0%)6.0% (6/100; 95% CI 2.0%–11%)
mayoclinic.org2.0% (2/100; 95% CI 0%–5.0%)4.0% (4/100; 95% CI 1.0%–8.0%)
patient.info5.0% (5/100; 95% CI 1.0%–10%)0% (0/100; 95% CI 0%–0%)
scot.nhs.uk5.0% (5/100; 95% CI 1.0%–10%)0% (0/100; 95% CI 0%–0%)
clevelandclinic.org3.0% (3/100; 95% CI 0%–7.0%)1.0% (1/100; 95% CI 0%–3.0%)
healthwatch.co.uk4.0% (4/100; 95% CI 1.0%–8.0%)0% (0/100; 95% CI 0%–0%)
healthystart.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)2.0% (2/100; 95% CI 0%–5.0%)
londonambulance.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)2.0% (2/100; 95% CI 0%–5.0%)
nottsapc.nhs.uk3.0% (3/100; 95% CI 0%–7.0%)1.0% (1/100; 95% CI 0%–3.0%)
gloshospitals.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)1.0% (1/100; 95% CI 0%–3.0%)
guysandstthomas.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)1.0% (1/100; 95% CI 0%–3.0%)
kingstonandrichmond.nhs.uk3.0% (3/100; 95% CI 0%–7.0%)0% (0/100; 95% CI 0%–0%)
nhs.wales3.0% (3/100; 95% CI 0%–7.0%)0% (0/100; 95% CI 0%–0%)
nutrition.org.uk2.0% (2/100; 95% CI 0%–5.0%)1.0% (1/100; 95% CI 0%–3.0%)
parliament.uk2.0% (2/100; 95% CI 0%–5.0%)1.0% (1/100; 95% CI 0%–3.0%)
tommys.org3.0% (3/100; 95% CI 0%–7.0%)0% (0/100; 95% CI 0%–0%)
uhsussex.nhs.uk3.0% (3/100; 95% CI 0%–7.0%)0% (0/100; 95% CI 0%–0%)
uk.com1.0% (1/100; 95% CI 0%–3.0%)2.0% (2/100; 95% CI 0%–5.0%)
advnture.com2.0% (2/100; 95% CI 0%–5.0%)0% (0/100; 95% CI 0%–0%)
assets.nhs.uk0% (0/100; 95% CI 0%–0%)2.0% (2/100; 95% CI 0%–5.0%)
barnsleyhospital.nhs.uk2.0% (2/100; 95% CI 0%–5.0%)0% (0/100; 95% CI 0%–0%)

7,728 share rows (consulted, presence, weighted; by publisher, model, intent and run) are in summary.json.

Where the two models differ

Paired differences in presence share for each run's most-cited publishers, with a two-sided bootstrap p-value and Holm correction (alpha 0.05, pre-registered).

RunPublisherModels comparedDifference in presence sharepp (Holm)Separated
run 1nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol-73 pts (95% CI -82 to -64; n=100)0.00020.0022yes
run 1gov.ukClaude Sonnet 5.5 − GPT-6.1 Sol-21 pts (95% CI -29 to -13; n=100)0.00020.0022yes
run 1nhsinform.scotClaude Sonnet 5.5 − GPT-6.1 Sol+11 pts (95% CI +4 to +18; n=100)0.00400.0280yes
run 1icb.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol+10 pts (95% CI +5 to +16; n=100)0.00020.0022yes
run 1wales.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol+7 pts (95% CI +2 to +12; n=100)0.00160.0128yes
run 1nhsbsa.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol-6 pts (95% CI -11 to -2; n=100)0.00580.0348yes
run 1nice.org.ukClaude Sonnet 5.5 − GPT-6.1 Sol-4 pts (95% CI -9 to +0; n=100)0.12420.6209no
run 1nih.govClaude Sonnet 5.5 − GPT-6.1 Sol-2 pts (95% CI -7 to +3; n=100)0.53491.0000no
run 1uk.comClaude Sonnet 5.5 − GPT-6.1 Sol-2 pts (95% CI -6 to +2; n=100)0.43821.0000no
run 1england.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol-2 pts (95% CI -9 to +5; n=100)0.66491.0000no
run 1bhf.org.ukClaude Sonnet 5.5 − GPT-6.1 Sol+0 pts (95% CI -6 to +6; n=100)1.00001.0000no
run 2nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol-71 pts (95% CI -80 to -62; n=100)0.00020.0020yes
run 2gov.ukClaude Sonnet 5.5 − GPT-6.1 Sol-21 pts (95% CI -30 to -13; n=100)0.00020.0020yes
run 2icb.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol+9 pts (95% CI +3 to +15; n=100)0.00340.0238yes
run 2nhsinform.scotClaude Sonnet 5.5 − GPT-6.1 Sol+8 pts (95% CI +1 to +16; n=100)0.04940.2964no
run 2wales.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol+8 pts (95% CI +3 to +14; n=100)0.00140.0112yes
run 2nice.org.ukClaude Sonnet 5.5 − GPT-6.1 Sol-5 pts (95% CI -10 to +0; n=100)0.06500.3250no
run 2nih.govClaude Sonnet 5.5 − GPT-6.1 Sol-5 pts (95% CI -10 to +0; n=100)0.06600.3250no
run 2nhsbsa.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol-3 pts (95% CI -8 to +1; n=100)0.23540.7061no
run 2bhf.org.ukClaude Sonnet 5.5 − GPT-6.1 Sol+1 pts (95% CI -5 to +7; n=100)0.86891.0000no
run 2england.nhs.ukClaude Sonnet 5.5 − GPT-6.1 Sol-1 pts (95% CI -8 to +6; n=100)0.88511.0000no

How concentrated the citations are

Claude Sonnet 5.5GPT-6.1 Sol
0%25%50%75%100%Run 1Run 1 · Claude Sonnet 5.5: 24% (n=100; 95% CI 23%–31%)Run 1 · Claude Sonnet 5.5: 24% (n=100; 95% CI 23%–31%)Run 1 · GPT-6.1 Sol: 78% (n=100; 95% CI 75%–85%)Run 1 · GPT-6.1 Sol: 78% (n=100; 95% CI 75%–85%)Run 2Run 2 · Claude Sonnet 5.5: 27% (n=100; 95% CI 24%–34%)Run 2 · Claude Sonnet 5.5: 27% (n=100; 95% CI 24%–34%)Run 2 · GPT-6.1 Sol: 79% (n=100; 95% CI 75%–86%)Run 2 · GPT-6.1 Sol: 79% (n=100; 95% CI 75%–86%)
Top-10 share: citation weight (each answer counted equally) held by the model's own top 10 publishers. The bootstrap re-picks the top 10 in each resample, so the interval leans upward of the point.
Table: concentration
ModelRunTop-10 shareHHI
Claude Sonnet 5.5124% (n=100; 95% CI 23%–31%)0.0103
GPT-6.1 Sol178% (n=100; 95% CI 75%–85%)0.2543
Claude Sonnet 5.5227% (n=100; 95% CI 24%–34%)0.0117
GPT-6.1 Sol279% (n=100; 95% CI 75%–86%)0.2648

Citations per answer

ModelRunIntentUnique URLs per answerRaw citations per answerAnswers citing nothing
Claude Sonnet 5.51All intents3.82 (95% CI 3.62–4.02; n=100)6.410
Claude Sonnet 5.51Fitness4.15 (95% CI 3.73–4.58; n=20)6.300
Claude Sonnet 5.51NHS services3.45 (95% CI 3.00–3.95; n=20)6.400
Claude Sonnet 5.51Nutrition3.80 (95% CI 3.35–4.24; n=20)6.550
Claude Sonnet 5.51Symptoms3.90 (95% CI 3.42–4.43; n=20)6.450
Claude Sonnet 5.51Treatment3.80 (95% CI 3.40–4.18; n=20)6.350
GPT-6.1 Sol1All intents3.08 (95% CI 2.85–3.32; n=100)4.700
GPT-6.1 Sol1Fitness3.45 (95% CI 3.00–3.88; n=20)5.050
GPT-6.1 Sol1NHS services2.95 (95% CI 2.40–3.59; n=20)4.350
GPT-6.1 Sol1Nutrition2.95 (95% CI 2.53–3.39; n=20)4.750
GPT-6.1 Sol1Symptoms2.90 (95% CI 2.38–3.47; n=20)4.850
GPT-6.1 Sol1Treatment3.15 (95% CI 2.56–3.76; n=20)4.500
Claude Sonnet 5.52All intents3.74 (95% CI 3.56–3.94; n=100)6.300
Claude Sonnet 5.52Fitness3.70 (95% CI 3.33–4.06; n=20)6.550
Claude Sonnet 5.52NHS services3.60 (95% CI 3.15–4.05; n=20)6.450
Claude Sonnet 5.52Nutrition3.60 (95% CI 3.21–4.00; n=20)5.750
Claude Sonnet 5.52Symptoms3.90 (95% CI 3.35–4.47; n=20)6.200
Claude Sonnet 5.52Treatment3.90 (95% CI 3.53–4.26; n=20)6.550
GPT-6.1 Sol2All intents2.98 (95% CI 2.78–3.19; n=100)4.710
GPT-6.1 Sol2Fitness3.30 (95% CI 2.87–3.75; n=20)5.050
GPT-6.1 Sol2NHS services2.80 (95% CI 2.35–3.25; n=20)4.350
GPT-6.1 Sol2Nutrition2.95 (95% CI 2.43–3.52; n=20)4.650
GPT-6.1 Sol2Symptoms2.90 (95% CI 2.45–3.39; n=20)4.800
GPT-6.1 Sol2Treatment2.95 (95% CI 2.55–3.38; n=20)4.700

Stale answers

Claude Sonnet 5.5GPT-6.1 Sol
0%25%50%75%100%All intentsAll intents · Claude Sonnet 5.5: 12% (14/114; 95% CI 5.8%–20%)All intents · Claude Sonnet 5.5: 12% (14/114; 95% CI 5.8%–20%)All intents · GPT-6.1 Sol: 43% (49/114; 95% CI 31%–55%)All intents · GPT-6.1 Sol: 43% (49/114; 95% CI 31%–55%)FitnessFitness · Claude Sonnet 5.5: 15% (3/20; 95% CI 0%–39%)Fitness · Claude Sonnet 5.5: 15% (3/20; 95% CI 0%–39%)Fitness · GPT-6.1 Sol: 15% (3/20; 95% CI 0%–39%)Fitness · GPT-6.1 Sol: 15% (3/20; 95% CI 0%–39%)NHS servicesNHS services · Claude Sonnet 5.5: 3.8% (1/26; 95% CI 0%–12%)NHS services · Claude Sonnet 5.5: 3.8% (1/26; 95% CI 0%–12%)NHS services · GPT-6.1 Sol: 73% (19/26; 95% CI 47%–95%)NHS services · GPT-6.1 Sol: 73% (19/26; 95% CI 47%–95%)NutritionNutrition · Claude Sonnet 5.5: 0% (0/20; 95% CI 0%–0%)Nutrition · Claude Sonnet 5.5: 0% (0/20; 95% CI 0%–0%)Nutrition · GPT-6.1 Sol: 30% (6/20; 95% CI 0%–62%)Nutrition · GPT-6.1 Sol: 30% (6/20; 95% CI 0%–62%)SymptomsSymptoms · Claude Sonnet 5.5: 19% (5/26; 95% CI 5.9%–33%)Symptoms · Claude Sonnet 5.5: 19% (5/26; 95% CI 5.9%–33%)Symptoms · GPT-6.1 Sol: 46% (12/26; 95% CI 20%–72%)Symptoms · GPT-6.1 Sol: 46% (12/26; 95% CI 20%–72%)TreatmentTreatment · Claude Sonnet 5.5: 23% (5/22; 95% CI 0%–50%)Treatment · Claude Sonnet 5.5: 23% (5/22; 95% CI 0%–50%)Treatment · GPT-6.1 Sol: 41% (9/22; 95% CI 12%–71%)Treatment · GPT-6.1 Sol: 41% (9/22; 95% CI 12%–71%)
Primary definition: share of time-sensitive answers whose newest dated citation is over 365 days old. Per-intent cells rest on few answers and are directional.
Table: stale answers (primary and secondary)
ModelIntentDefinitionRateUndated
Claude Sonnet 5.5All intentsprimary12% (14/114; 95% CI 5.8%–20%)0
Claude Sonnet 5.5All intentssecondary67% (76/114; 95% CI 56%–77%)0
Claude Sonnet 5.5Fitnessprimary15% (3/20; 95% CI 0%–39%) · directional0
Claude Sonnet 5.5Fitnesssecondary60% (12/20; 95% CI 31%–88%) · directional0
Claude Sonnet 5.5NHS servicesprimary3.8% (1/26; 95% CI 0%–12%) · directional0
Claude Sonnet 5.5NHS servicessecondary65% (17/26; 95% CI 41%–88%) · directional0
Claude Sonnet 5.5Nutritionprimary0% (0/20; 95% CI 0%–0%) · directional0
Claude Sonnet 5.5Nutritionsecondary70% (14/20; 95% CI 42%–94%) · directional0
Claude Sonnet 5.5Symptomsprimary19% (5/26; 95% CI 5.9%–33%) · directional0
Claude Sonnet 5.5Symptomssecondary62% (16/26; 95% CI 38%–83%) · directional0
Claude Sonnet 5.5Treatmentprimary23% (5/22; 95% CI 0%–50%) · directional0
Claude Sonnet 5.5Treatmentsecondary77% (17/22; 95% CI 55%–95%) · directional0
GPT-6.1 SolAll intentsprimary43% (49/114; 95% CI 31%–55%)0
GPT-6.1 SolAll intentssecondary78% (89/114; 95% CI 68%–88%)0
GPT-6.1 SolFitnessprimary15% (3/20; 95% CI 0%–39%) · directional0
GPT-6.1 SolFitnesssecondary65% (13/20; 95% CI 39%–90%) · directional0
GPT-6.1 SolNHS servicesprimary73% (19/26; 95% CI 47%–95%) · directional0
GPT-6.1 SolNHS servicessecondary88% (23/26; 95% CI 70%–100%) · directional0
GPT-6.1 SolNutritionprimary30% (6/20; 95% CI 0%–62%) · directional0
GPT-6.1 SolNutritionsecondary70% (14/20; 95% CI 38%–100%) · directional0
GPT-6.1 SolSymptomsprimary46% (12/26; 95% CI 20%–72%) · directional0
GPT-6.1 SolSymptomssecondary85% (22/26; 95% CI 62%–100%) · directional0
GPT-6.1 SolTreatmentprimary41% (9/22; 95% CI 12%–71%) · directional0
GPT-6.1 SolTreatmentsecondary77% (17/22; 95% CI 50%–100%) · directional0

How old the cited pages are

Lag is days from the page's effective date (last reviewed, else modified, else published) to the answer that cited it. Top 30 publishers by dated pages (both models); per-model rows are in summary.json.

PublisherDated citationsMedian lag (days)IQR (days)Modified after the answer
nhs.uk144823249–12290
gov.uk28129129–7540
bhf.org.uk196955–3680
england.nhs.uk191217342–13290
nhsinform.scot169747–1120
icb.nhs.uk11397178–6270
wales.nhs.uk8458146–6710
healthwatch.co.uk6435428–4510
patient.info6699383–11200
uhsussex.nhs.uk5909424–9350
clevelandclinic.org412491–2630
curatehealth.co.uk4122116–1220
kingstonandrichmond.nhs.uk4455212–5030
mayoclinic.org4618599–11260
nhsbsa.nhs.uk41473594–21970
nice.org.uk4949264–11590
pharmaceutical-journal.com4357357–9580
scot.nhs.uk4547368–35270
tommys.org483287–8320
accessdoctor.co.uk32424–290
cheshireandmerseyside.nhs.uk3743565–9350
gloshospitals.nhs.uk360382–6030
gov.wales3341263–3740
healthystart.nhs.uk35353–1920
londonambulance.nhs.uk39672–970
myhealthlondon.nhs.uk32525–250
nhs.wales334732–7730
nhsggc.scot36152–1280
nutrition.org.uk337020–7190
ombudsman.org.uk34949–490

NHS pages past their review date

ModelCited NHS pages past their review-due date
Both models13% (88/661; 95% CI 10%–17%)
Claude Sonnet 5.51.1% (3/282; 95% CI 0%–2.9%)
GPT-6.1 Sol22% (85/379; 95% CI 16%–29%)

Do the two models cite the same sources?

Run 1Run 2
0%25%50%75%100%All intentsAll intents · Run 1: 10% (n=100; 95% CI 7.4%–13%)All intents · Run 1: 10% (n=100; 95% CI 7.4%–13%)All intents · Run 2: 10% (n=100; 95% CI 6.6%–13%)All intents · Run 2: 10% (n=100; 95% CI 6.6%–13%)FitnessFitness · Run 1: 8.7% (n=20; 95% CI 2.4%–17%)Fitness · Run 1: 8.7% (n=20; 95% CI 2.4%–17%)Fitness · Run 2: 12% (n=20; 95% CI 3.3%–22%)Fitness · Run 2: 12% (n=20; 95% CI 3.3%–22%)NHS servicesNHS services · Run 1: 11% (n=20; 95% CI 4.5%–19%)NHS services · Run 1: 11% (n=20; 95% CI 4.5%–19%)NHS services · Run 2: 10% (n=20; 95% CI 4.2%–17%)NHS services · Run 2: 10% (n=20; 95% CI 4.2%–17%)NutritionNutrition · Run 1: 12% (n=20; 95% CI 6.2%–18%)Nutrition · Run 1: 12% (n=20; 95% CI 6.2%–18%)Nutrition · Run 2: 6.1% (n=20; 95% CI 2.1%–11%)Nutrition · Run 2: 6.1% (n=20; 95% CI 2.1%–11%)SymptomsSymptoms · Run 1: 10% (n=20; 95% CI 3.9%–16%)Symptoms · Run 1: 10% (n=20; 95% CI 3.9%–16%)Symptoms · Run 2: 11% (n=20; 95% CI 2.7%–23%)Symptoms · Run 2: 11% (n=20; 95% CI 2.7%–23%)TreatmentTreatment · Run 1: 9.2% (n=20; 95% CI 3.7%–16%)Treatment · Run 1: 9.2% (n=20; 95% CI 3.7%–16%)Treatment · Run 2: 10% (n=20; 95% CI 3.4%–17%)Treatment · Run 2: 10% (n=20; 95% CI 3.4%–17%)
Cross-model overlap: Jaccard similarity of the two models' cited publishers per question, averaged (1 = identical sources, 0 = none in common).
Table: every overlap measure
KindIntentRunModelValue
cross_modelAll intents1—10% (n=100; 95% CI 7.4%–13%)
pooled_top20All intents1—11% (n=83; 95% CI 8.2%–22%)
cross_modelAll intents2—10% (n=100; 95% CI 6.6%–13%)
pooled_top20All intents2—18% (n=94; 95% CI 10%–24%)
selfAll intentsbothClaude Sonnet 5.554% (n=100; 95% CI 48%–60%)
selfAll intentsbothGPT-6.1 Sol67% (n=100; 95% CI 62%–73%)
normalisedAll intentsboth—16% (n=200; 95% CI 12%–21%)
cross_modelFitness1—8.7% (n=20; 95% CI 2.4%–17%)
pooled_top20Fitness1—9.2% (n=87; 95% CI 2.7%–14%)
cross_modelFitness2—12% (n=20; 95% CI 3.3%–22%)
pooled_top20Fitness2—9.5% (n=74; 95% CI 4.7%–16%)
selfFitnessbothClaude Sonnet 5.549% (n=20; 95% CI 36%–64%)
selfFitnessbothGPT-6.1 Sol59% (n=20; 95% CI 46%–73%)
normalisedFitnessboth—19% (n=40; 95% CI 7.2%–32%)
cross_modelNHS services1—11% (n=20; 95% CI 4.5%–19%)
pooled_top20NHS services1—13% (n=55; 95% CI 5.1%–19%)
cross_modelNHS services2—10% (n=20; 95% CI 4.2%–17%)
pooled_top20NHS services2—12% (n=59; 95% CI 6.5%–19%)
selfNHS servicesbothClaude Sonnet 5.554% (n=20; 95% CI 41%–68%)
selfNHS servicesbothGPT-6.1 Sol81% (n=20; 95% CI 68%–92%)
normalisedNHS servicesboth—16% (n=40; 95% CI 7.4%–26%)
cross_modelNutrition1—12% (n=20; 95% CI 6.2%–18%)
pooled_top20Nutrition1—13% (n=70; 95% CI 7.9%–23%)
cross_modelNutrition2—6.1% (n=20; 95% CI 2.1%–11%)
pooled_top20Nutrition2—10% (n=70; 95% CI 4.5%–16%)
selfNutritionbothClaude Sonnet 5.562% (n=20; 95% CI 49%–75%)
selfNutritionbothGPT-6.1 Sol68% (n=20; 95% CI 54%–81%)
normalisedNutritionboth—14% (n=40; 95% CI 6.7%–23%)
cross_modelSymptoms1—10% (n=20; 95% CI 3.9%–16%)
pooled_top20Symptoms1—10% (n=71; 95% CI 5.9%–19%)
cross_modelSymptoms2—11% (n=20; 95% CI 2.7%–23%)
pooled_top20Symptoms2—6.6% (n=76; 95% CI 2.6%–13%)
selfSymptomsbothClaude Sonnet 5.552% (n=20; 95% CI 39%–65%)
selfSymptomsbothGPT-6.1 Sol72% (n=20; 95% CI 60%–84%)
normalisedSymptomsboth—17% (n=40; 95% CI 6.5%–31%)
cross_modelTreatment1—9.2% (n=20; 95% CI 3.7%–16%)
pooled_top20Treatment1—12% (n=68; 95% CI 5.4%–18%)
cross_modelTreatment2—10% (n=20; 95% CI 3.4%–17%)
pooled_top20Treatment2—15% (n=68; 95% CI 6.7%–22%)
selfTreatmentbothClaude Sonnet 5.551% (n=20; 95% CI 40%–62%)
selfTreatmentbothGPT-6.1 Sol57% (n=20; 95% CI 45%–70%)
normalisedTreatmentboth—17% (n=40; 95% CI 7.6%–28%)

Run-to-run stability

ModelPublisherMetricValue
Claude Sonnet 5.5allself_jaccard54% (n=100; 95% CI 48%–60%)
Claude Sonnet 5.5nhsinform.scotshare_change-3 pts (95% CI -8 to +2; n=100)
Claude Sonnet 5.5england.nhs.ukshare_change-3 pts (95% CI -7 to +0; n=100)
Claude Sonnet 5.5icb.nhs.ukshare_change+0 pts (95% CI -5 to +5; n=100)
Claude Sonnet 5.5nhs.ukshare_change+3 pts (95% CI -2 to +8; n=100)
Claude Sonnet 5.5bhf.org.ukshare_change+0 pts (95% CI -4 to +4; n=100)
Claude Sonnet 5.5wales.nhs.ukshare_change+1 pts (95% CI -2 to +4; n=100)
Claude Sonnet 5.5scot.nhs.ukshare_change+0 pts (95% CI -3 to +3; n=100)
Claude Sonnet 5.5uhsussex.nhs.ukshare_change-2 pts (95% CI -5 to +0; n=100)
Claude Sonnet 5.5clevelandclinic.orgshare_change-1 pts (95% CI -3 to +0; n=100)
Claude Sonnet 5.5curatehealth.co.ukshare_change-2 pts (95% CI -5 to +0; n=100)
Claude Sonnet 5.5healthwatch.co.ukshare_change+0 pts (95% CI -4 to +4; n=100)
Claude Sonnet 5.5nhs.walesshare_change-1 pts (95% CI -4 to +2; n=100)
Claude Sonnet 5.5patient.infoshare_change+1 pts (95% CI -2 to +5; n=100)
Claude Sonnet 5.5pharmaceutical-journal.comshare_change-3 pts (95% CI -7 to +0; n=100)
GPT-6.1 Solallself_jaccard67% (n=100; 95% CI 62%–73%)
GPT-6.1 Solnhs.ukshare_change+1 pts (95% CI -3 to +5; n=100)
GPT-6.1 Solgov.ukshare_change+2 pts (95% CI -5 to +9; n=100)
GPT-6.1 Solengland.nhs.ukshare_change-4 pts (95% CI -10 to +2; n=100)
GPT-6.1 Solbhf.org.ukshare_change-1 pts (95% CI -4 to +2; n=100)
GPT-6.1 Solnhsbsa.nhs.ukshare_change+0 pts (95% CI -3 to +3; n=100)
GPT-6.1 Solnhsinform.scotshare_change+0 pts (95% CI -5 to +5; n=100)
GPT-6.1 Solnice.org.ukshare_change+2 pts (95% CI -3 to +7; n=100)
GPT-6.1 Solnih.govshare_change+2 pts (95% CI +0 to +5; n=100)
GPT-6.1 Soluk.comshare_change-2 pts (95% CI -5 to +0; n=100)
GPT-6.1 Solmyhealthlondon.nhs.ukshare_change-2 pts (95% CI -5 to +0; n=100)

Date coverage

89% (745/841; 95% CI 86%–91%)

Cited URLs with a resolved date or a logged reason for having none (the study's 90% target).

Date check

Held-out pages never used to tune the parser; agent-checked, owner-approved (OWNER D-63).

Date sourceWithin 7 daysExact
overall67% (18/27; 95% CI 48%–81%)67% (18/27; 95% CI 48%–81%)
http_header0% (0/2; 95% CI 0%–66%) · directional0% (0/2; 95% CI 0%–66%) · directional
meta_tag50% (1/2; 95% CI 9.5%–91%) · directional50% (1/2; 95% CI 9.5%–91%) · directional
page_age50% (1/2; 95% CI 9.5%–91%) · directional50% (1/2; 95% CI 9.5%–91%) · directional
schema_org67% (4/6; 95% CI 30%–90%) · directional67% (4/6; 95% CI 30%–90%) · directional
sitemap0% (0/3; 95% CI 0%–56%) · directional0% (0/3; 95% CI 0%–56%) · directional
visible_text100% (12/12; 95% CI 76%–100%)100% (12/12; 95% CI 76%–100%)
undated50% (2/4; 95% CI 15%–85%) · directional50% (2/4; 95% CI 15%–85%) · directional

Support check

A sample of citations: does the cited page state the claim it was cited for? Two AI judges from different families and the owner's own check. Kappa is not reported while the owner's labels are all one value.

Cited modelJudgeSupportedAgreement with ownerKappa
Claude Sonnet 5.5claude-opus-5-567% (16/24; 95% CI 47%–82%)67% (16/24)not reported
Claude Sonnet 5.5gpt-6.1-sol67% (16/24; 95% CI 47%–82%)67% (16/24)not reported
Claude Sonnet 5.5owner100% (24/24; 95% CI 86%–100%)—not reported
GPT-6.1 Solclaude-opus-5-557% (13/23; 95% CI 37%–74%)57% (13/23)not reported
GPT-6.1 Solgpt-6.1-sol43% (10/23; 95% CI 26%–63%)43% (10/23)not reported
GPT-6.1 Solowner100% (25/25; 95% CI 87%–100%)—not reported

How each check was made

CheckMethod
date_accuracyagent-checked, owner-approved (OWNER D-63)
support_handowner-labelled (OWNER D-62)

Errors and exclusions

Table: every error and exclusion count
GroupCountValue
claude-sonnet-5-5answers200
claude-sonnet-5-5over_length48
claude-sonnet-5-5refusal0
claude-sonnet-5-5search_error0
claude-sonnet-5-5transport0
claude-sonnet-5-5zero_citation0
gpt-6.1-solanswers200
gpt-6.1-solover_length0
gpt-6.1-solrefusal0
gpt-6.1-solsearch_error0
gpt-6.1-soltransport0
gpt-6.1-solzero_citation0
hand_dateschecker_could_not_load7
hand_dateslabels55
hand_datesstale_labels0
hand_datesunjudgeable17
nhs_no_review_dateblocked4
nhs_no_review_datefetch_error4
nhs_no_review_datenot_html43
nhs_no_review_dateok151
nhs_no_review_daterobots_disallowed33
overlap_excludedcross_model:all:run10
overlap_excludedcross_model:all:run20
overlap_excludedcross_model:fitness:run10
overlap_excludedcross_model:fitness:run20
overlap_excludedcross_model:nhs_services:run10
overlap_excludedcross_model:nhs_services:run20
overlap_excludedcross_model:nutrition:run10
overlap_excludedcross_model:nutrition:run20
overlap_excludedcross_model:symptoms:run10
overlap_excludedcross_model:symptoms:run20
overlap_excludedcross_model:treatment:run10
overlap_excludedcross_model:treatment:run20
overlap_excludedself:claude-sonnet-5-5:all0
overlap_excludedself:claude-sonnet-5-5:fitness0
overlap_excludedself:claude-sonnet-5-5:nhs_services0
overlap_excludedself:claude-sonnet-5-5:nutrition0
overlap_excludedself:claude-sonnet-5-5:symptoms0
overlap_excludedself:claude-sonnet-5-5:treatment0
overlap_excludedself:gpt-6.1-sol:all0
overlap_excludedself:gpt-6.1-sol:fitness0
overlap_excludedself:gpt-6.1-sol:nhs_services0
overlap_excludedself:gpt-6.1-sol:nutrition0
overlap_excludedself:gpt-6.1-sol:symptoms0
overlap_excludedself:gpt-6.1-sol:treatment0
undated_pagesblocked9
undated_pagesfetch_error5
undated_pagesnot_html37
undated_pagesok96
undated_pagesrobots_disallowed74

Provenance

ItemValue
Runs1, 2
Generated2026-11-16T20:23:27+00:00
Spend (USD)$15.03
Config hashb1ef32199d482e7d
Questions sha256aaa3a348ab5844e2ad1fac47e0b68a4b53fb08e1354a0f303cc3d60186bba071
Pre-registration sha2569e227483cc387386c0a2b7ca36161c24f77cd59eaee2eb173978c4a183f60cbb
Results format1.0