Quoted Sources Aren't Verification: How to Tell When a Story Goes Beyond Its Evidence
- The Media Integrity Project

- 5 days ago
- 10 min read
The Media Integrity Project is an independent, nonpartisan research organization that advances transparency, accountability, and humanity in journalism through structural analysis of published reporting.
Quoting a source and verifying a claim are distinct journalistic acts. This article explains the difference, presents evidence from the ReporterLens™ corpus of 1,650 published analyses, and offers practical checks for readers and reporters.

Consider a pattern that appears regularly in published journalism: a story names a senior official who claims a proposed policy will cost taxpayers a specific, large sum annually. The official is identified, the quote is accurate, and the story spreads widely. Days later, a correction notes that the figure came from a single agency with a direct financial interest in the outcome, was not corroborated by any independent economic analysis, and was disputed by at least two separate research institutions whose findings were not mentioned in the original piece.
This pattern of accurate attribution followed by inadequate verification is not a rare failure. It is a structural gap that appears across outlets and beats, and it is measurable.
Quoting a source and verifying what they said are two separate acts. A named, credentialed, on-the-record source can be wrong, selective, motivated, or accurately quoted while the conclusion the article draws from that quote exceeds what the source actually established. Attribution tells you who spoke. It does not tell you whether what they said is independently supported.
"Journalists should: Take responsibility for the accuracy of their work. Verify information before releasing it. Use original sources whenever possible. Identify sources clearly. The public is entitled to as much information as possible to judge the reliability and motivations of sources." — Society of Professional Journalists, Code of Ethics (revised 2014, spj.org) |
The ReporterLens™ corpus made up of 1,650 published analyses through July 7, 2026, offers measurable evidence of how frequently this gap appears in practice. Of the 1,447 articles in the corpus that score 8 or above on Attribution Quality (87.7% of all analyzed articles), 67 (4.6% of that high-attribution group) simultaneously carry an Evidence-Claim Gap score of 5 or higher, meaning their sourcing is strong by conventional standards while their conclusions consistently outrun what the cited evidence can support. An additional 405 articles (24.5% of the full corpus) show attribution of 8 or above alongside a milder but still elevated gap of 3 or higher. The tool scores these as separate metrics because the data shows they do not move together.
Below are the five distinctions that explain why attribution and verification diverge — and a checklist readers can apply in under two minutes.
1. A Quote Tells You What Someone Said. Verification Tells You Whether It Is True.
Attribution and verification are different skills. Attribution is the act of connecting a claim to a named speaker. Verification is the act of independently confirming that the claim holds up against documents, datasets, or corroboration from additional credible sources.
Academic research has documented wide variation in how consistently verification follows attribution. A study published in Journalism Practice (Shapiro et al., 2013, documented by Poynter, November 25, 2013, poynter.org) found that "methods for ensuring accuracy varied greatly, with some factual statements relayed, with or without attribution, based on a single subject's word, while others were rigorously triangulated." The researchers noted that "strongly idealistic statements about the need for verification were often made during the course of the same interview as were indications of methodological ambiguity." Ivor Shapiro, then-chair of Ryerson University's School of Journalism and lead author of the study, concluded that the profession's stated norms around verification were "not quite matched by the kind of methodological discipline" those norms described.
What ReporterLens™ measures: Attribution Quality evaluates how clearly claims are linked to named, credentialed sources. Fact Verification measures how well those claims are independently corroborated. These are scored separately because a high Attribution Quality score does not predict strong verification — the corpus data confirm they move independently. |
Illustrative example from the corpus: An article scoring 9/10 on Attribution Quality names four credentialed sources across twelve claims. Its Fact Verification score is 5/10 because eight of those twelve claims rest on a single source's assertion with no corroborating document, dataset, or second voice. The article is well-attributed but is not well-verified.
Quick reader test: after encountering a significant claim, does the article corroborate it through a second source, a document, or a dataset? If not, the article has attributed but not verified.
2. Named Sources Can Be Wrong, Selective, or Motivated.
Naming a source establishes who made a claim. It does not establish that the claim is accurate. Sources can have biases, incomplete information, or institutional incentives that shape how they characterize facts and a credential next to a name does not neutralize any of those factors.
The Reuters Institute for the Study of Journalism's Journalism, Media, and Technology Trends and Predictions 2026 (January 12, 2026, reutersinstitute.politics.ox.ac.uk), drawing on interviews with 280 senior news executives across 51 countries, identified source credibility and editorial independence as two of the primary areas of concern for newsroom leadership heading into 2026. The report found that publishers are responding to eroding audience trust by investing more in original reporting and contextual analysis. This is precisely because source-dependent coverage has proven insufficient to establish credibility on its own.
What ReporterLens™ measures: Source Credibility evaluates whether an article identifies a source's potential motivation, institutional relationship, and domain-relevant expertise. A named government official and a named independent economist are not interchangeable when the claim being evaluated is economic in nature — and the metric reflects that distinction. |
Reader checklist for this distinction: Does the article identify the source's employer and whether that institution has a financial or political stake in the claim being made? Is the source's expertise directly applicable to this specific claim; not adjacent to it, but directly relevant?
3. High Attribution and a Large Evidence-Claim Gap Can Coexist — and the Data Confirm They Do.
This is the distinction the ReporterLens™ corpus makes most visible, and the one most counterintuitive for readers who associate named sourcing with factual rigor.
Per the ReporterLens™ corpus snapshot of July 2026 (n = 1,650 analyses, methodology at reporterlens.app/methodology), 87.7%of all analyzed articles score 8 or above on Attribution Quality. Of that high-attribution group, 4.6% (67 articles) simultaneously carry an Evidence-Claim Gap score of 5 or higher.
These articles name and credential their sources for virtually every claim. Their claims nonetheless outrun the evidence those sources provide. As the corpus data describe this pattern: these are articles where reporters write "analysts predict" or "experts warn it could" — properly credited speculation that remains speculation regardless of how well it is attributed.
Broadening the threshold: 405 articles in the corpus (24.5 % of all analyzed pieces) score high on attribution alongside a mild-to-elevated Evidence-Claim Gap of 3 or above. That is roughly one in four articles showing meaningful tension between how sources are named and what those sources actually establish.
Across article archetypes, the pattern is consistent. Per the same corpus snapshot:
Article Type | Avg. Attribution Quality | Avg. Evidence-Claim Gap | Gap vs. Investigative |
Investigative | 8.1 / 10 | 2.07 | — |
Analyst | 7.9 / 10 | 2.34 | +13% |
Storyteller | 7.6 / 10 | 2.89 | +40% |
Advocate / Opinion | 7.8 / 10 | 3.85 | +86% |
Source: ReporterLens™ corpus snapshot, July 2026 (n = 1,650). Methodology at reporterlens.app/methodology.
Attribution Quality scores are comparable across all four archetypes. Evidence-Claim Gap scores are not. The 86 percent difference between investigative and advocate-archetype articles exists despite nearly identical attribution practices — confirming that the two metrics capture distinct structural behaviors.
What ReporterLens™ measures: The Evidence-Claim Gap scores how much an article's conclusions exceed what its cited evidence actually supports. A score of 1 indicates close alignment between evidence and conclusion. A score of 5 or above indicates that claims are regularly outrunning what the sourcing can carry — regardless of how thoroughly that sourcing is attributed. |
Illustrative contrast from the corpus: A score-1 article states: "Per the agency's published 2025 budget report (linked), spending in this category increased 14 percent year over year." A score-5 article states: "Analysts say the policy could devastate communities across the region" — attributing the claim to named analysts without specifying which analysts, what communities, what the mechanism of harm would be, or what evidence supports the word 'devastate.'
4. Who Was Not Quoted Matters as Much as Who Was.
Selective sourcing is a structural choice that can produce misleading coverage even when every quoted source is accurately attributed. If quoted sources share a common perspective and the strongest counterargument is omitted, the article can mislead through absence — without a single factual error.
The SPJ Code of Ethics addresses this directly: "Provide context. Take special care not to misrepresent or oversimplify in promoting, previewing or summarizing a story." The Code also calls on journalists to "diligently seek subjects of news coverage to allow them to respond to criticism or allegations of wrongdoing" (SPJ, 2014, spj.org). The obligation is to seek out perspectives the story might otherwise omit; not only to quote accurately those who were available.
Research on AI-assisted fact-checking tools (Cazzamatta and Sarısakaloğlu, University of Erfurt and Technische Universität Ilmenau, Journalism Practice, Vol. 19, Issue 10, February 2025, tandfonline.com) identifies selective sourcing as one of the primary structural mechanisms through which inaccurate impressions propagate in otherwise factually correct articles finding that "supporting and improving high-quality journalism is considered essential in combatting the spread of disinformation."
What ReporterLens™ measures: The Source Outreach Tracker identifies named subjects in an article who were not contacted for comment and flags whether pending litigation or other documented circumstances may explain the absence. It does not penalize reporters whose outreach attempts were declined — it surfaces gaps so readers can account for them. |
Reader checklist for this distinction: If an article makes a significant negative claim about a named person or institution, was that party offered an opportunity to respond? If not, does the article explain why? An absence without explanation is itself information about the completeness of the reporting.
5. Anonymous Sources Lower Readers' Ability to Verify Anything.
Anonymity is sometimes necessary. Whistleblowers, witnesses to crimes, and individuals facing retaliation cannot always speak on the record. The SPJ Code of Ethics accepts anonymity as a protected exception: "Consider sources' motives before promising anonymity. Reserve anonymity for sources who may face danger, retribution or other harm, and have information that cannot be obtained elsewhere" (SPJ, 2014, spj.org).
The standard is that anonymity should be an exception, not a default. Phrases like "sources familiar with the matter," "officials who requested anonymity," and "people close to the situation" appear regularly in coverage as substitutes for named sourcing rather than protected exceptions to it. The Reuters Institute Digital News Report 2025 (July 2025, reutersinstitute.politics.ox.ac.uk) found ongoing declines in public trust in news across markets, with sourcing transparency among the cited reasons audiences give for distrusting political and economic coverage.

The structural problem with anonymous sourcing is not that anonymous sources are unreliable, indeed, they may be highly reliable. The problem is that readers have no mechanism to evaluate the claim independently. They cannot assess the source's credentials, institutional affiliation, or potential motivation. They are being asked to accept a claim on the outlet's authority alone.
What ReporterLens™ measures: Attribution Quality distinguishes between named and anonymous sourcing within the same article. An article citing four named experts and two unnamed 'officials' does not receive the same Attribution Quality score as an article citing six named, credentialed sources — because the reader's ability to independently verify each category of claim is categorically different. |
A Two-Minute Checklist for Readers
When evaluating any article making a significant factual claim:
1. Is the source named, and are their credentials directly relevant to this specific claim, not merely adjacent to it?
2. Is the claim corroborated by a second source, a document, or a dataset or does it rest on a single source's word?
3. Does the article's conclusion match what the cited source actually said, or does it extend beyond it?
4. Is there a named party who would reasonably dispute the claim who is not quoted or paraphrased in the article?
5. If a source is anonymous, does the article explain why anonymity was necessary and whether no alternative source was available?
A yes to all five suggests the article made a meaningful attempt at both attribution and verification. A no to any one does not mean the article is false — but it identifies a gap that warrants skepticism or additional reporting before accepting the claim.
What the ReporterLens™ Data Contributes
The distinctions above are longstanding in journalism ethics and professional standards. What the ReporterLens™ corpus contributes is measurement at scale. The July 2026 snapshot demonstrates empirically that Attribution Quality and Evidence-Claim Gap are independent variables and raising one does not reliably lower the other. The practical implication is that they require separate structural solutions.
For journalists: treat each conclusion as its own verification task. Strong attribution does not eliminate the need to ask whether each conclusion drawn from a source is proportional to what that source actually established. Document verification steps in copy or in editorial notes. Track outreach attempts to key subjects and be explicit when anonymous sourcing is used and why.
For readers: treat named, credentialed sources as a positive signal and not conclusive proof. The presence of a name and a title tells you who spoke. It does not tell you whether what they said is independently supported, whether the conclusion drawn matches what they established, or whether the strongest counterargument is represented elsewhere in the piece.
For newsrooms: the gap between attribution and verification is structural, not individual. It requires editorial systems, not just editorial standards, to close consistently. Verification checklists, outreach logs, and post-publication correction tracking are the mechanisms the research on newsroom practice consistently identifies as the difference between stated norms and applied discipline.
Try It Free: ReporterLens™ measures Attribution Quality, Fact Verification, Source Credibility, Evidence-Claim Gap, and Source Outreach separately in every article it analyzes. Free, no signup required, on any published article or draft at reporterlens.app. Your draft is never saved or shared. |
Sources
Society of Professional Journalists. SPJ Code of Ethics. Revised 2014. spj.org/spj-code-of-ethics/
Shapiro, Ivor, et al. "Doing the Right Things for the Right Reasons: Journalism's Emerging Standards of Verification." Journalism Practice, 2013. Documented by Poynter, November 25, 2013. poynter.org/reporting-editing/2013/new-research-details-how-journalists-verify-information/
Reuters Institute for the Study of Journalism. Journalism, Media, and Technology Trends and Predictions 2026. January 12, 2026. reutersinstitute.politics.ox.ac.uk
Cazzamatta, Regina, and Aynur Sarısakaloğlu. "Mapping Global Emerging Scholarly Research and Practices of AI-supported Fact-Checking Tools in Journalism." Journalism Practice, Vol. 19, Issue 10. Published February 13, 2025. tandfonline.com/doi/full/10.1080/17512786.2025.2463470
Reuters Institute for the Study of Journalism. Digital News Report 2025. July 2025. reutersinstitute.politics.ox.ac.uk
The Media Integrity Project. ReporterLens™ Corpus Snapshot, July 2026 (n = 1,650 analyses). Methodology at reporterlens.app/methodology.
The Media Integrity Project is an independent, nonpartisan organization and the publisher of ReporterLens™. All corpus data cited in this article was generated by ReporterLens™. The methodology governing that data is publicly available at reporterlens.app/methodology. Corrections: press@themediaintegrityproject.com




Comments