AI Tools for Evaluating Journalism
Updated: Sep 17
Overview of AI Tools
The landscape of AI tools for journalism is rapidly evolving. These tools aim to enhance transparency and accountability in news reporting. They provide valuable insights for journalists, readers, and media organizations. Below, I will explore some of the most notable tools available today.
PRIMARY (FORMERLY OBJECTION.AI)
The Tool: Primary www.theprimary.com
What it is: Primary operates a public, searchable "Primary Index" that assigns scores to individual journalists and their published articles. Scores for articles roll up into a headline score for each journalist. The index weights recent work more heavily and applies a decay, so an author’s oldest pieces carry roughly 6% of the weight, according to the project whitepaper.
How it works: Primary scores articles based on seven weighted factors. These include the use of sources and attribution, evidence quality and relevance, and evidence traceability. The three highest-weighted metrics are followed by balance and acknowledgment of uncertainty, fact vs. opinion separation, polemical language, and source balance. Together, these seven weights sum to 1.0. The company reported at launch that the index covered more than 20,000 journalists and roughly 2 million articles.
Who it’s for: Primary's audiences include readers, journalists, and news employers who seek a data-driven view of reporting. Journalists can claim profiles and file a "Report an Issue" flag for human review. The company's FAQ describes that such issues are reviewed by staff.
Background: The service launched in spring 2026 as Objection.ai with a paid arbitration model. This model was taken offline in May 2026, and the company relaunched as a public index in July 2026. The project’s founder, Dr. Aron D’Souza, has discussed the idea publicly.
TRUST IN MEDIA COOPERATIVE (TIM)
The Tool: InQ Data Platform https://dashboard.timcoop.org/
What it is: Trust in Media Cooperative (TIM) is a Washington-based nonprofit. Its mission is to strengthen the infrastructure behind high-quality content and information quality. The organization operates the InQ Data Platform as a public beta.
How it works: TIM’s InQ Data Platform provides a dashboard that uses machine assistance to describe how an article aligns with standards such as factual fidelity, source provenance, consistency, timeliness, sentiment neutrality, and completeness. TIM characterizes the beta as an exploratory tool for refining standards and gathering feedback.
Who It's For: TIM positions the InQ Data Platform primarily for those working on media literacy and information-quality standards rather than for readers seeking single-article ratings.
NEWSGRADE
The Tool: NewsGrade Analyzer https://newsgrade.org/
What it is: NewsGrade, produced by Editorial Style LLC, is a free self-service audit aimed at newsrooms’ websites rather than individual stories or reporters.
How it works: NewsGrade runs a 10-step checklist that evaluates editorial transparency signals, mobile experience, SEO, and structured data. Instead of a numeric score, it returns a punch-list of concrete fixes.
Who It's For: Newsrooms looking for an audit of their site can benefit from this tool.
NEWSGUARD AI
The Tool: NewsGuard AI https://www.newsguard.ai/
What it is and How it Works: NewsGuard AI launched in June 2026. It combines human analysts and technology to produce Source Reliability Ratings for news outlets. The service is presented as a chatbot that answers news questions using only sources vetted by NewsGuard.
Who It’s For: NewsGuard frames NewsGuard AI as a consumption-side trust layer for readers who want answers limited to vetted outlets.
REPORTERLENS™
The Tool: https://reporterlens.app
What it is: ReporterLens™ is the Media Integrity Project’s tool that scores articles and bylines against the Society of Professional Journalists Code of Ethics. It uses 17 weighted metrics, and the project publishes a methodology document for review.
How It Works: Users can enter a URL, copy and paste text, or use a Google Chrome Extension to analyze individual articles on metrics and ethics.
Who It’s For: The tool is designed for reporters to check drafts, for readers and news subjects to see how a story rates on sourcing and fairness, and for educators as a methodology-focused teaching aid.
ReporterLens™ is a volunteer-built, bootstrapped initiative intended to be transparent about its standards. The project is paired with the Humanity in Journalism podcast and an Impact Survey intended to surface how coverage affects people and reporting subjects.
Select AI Tools for Journalism Based on Your Interests and Outcomes
All the tools described here emerged publicly in spring and summer 2026. They vary in scope, stated audiences, and whether they publish individual reporter ratings.
Limitations and Next Steps
These tools are early-stage and differ in transparency, methodology, and governance. Readers and newsrooms should treat their outputs as one signal among many. Consult vendor methodology documents to understand what is measured. Where claims about reach, weighting, or revenue-sharing are made by vendors, this piece references vendor materials. Reporters should follow up with the companies for independent verification where needed.
Corrections and sources: For corrections, contact *info@themediaintegrityproject.com. Full ReporterLens™ methodology: reporterlens.app/methodology
Source materials cited in this piece include: the Primary whitepaper and FAQ, TIM materials, NewsGrade coverage, and NewsGuard product pages. Any piece authored by "The Media Integrity Project" is a combination of AI and human creation.
Nice
IPTV