Lights off

Process

This page explains how we select and research claims, and how we draft, edit, and publish our fact checks and explainer articles. It also outlines our corrections policy.

We encourage readers to send us claims to fact check, as well as requests for corrections (by email to [email protected]).

  • Claim selection

We ask ourselves two crucial questions before selecting a claim to evaluate:

    1. Is this important? (i.e. what will the impact of it going unchecked be?)
    2. Is it fact checkable? (i.e. is it based on peoples’ feelings or can we actually find an evidence base?)

We also consider the impact of claims. We do this by considering the following:

  • the “reach” of a claim, i.e. how much has it been shared or discussed (whether in the media or on social media platforms);
  • Has it been stated or repeated by those in positions of influence (e.g. a politician)?
  • Could it be harmful to people lives? (e.g. health misinformation).

We prefer well-defined claims and publicly available sources of information and data. Sometimes we uncover information through private correspondence and/or Freedom of Information (FOI) requests. On occasion, we may also include underlying data/information that is not in the public domain, in order to better explain an issue. We do not use anonymous sources.

In order for FactCheckNI to research a claim, the claim must be:

    • a statement made in public, which can be attributed to a specific person (not limited to politicians and campaigners) or organisation (perhaps a press release or a report)
    • an assertion or allegation that can be validated or refuted (to a degree)
    • based on past or present actions

We research the claim, but also aim to provide information about the context surrounding it. We believe this is an essential part of our work.

We base our work on broad range topics of concern to everyone in Northern Ireland: education; the economy; law; health; elections; and Europe/Brexit.

As well as publishing fact checks, we also produce explainer articles. These articles are an effort to walk readers through more complex claims and topics that are educational and informative, but cannot so easily be reduced to the simple indication of accuracy or inaccuracy in our verdict system. Sometimes we will investigate a topic that is in the news, to provide additional context to eliminate confusion rather than responding to an individual explicit claim.

New claims and information can be submitted via our online form at factcheckni.org/claims or by email to [email protected].

We may not check every claim suggested to us, but we promise to read everything that is submitted. It helps if you provide as much information as possible, such as date, source, and any particular reason why you’re skeptical about the claim.

  • Research

Where possible, we will usually attempt to contact the person/organisation who made the claim, to verify the accuracy and context of the statement of the claim. We will investigate any sources of information that the claimant provides. We may not be able to contact anonymous claimants, or very high profile people who have made well-reported claims. The lack of a claimant response will not delay publication of a fact check.

In our research, we are aware of the variable standards of quality and accuracy of source material; therefore we will link to the most reliable statistical information and primary sources. Official sources, or those from organisations working on specific areas, are often cited as best-available evidence, but we know that that nothing is perfect and the nature and quality of information can sometimes vary or indeed, change.

We welcome all additional information on our fact checks – so if you have additional detail and sources of information about this topic, please send it through to us here.

In all of our published articles we link to our sources, so readers can follow our investigation and double-check the primary source of information.

  • Drafting 

We assign individual researchers to the task of fact checking the claim/area of interest.

Editorial team 

Once collated, the research is assessed and drafted into article format by our Editor.

Articles are then reviewed by our Managing Director before publishing. More complex, or politically sensitive, topics will be forwarded to a third person – a member of our Board of Directors.

FactCheckNI retains full editorial control over what it fact checks and what it concludes.

Our ratings

Similar to other fact checking organisations, FactCheckNI has a set of ratings we use when assessing claims. We believe this allows readers to gain an insight into a particular issue, quickly. Our ratings are:

    • accurate (evidence corroborates; within margin or error)
    • accurate with considerations (qualifications)
    • unsubstantiated (insufficient information)
    • inaccurate with considerations (qualifications)
    • inaccurate (evidence does not corroborate; outside margin of error)
    • mixture (recognise the differing veracity of sub-claims)
    • it’s complicated (where a claim is so open to interpretation that none of our other five ratings properly fit, e.g. where competing narratives place agreed facts in different contexts)

In the rare instance that we check multiple claims in one article, we may assign a rating of ‘mixture’ to recognise the differing veracity of sub-claims.

These fixed categories aim to make our claim verdicts as objective as possible. We believe that it is up to the reader to determine how much weight to apply to any of our article conclusions. Is a misapplied piece of satire better or worse than a state agency misreporting economic data? We have our views. It’s up to you to defend yours.

It’s important to note that we fact check claims for accuracy; we do not question the motivation or intent of the person or organisation making the claim. We label claims as accurate or inaccurate, but attach no such labels (such as ‘liar’) to claimants. Readers are free to follow the evidence and draw their own conclusions, whether or not in agreement with our verdict.

Publishing 

We publish an overall summary of the claim and our verdict at the top of fact check articles. We outline high level observations at the top of explainer articles.

The substantive body of each article details our research and links to source material.

We share our articles through our social media channels (Facebook, Twitter and Instagram), and our content will surface through Google searches and on YouTube (as a result of our fact checks being submitted to the international Claim Review schema). FactCheckNI is also a participant in the Facebook Third Party Fact Checking Programme.

Reflecting

On a quarterly basis — and sometimes more often during election periods — FactCheckNI staff and directors review the mix of topics being fact checked, and whether a range of political claims are being addressed. These reviews focus on (if and where applicable): topic of focus; party political background; claimant source (if an individual); and is open to other areas of consideration depending on the claims or context in question (for example, we found ourselves fact checking a lot of COVID-19 claims in 2020 and 2021!).

While we strive for breadth and balance, we are aware that particular circumstances (a health pandemic or a particularly combative politician) can understandably skew that sense of balance. We committed to publishing an end of year (2024) summary of these reviews, and providing publicly available quarterly update summaries going forward. We believe this will provide evidence of the range, breadth and non-partisan nature of our work.

Corrections 

Our process is rigorous and aims to ensure that our published work is as accurate as possible. But we recognise that mistakes can happen. Post-publication of any FactCheckNI article, we welcome receiving further evidence, whether it refutes or validates our conclusion. You can read about how we deal with feedback and corrections here.

If you think we’ve got something wrong, you can contact us here.