{"id":2514,"date":"2019-02-16T08:30:44","date_gmt":"2019-02-16T08:30:44","guid":{"rendered":"https:\/\/factcheckni.org\/?p=2514"},"modified":"2023-10-12T11:23:28","modified_gmt":"2023-10-12T11:23:28","slug":"for-your-consideration-factcheckni-verdict-ratings","status":"publish","type":"post","link":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/","title":{"rendered":"For your consideration: FactCheckNI verdict ratings"},"content":{"rendered":"\n

What does it mean for something to be \u201ctrue\u201d, \u201ccorrect\u201d, or \u201caccurate\u201d? Can anything be absolutely true or completely false? Is there any difference between being correct and being accurate?<\/strong><\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Most fact-checking projects employ a verdict rating system. The initial policy at FactCheckNI was to avoid using an explicit rating system. Instead, we suggested that the reader draw his or her own conclusions from the concise summary provided in each article that fact-checked a claim.<\/p>\n\n\n\n

We based this policy on our motivation to inform and educate, rather than to determine a judgement, or intention, on the \u201ctruthfulness\u201d of the claim.<\/p>\n\n\n\n

Researchers recently asked us to categorise the results of our claim investigations. We paused to assess how we had utilised a range of words prominently in our fact-check conclusions and discussed whether we could tighten up our usage to increase comprehension and reduce confusion.<\/p>\n\n\n\n

Many of our article conclusions contained the term \u201caccurate\u201d or \u201cinaccurate\u201d. What do those terms mean?
In data sciences, there is an established procedure to determine a margin or error (e.g. +\/- x%); if something falls outside this margin, then you can question its accuracy. If there are five people seated in a room, then \u2013 in terms of accuracy of numeric estimation \u2013 the answers \u201c4\u201d, \u201c5\u201d, or \u201c6\u201d are all accurate. There is no need to determine a status of \u201cless than accurate\u201d or \u201cmore than inaccurate\u201d.<\/p>\n\n\n\n

In the case of qualitative claims, how close is the claim to the evidence? For example, you can check the audio\/video recording or official transcript against what was reported to be said. Perhaps it corroborates (\u201caccurate\u201d). Perhaps it almost corroborates; in such cases, we will say \u201caccurate with considerations\u201d, pointing out the inaccuracies but not deeming the whole matter inaccurate. This can work the other way round, too — \u201cinaccurate with considerations\u201d — when there\u2019s an element of the claim that we wish to underline.<\/p>\n\n\n\n

\u201cWith considerations\u201d is still a qualifier, such as \u201cmostly\u201d\/\u201dalmost\u201d\/\u201dpartly\u201d\/\u201dhalf\u201d. But it is not a statement on the degree of \u201ctrue\u201d\/\u201dtruth\u201d\/\u201dcorrect\u201d\/\u201dright\u201d-ness of the claim. Just that there are some aspects that we wish to draw to your attention for consideration.<\/p>\n\n\n\n

And then there are those claims where we don\u2019t come to any conclusion on accuracy or inaccuracy. This may be because of insufficient information to substantiate or rebuke the claim. Thus, we will apply a conclusion of \u201cunsubstantiated\u201d.<\/p>\n\n\n\n

The following verdict ratings will be applied to FactCheckNI fact-check articles:<\/p>\n\n\n\n

    \n
  1. accurate (evidence corroborates; within margin or error)<\/li>\n\n\n\n
  2. accurate with considerations (qualifications)<\/li>\n\n\n\n
  3. unsubstantiated (insufficient information)<\/li>\n\n\n\n
  4. inaccurate with considerations (qualifications)<\/li>\n\n\n\n
  5. inaccurate (evidence does not corroborate; outside margin of error)<\/li>\n\n\n\n
  6. mixture (recognise the differing veracity of sub-claims)<\/li>\n\n\n\n
  7. it’s complicated (where a claim is so open to interpretation that none of our other five ratings properly fit, e.g. where competing narratives place agreed facts in different contexts)<\/li>\n<\/ol>\n\n\n\n

    This effort is to try to establish a system for our claim verdicts that is as objective as possible.<\/p>\n\n\n\n

    We still argue that it is up to the reader to determine how much weight to apply to any of our article conclusions. Is a misapplied piece of satire better or worse than a state agency misreporting economic data? We have our views. It\u2019s up to you to defend yours.<\/p>\n\n\n\n

    Our hope is that other fact-checking projects see the benefit of a more objective-based system of claim verdicts — to take some subjectivity out of scrutinising facts and to spend more time on other crucial aspects of our work, such as developing a greater appreciation of media literacy and critical thinking.<\/p>\n","protected":false},"excerpt":{"rendered":"

    What does it mean for something to be \u201ctrue\u201d, \u201ccorrect\u201d, or \u201caccurate\u201d? Can anything be absolutely true or completely false? Is there any difference between being correct and being accurate? Most fact-checking projects employ a verdict rating system. The initial policy at FactCheckNI was to avoid using an explicit rating system. Instead, we suggested that…<\/p>\n","protected":false},"author":2,"featured_media":20705,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[20],"tags":[56],"acf":[],"yoast_head":"\nFor your consideration: FactCheckNI verdict ratings - FactCheckNI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"For your consideration: FactCheckNI verdict ratings - FactCheckNI\" \/>\n<meta property=\"og:description\" content=\"What does it mean for something to be \u201ctrue\u201d, \u201ccorrect\u201d, or \u201caccurate\u201d? Can anything be absolutely true or completely false? Is there any difference between being correct and being accurate? Most fact-checking projects employ a verdict rating system. The initial policy at FactCheckNI was to avoid using an explicit rating system. Instead, we suggested that...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\" \/>\n<meta property=\"og:site_name\" content=\"FactCheckNI\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/factcheckni\" \/>\n<meta property=\"article:published_time\" content=\"2019-02-16T08:30:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-12T11:23:28+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1420\" \/>\n\t<meta property=\"og:image:height\" content=\"955\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"FactCheckNI\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@FactCheckNI\" \/>\n<meta name=\"twitter:site\" content=\"@FactCheckNI\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"FactCheckNI\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\"},\"author\":{\"name\":\"FactCheckNI\",\"@id\":\"https:\/\/factcheckni.org\/#\/schema\/person\/85d1ea0fa0159339bdadca79e73ec7fa\"},\"headline\":\"For your consideration: FactCheckNI verdict ratings\",\"datePublished\":\"2019-02-16T08:30:44+00:00\",\"dateModified\":\"2023-10-12T11:23:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\"},\"wordCount\":603,\"publisher\":{\"@id\":\"https:\/\/factcheckni.org\/#organization\"},\"image\":{\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg\",\"keywords\":[\"fact checking\"],\"articleSection\":[\"News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\",\"url\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\",\"name\":\"For your consideration: FactCheckNI verdict ratings - FactCheckNI\",\"isPartOf\":{\"@id\":\"https:\/\/factcheckni.org\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg\",\"datePublished\":\"2019-02-16T08:30:44+00:00\",\"dateModified\":\"2023-10-12T11:23:28+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage\",\"url\":\"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg\",\"contentUrl\":\"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg\",\"width\":1420,\"height\":955},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/factcheckni.org\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"For your consideration: FactCheckNI verdict ratings\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/factcheckni.org\/#website\",\"url\":\"https:\/\/factcheckni.org\/\",\"name\":\"FactCheckNI\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/factcheckni.org\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/factcheckni.org\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/factcheckni.org\/#organization\",\"name\":\"FactCheckNI\",\"url\":\"https:\/\/factcheckni.org\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/factcheckni.org\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/factcheckni.org\/wp-content\/uploads\/2020\/04\/Logo-FactCheckNI-JPG-1.jpg\",\"contentUrl\":\"https:\/\/factcheckni.org\/wp-content\/uploads\/2020\/04\/Logo-FactCheckNI-JPG-1.jpg\",\"width\":1472,\"height\":361,\"caption\":\"FactCheckNI\"},\"image\":{\"@id\":\"https:\/\/factcheckni.org\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/factcheckni\",\"https:\/\/x.com\/FactCheckNI\",\"https:\/\/www.instagram.com\/factcheckni_\",\"https:\/\/www.linkedin.com\/company\/factcheckni\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/factcheckni.org\/#\/schema\/person\/85d1ea0fa0159339bdadca79e73ec7fa\",\"name\":\"FactCheckNI\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/factcheckni.org\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4dd32bb816d3f7c31c3cbc856bd695b0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4dd32bb816d3f7c31c3cbc856bd695b0?s=96&d=mm&r=g\",\"caption\":\"FactCheckNI\"},\"description\":\"Northern Ireland's first and only dedicated fact checking service.\",\"sameAs\":[\"http:\/\/factcheckni.org\"],\"url\":\"https:\/\/factcheckni.org\/author\/factcheckni\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"For your consideration: FactCheckNI verdict ratings - FactCheckNI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/","og_locale":"en_US","og_type":"article","og_title":"For your consideration: FactCheckNI verdict ratings - FactCheckNI","og_description":"What does it mean for something to be \u201ctrue\u201d, \u201ccorrect\u201d, or \u201caccurate\u201d? Can anything be absolutely true or completely false? Is there any difference between being correct and being accurate? Most fact-checking projects employ a verdict rating system. The initial policy at FactCheckNI was to avoid using an explicit rating system. Instead, we suggested that...","og_url":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/","og_site_name":"FactCheckNI","article_publisher":"https:\/\/www.facebook.com\/factcheckni","article_published_time":"2019-02-16T08:30:44+00:00","article_modified_time":"2023-10-12T11:23:28+00:00","og_image":[{"width":1420,"height":955,"url":"http:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg","type":"image\/jpeg"}],"author":"FactCheckNI","twitter_card":"summary_large_image","twitter_creator":"@FactCheckNI","twitter_site":"@FactCheckNI","twitter_misc":{"Written by":"FactCheckNI","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#article","isPartOf":{"@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/"},"author":{"name":"FactCheckNI","@id":"https:\/\/factcheckni.org\/#\/schema\/person\/85d1ea0fa0159339bdadca79e73ec7fa"},"headline":"For your consideration: FactCheckNI verdict ratings","datePublished":"2019-02-16T08:30:44+00:00","dateModified":"2023-10-12T11:23:28+00:00","mainEntityOfPage":{"@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/"},"wordCount":603,"publisher":{"@id":"https:\/\/factcheckni.org\/#organization"},"image":{"@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage"},"thumbnailUrl":"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg","keywords":["fact checking"],"articleSection":["News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/","url":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/","name":"For your consideration: FactCheckNI verdict ratings - FactCheckNI","isPartOf":{"@id":"https:\/\/factcheckni.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage"},"image":{"@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage"},"thumbnailUrl":"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg","datePublished":"2019-02-16T08:30:44+00:00","dateModified":"2023-10-12T11:23:28+00:00","breadcrumb":{"@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#primaryimage","url":"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg","contentUrl":"https:\/\/factcheckni.org\/wp-content\/uploads\/2016\/04\/large-magnifying-glass-e1459640806248-1.jpg","width":1420,"height":955},{"@type":"BreadcrumbList","@id":"https:\/\/factcheckni.org\/articles\/news\/for-your-consideration-factcheckni-verdict-ratings\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/factcheckni.org\/"},{"@type":"ListItem","position":2,"name":"For your consideration: FactCheckNI verdict ratings"}]},{"@type":"WebSite","@id":"https:\/\/factcheckni.org\/#website","url":"https:\/\/factcheckni.org\/","name":"FactCheckNI","description":"","publisher":{"@id":"https:\/\/factcheckni.org\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/factcheckni.org\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/factcheckni.org\/#organization","name":"FactCheckNI","url":"https:\/\/factcheckni.org\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/factcheckni.org\/#\/schema\/logo\/image\/","url":"https:\/\/factcheckni.org\/wp-content\/uploads\/2020\/04\/Logo-FactCheckNI-JPG-1.jpg","contentUrl":"https:\/\/factcheckni.org\/wp-content\/uploads\/2020\/04\/Logo-FactCheckNI-JPG-1.jpg","width":1472,"height":361,"caption":"FactCheckNI"},"image":{"@id":"https:\/\/factcheckni.org\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/factcheckni","https:\/\/x.com\/FactCheckNI","https:\/\/www.instagram.com\/factcheckni_","https:\/\/www.linkedin.com\/company\/factcheckni"]},{"@type":"Person","@id":"https:\/\/factcheckni.org\/#\/schema\/person\/85d1ea0fa0159339bdadca79e73ec7fa","name":"FactCheckNI","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/factcheckni.org\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4dd32bb816d3f7c31c3cbc856bd695b0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4dd32bb816d3f7c31c3cbc856bd695b0?s=96&d=mm&r=g","caption":"FactCheckNI"},"description":"Northern Ireland's first and only dedicated fact checking service.","sameAs":["http:\/\/factcheckni.org"],"url":"https:\/\/factcheckni.org\/author\/factcheckni\/"}]}},"_links":{"self":[{"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/posts\/2514"}],"collection":[{"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/comments?post=2514"}],"version-history":[{"count":3,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/posts\/2514\/revisions"}],"predecessor-version":[{"id":23518,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/posts\/2514\/revisions\/23518"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/media\/20705"}],"wp:attachment":[{"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/media?parent=2514"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/categories?post=2514"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/factcheckni.org\/wp-json\/wp\/v2\/tags?post=2514"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}