Normalizing ratings
As platforms and organisations use a wide variation of rating systems we need to normalize ratings to get consistent rating values over all sources.
To get this done we have a very simple rating schema. This means indexed content needs to be translated into the following schema:
value
label
description / example
3
No issues: Content is rated as not problematic. Credibility high or very high.
The reviewed item is rated as mostly true or true.
2
Neutral: Whether positive nor negative rating. Neutral credibility.
The reviewed item is not rated as true, mostly true, mostly false or false.
1
Questionable: Content is rated as questionable (at least for some aspects).Credibility low or very low.
The reviewed item is rated as mostly false or false.
n/a
No rating
There is no rating.
Mapping example for climatefeedback
reviewRating.alternateName climatefeedback
Hoaxly normalized rating
> 0.5
3
-0.5 - 0.5
2
< - 0.5
1
n/a
n/a
So if an article on climatefeedback is rated with 0.5 we want to have it saved in hoax.ly index with an normalized rating of 2 (neutral).
Rating json schema
See the following schema for an description how ratings should be presented in the hoax.ly index:
"ReviewRating": {
"type": "object",
"properties": {
// THE ORIGINAL RATING
"originalRatingValue": {
"type": "integer"
},
// THE ORIGINAL ALTERNATE NAME
"originalAlternateName": {
"type": "string"
},
// THE LABEL FOR THE NORMALIZED RATING (Questionable, Neutral, No Issues)
"alternateName": {
"type": "integer"
},
// THE BEST RATING VALUE (IN OUR CASE ALWAYS 3)
"bestRating": {
"type": "integer"
},
// THE WORST RATING VALUE (IN OUR CASE ALWAYS 1)
"worstRating": {
"type": "integer"
},
// THE NORMALIZED RATING VALUE
"ratingValue": {
"type": "integer"
}
}
},
Last updated