Validator continues to show information for datasets that are unavailable for more than several days #573
Description
Brief Description
The Validator (and possibly/probably the Datastore, too) sometimes continues to show information for datasets that are unavailable for more than several days.
Severity
High
Issue Location
This issue arose when @stevieflow noticed that most of the AfDB's datasets were 404-ing, and had been for a while, but the Validator still reported on their status (e.g., Error, Critical). The AfDB's datasets have subsequently been fixed, so this issue will need investigating against a different set of data.
However, searching the Registry today for datasets with 404s, showed that most 404-ing datasets did not have an associated validation report. So the Validator/Datastore sometimes correctly removes the data after a 404, but under some circumstances is failing to do so.