Periodically check that indexed repositories still exist

[alranel]

We should periodically go through the indexed publiccodes and check whether they are still online. The ones which do not exist anymore should be hidden (or removed?) from the catalog, and logged.

[lorello]

I suppose that resolving this should prevent also "double" indexing like this:

• https://developers.italia.it/it/software/opencontent-stanzadelcittadino-cf016d
• https://developers.italia.it/it/software/opencontent-stanza-del-cittadino-core-410a6e

We changed our project repository URL from https://gitlab.com/opencontent/stanzadelcittadino
to https://gitlab.com/opencontent/stanza-del-cittadino/core

[bfabio]

Related to this, what happens when repos are archived?

I don't think we should stop indexing them because they can still be useful or relevant and maybe they were archived because they're considered done.

We should probably signal the archival somewhere - but maybe it can be a factor in the vitality calculation.

Related example: https://developers.italia.it/it/software/pcm-immuni-app-immuni

[libremente]

We should probably signal the archival somewhere - but maybe it can be a factor in the vitality calculation.

My 2cents: that's probably affecting the development status value.
By checking the docs it says:

obsolete - Il software non è più manutenuto o aggiornato. Tutto il codice sorgente è archiviato e tenuto per ragioni di storico.

However this would mean getting this info via API and overriding a publiccode.yml entry, not very clean...