Create test files

[rgaudin]

All the mirrors must serve the same file for use with the speed test. Location and name needs to accommodate all servers.
Although it should not require any mirror intervention, an email must be sent to admins informing them about this new file and its purpose.

File should be random binary data and weight 50MB.
We may also host a 1MB file for simulation/devel for use where speed accuracy is not important

[rgaudin]

Constraints:

• - .zim named so it's synced by mirrors without action on their part
• - an actual ZIM file so it's not deceptive (explains it's not actually content)
• - must be mirrored by all mirrors (or most of them) ; in case we cant have them all, we need a ticket to exclude from Update mirrors DB #12
• - ideally a single file but can be duplicated in several folders: wikipedia/ folder is synced on all mirrors but IL one (which only syncs a subset of it)
• - must not be included in Kiwix Catalog
• - Must not be included in opentracker
• - Must not be included in matomo stats

Currently testing with wikipedia/speedtest_en_blob_2024-05.zim

[rgaudin]

Opentracker is not a concern as it is based on Catalog

[rgaudin]

As discussed with @kelson42 we will exclude those downloads from the stats via a User-Agent exclusion rule.

I've added /speedtest/ to the global matomo configuration and we know that the log-import script has a list of UA patterns to exclude.

For this, I suggest we use the speedtester/robot string (maybe with a version number) as User-Agent as to fall into the script exclusion rule and not upload those log entries at all.

[rgaudin]

We now have:

• https://download.kiwix.org/zim/wikipedia/speedtest_en_blob_2024-05.zim 48M
• https://download.kiwix.org/zim/wikipedia/speedtest_en_blob-mini_2024-05.zim 2M

Both are available on 13 mirrors (all but IL). Code uses speedtester/robot as U-A.