Allow verification of files in Object Storage

Problem to solve

Not all files are stored locally on disc, we need to allow for verification of objects in object storage as well.

Initial Proposal

• Add a GeoNode setting Allow verification of files in Object Storage

• Modify #checksummable? and .registries_pending_verification so that checksums are calculated if allowed (this will download the whole file each time)

• This is inefficient, but we can add optimizations in later iterations

• Modify code that calculates checksums that relies on files being locally stored

Updated Proposal

Use file size instead of checksum for a first iteration. It addressed most of the concerns. It helps to detect human mistakes like removing buckets or changing access settings. It also checks the file existence and basic file identification (the size).

Permissions and Security

TBD

Documentation

We will need update the relevant tables in the Supported Geo data types docs page.

Testing

What does success look like, and how can we measure that?

TBD