Geo: Improve performance of RegistryBackfillService with bulk insert
Problem to solve
Improve performance of RegistryBackfillService with bulk insert.
Follow up for !20002 (comment 266285571):
@toon It's weird. It seems like some optimization isn't playing well with the way we are using multiple DBs.
Bulk insert somehow causes
find_missing_registry_ids
to not realize that the joined registry table has changed. So it keeps returning the same data until something else changes, like when anlfs_objects
record is created, or when the RegistryBackfillWorker job is killed and another one replaces it.I'm removing this for now because I believe the "slow" way would still represent only a small percentage of the time and resources to sync. We will test performance while this is feature flagged, and then solve this weirdness if necessary.
Intended users
Further details
Proposal
The main work here is to figure out the bug in the quote in the summary.