Create new zoekt index when watermark indices can no longer reserve additional storage
This should be behind a temporary feature flag zoekt_index_creations
Let's create a scheduled task that checks for zoekt indices with a watermark that have nodes with unclaimed_storage_bytes
less than or equal to 0
. The nodes that meet this criteria cannot give out any additional storage reservations so another index needs to be created.
- If the namespace has less than
MAX_INDICES
, we can create and assign a new index to another node with the maximum unclaimed storage bytes.- If no nodes have any unclaimed storage available, we should log an error
- If the namespace has
MAX_INDICES
already, we should log an error.
Edited by John Mason