Update Gitlab::LicenseScanning::PackageLicenses#fetch to process components in batches
Proposal
While working on Add class for fetching package licenses (!107186 - merged), it was determined in this comment that fetching over 5,000
records at a time is too slow, and that it's more efficient to fetch in batches of 700
records. Due to time constraints, we decided to impose a maximum allowed value of 1,000
components for the fetch
method, and to update the logic in a follow-up issue to handle an arbitrary number of components.
The purpose of this issue is to update the Gitlab::LicenseScanning::PackageLicenses#fetch
method so it fetches in batches of 700
records, and is capable of handling an arbitrary number of components efficiently.