1
0
Fork 0
mirror of https://github.com/git/git.git synced 2024-05-06 01:46:12 +02:00

maintenance: add get_random_minute()

When we initially created background maintenance -- with its hourly,
daily, and weekly schedules -- we considered the effects of all clients
launching fetches to the server every hour on the hour. The worry of
DDoSing server hosts was noted, but left as something we would consider
for a future update.

As background maintenance has gained more adoption over the past three
years, our worries about DDoSing the big Git hosts has been unfounded.
Those systems, especially those serving public repositories, are already
resilient to thundering herds of much smaller scale.

However, sometimes organizations spin up specific custom server
infrastructure either in addition to or on top of their Git host. Some
of these technologies are built for a different range of scale, and can
hit concurrency limits sooner. Organizations with such custom
infrastructures are more likely to recommend tools like `scalar` which
furthers their adoption of background maintenance.

To help solve for this, create get_random_minute() as a method to help
Git select a random minute when creating schedules in the future. The
integrations with this method do not yet exist, but will follow in
future changes.

To avoid multiple sources of randomness in the Git codebase, create a
new helper function, git_rand(), that returns a random uint32_t. This is
similar to how rand() returns a random nonnegative value, except it is
based on csprng_bytes() which is cryptographic and will return values
larger than RAND_MAX.

One thing that is important for testability is that we notice when we
are under a test scenario and return a predictable result. The schedules
themselves are not checked for this value, but at least one launchctl
test checks that we do not unnecessarily reboot the schedule if it has
not changed from a previous version.

Signed-off-by: Derrick Stolee <derrickstolee@github.com>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
This commit is contained in:
Derrick Stolee 2023-08-10 20:39:40 +00:00 committed by Junio C Hamano
parent a82fb66fed
commit 89024a0ab0
3 changed files with 26 additions and 0 deletions

View File

@ -1708,6 +1708,16 @@ static int get_schedule_cmd(const char **cmd, int *is_available)
return 1;
}
MAYBE_UNUSED
static int get_random_minute(void)
{
/* Use a static value when under tests. */
if (getenv("GIT_TEST_MAINT_SCHEDULER"))
return 13;
return git_rand() % 60;
}
static int is_launchctl_available(void)
{
const char *cmd = "launchctl";

View File

@ -819,3 +819,13 @@ int csprng_bytes(void *buf, size_t len)
return 0;
#endif
}
uint32_t git_rand(void)
{
uint32_t result;
if (csprng_bytes(&result, sizeof(result)) < 0)
die(_("unable to get random bytes"));
return result;
}

View File

@ -139,4 +139,10 @@ void sleep_millisec(int millisec);
*/
int csprng_bytes(void *buf, size_t len);
/*
* Returns a random uint32_t, uniformly distributed across all possible
* values.
*/
uint32_t git_rand(void);
#endif /* WRAPPER_H */