Related discussion in https://dev.gitlab.org/gitlab/organization/issues/878
\cc @stanhu @dblessing @brittanyr @tiffanie @kirstenabma