Kubernetes integration tests fail on master
Overview
Running go test -v -run TestRunTestsWithFeatureFlag gitlab.com/gitlab-org/gitlab-runner/executors/kubernetes
on the mater branch there is some failures in our tests.
--- FAIL: TestRunTestsWithFeatureFlag (154.81s)
--- PASS: TestRunTestsWithFeatureFlag/testSetupBuildPodServiceCreationError_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (0.01s)
--- PASS: TestRunTestsWithFeatureFlag/testSetupBuildPodServiceCreationError_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testInteractiveTerminal_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (11.99s)
--- PASS: TestRunTestsWithFeatureFlag/testInteractiveTerminal_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (11.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumes_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumes_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/no_custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumes_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumes_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumes_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/no_custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumes_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/no_custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/custom_volumes_with_read-only_settings (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/no_custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/custom_volumes (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testVolumeMounts_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/custom_volumes_with_read-only_settings (0.00s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesBuildCancel_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (1.10s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesBuildCancel_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (3.11s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesBuildAbort_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (1.09s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesBuildAbort_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (3.13s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesBuildFail_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (7.36s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesBuildFail_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (3.97s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesTimeoutRun_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (10.10s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesTimeoutRun_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (10.12s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesCustomClonePath_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (13.18s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesCustomClonePath_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/uses_custom_clone_path (4.08s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesCustomClonePath_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true/path_has_to_be_within_CI_BUILDS_DIR (9.02s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesCustomClonePath_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (12.98s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesCustomClonePath_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/uses_custom_clone_path (3.89s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesCustomClonePath_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false/path_has_to_be_within_CI_BUILDS_DIR (9.01s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesNoRootImage_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (4.20s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesNoRootImage_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (4.25s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesMissingImage_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (3.14s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesMissingImage_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (3.16s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesMissingTag_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (3.12s)
--- FAIL: TestRunTestsWithFeatureFlag/testKubernetesMissingTag_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (3.15s)
--- PASS: TestRunTestsWithFeatureFlag/testOverwriteNamespaceNotMatch_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (9.10s)
--- PASS: TestRunTestsWithFeatureFlag/testOverwriteNamespaceNotMatch_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (9.10s)
--- PASS: TestRunTestsWithFeatureFlag/testOverwriteServiceAccountNotMatch_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (9.10s)
--- PASS: TestRunTestsWithFeatureFlag/testOverwriteServiceAccountNotMatch_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (9.09s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesSuccessRun_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_true (4.18s)
--- PASS: TestRunTestsWithFeatureFlag/testKubernetesSuccessRun_FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY_false (4.07s)
We don't see this failure in our pipeline because we don't run kubernetes integration tests in our pipeline