Date
1 - 3 of 3
Still random failures at gitlab
|
Pavel Machek
Hi!
I'm still getting random failures at gitlab. Is the info below enough / can I retry the tests now to get real results? Thanks and best regards, Pavel https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/pipelines/679070235 https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/jobs/3238998916 Running with gitlab-runner 15.4.0 (43b2dc3d) 2 on 1665142213-cip-project-small-v9-project-gitlab-runner-85dctt8xr Uf_MsYPS 3 feature flags: FF_KUBERNETES_HONOR_ENTRYPOINT:true 4 Resolving secrets 00:00 6 Preparing the "kubernetes" executor 00:00 7Using Kubernetes namespace: gitlab 8Using Kubernetes executor with image registry.gitlab.com/cip-project/cip-testing/linux-cip-ci:test-v3 ... 9Using attach strategy to execute scripts... 11 Preparing environment 03:07 12Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 13 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 14Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 15 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 16Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 17 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 18Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 19 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 20Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 21 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 22Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 23 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 24Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 25 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 26Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 27 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 28Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 29 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 30Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 31 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 32Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 33 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 34Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 35 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 36Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 37 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 38Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 39 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 40Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 41 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 42Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-0nzck6 to be running, status is Pending 43 Unschedulable: "0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling." 44Waiting for pod gitlab/runner-ufmsyps-project -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany |
|
|
|
Pavel Machek
Hi!
I'm still getting random failures at gitlab. Is the info below enough4.9 testing has different failure mode: https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/pipelines/679070249 https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/jobs/3238999016 Running with gitlab-runner 15.4.0 (43b2dc3d) 2 on 1665142213-cip-project-small-v9-project-gitlab-runner-85dctt8xr Uf_MsYPS 3 feature flags: FF_KUBERNETES_HONOR_ENTRYPOINT:true 4 Resolving secrets 00:00 6 Preparing the "kubernetes" executor 00:00 7Using Kubernetes namespace: gitlab 8Using Kubernetes executor with image registry.gitlab.com/cip-project/cip-testing/linux-cip-ci:test-v3 ... 9Using attach strategy to execute scripts... 11 Preparing environment 00:06 12Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-8tdl4w to be running, status is Pending 13 ContainersNotInitialized: "containers with incomplete status: [init-permissions]" 14 ContainersNotReady: "containers with unready status: [build helper]" 15 ContainersNotReady: "containers with unready status: [build helper]" 16Waiting for pod gitlab/runner-ufmsyps-project-14394223-concurrent-8tdl4w to be running, status is Pending 17 ContainersNotReady: "containers with unready status: [build helper]" 18 ContainersNotReady: "containers with unready status: [build helper]" 19Running on runner-ufmsyps-project-14394223-concurrent-8tdl4w via 1665142213-cip-project-small-v9-project-gitlab-runner-85dctt8xr... 21 Getting source from Git repository 00:01 22Skipping Git repository setup 23Skipping Git checkout 24Skipping Git submodules setup 26 Downloading artifacts 01:32 27Downloading artifacts for build:arm_cip_bbb_defconfig (3238998979)... 28ERROR: Downloading artifacts from coordinator... error couldn't execute GET against https://gitlab.com/api/v4/jobs/3238998979/artifacts?direct_download=true: Get "https://gitlab.com/api/v4/jobs/3238998979/artifacts?direct_download=true": dial tcp: i/o timeout id=3238998979 token=BszELFyL 29WARNING: Retrying... error=invalid argument 30ERROR: Downloading artifacts from coordinator... error couldn't execute GET against https://gitlab.com/api/v4/jobs/3238998979/artifacts?: Get "https://gitlab.com/api/v4/jobs/3238998979/artifacts?": dial tcp: i/o timeout id=3238998979 token=BszELFyL 31WARNING: Retrying... error=invalid argument 32ERROR: Downloading artifacts from coordinator... error couldn't execute GET against https://gitlab.com/api/v4/jobs/3238998979/artifacts?: Get "https://gitlab.com/api/v4/jobs/3238998979/artifacts?": dial tcp: i/o timeout id=3238998979 token=BszELFyL 33FATAL: invalid argument 35 Uploading artifacts for failed job 00:00 36Uploading artifacts... 37WARNING: output: no matching files. Ensure that the artifact path is relative to the working directory 38ERROR: No files to upload 40 Cleaning up project directory and file based variables 00:01 42ERROR: Job failed: command terminated with exit code 1 -- DENX Software Engineering GmbH, Managing Director: Wolfgang Denk HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany |
|
|
|
Chris Paterson
Hi Pavel,
From: Pavel Machek <pavel@...>Thank you for the report and links. I noticed similar issues yesterday as well. I'll let you know when we've found the issue behind it. Kind regards, Chris
|
|
|