A lot of compiles failing


Pavel Machek
 

Hi!

This is going on for a few days now, but today it seems worse than
usual:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843

builds are failing, 'HTTP 500 curl 22' error, so not a real build
problem. I can probably just click restart... 6 times. But something
is not there, and it is getting worse.

Best regards,
Pavel


g for pod gitlab/runner-bcrayztp-project-2678032-concurrent-7hmhsr to be running, status is Pending
74Running on runner-bcrayztp-project-2678032-concurrent-7hmhsr via cip-project-v3-gitlab-runner-6dbd79945f-wdqqw...
76
Fetching changes with git depth set to 10...
00:18
77Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-cip/.git/
78Created fresh repository.
79error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500
80fatal: the remote end hung up unexpectedly
82
Uploading artifacts...
00:00
83WARNING: output: no matching files
84ERROR: No files to upload
86ERROR: Job failed: command terminated with exit code 1
--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany


Pavel Machek
 

Hi!

This is going on for a few days now, but today it seems worse than
usual:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843

builds are failing, 'HTTP 500 curl 22' error, so not a real build
problem. I can probably just click restart... 6 times. But something
is not there, and it is getting worse.
Today I got new one....

Waiting for pod gitlab/runner-bcrayztp-project-2678032-concurrent-392fb6 to be running, status is Pending
217Running on runner-bcrayztp-project-2678032-concurrent-392fb6 via cip-project-v3-gitlab-runner-6dbd79945f-wdqqw...
219
Fetching changes with git depth set to 10...
00:35
220Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-cip/.git/
221Created fresh repository.
222error: RPC failed; curl 92 HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2)
223fatal: the remote end hung up unexpectedly
224fatal: early EOF
225fatal: index-pack failed
227
Uploading artifacts.

I wonder... Is each of our workers pulling full copy of kernel from
gitlab?

If so, I understand that gitlab might be a bit unhappy. We probably
should populate the initial version from our servers (or from
kernel.org), or maybe include copy of recent linux directly into
machine images... to reduce load on gitlab.

Best regards,
Pavel

--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany


Sudip Mukherjee
 

Hi Pavel,

On 24/11/2020 18:44, Pavel Machek wrote:
Hi!

This is going on for a few days now, but today it seems worse than
usual:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843

builds are failing, 'HTTP 500 curl 22' error, so not a real build
problem. I can probably just click restart... 6 times. But something
is not there, and it is getting worse.
Today I got new one....

Waiting for pod gitlab/runner-bcrayztp-project-2678032-concurrent-392fb6 to be running, status is Pending
217Running on runner-bcrayztp-project-2678032-concurrent-392fb6 via cip-project-v3-gitlab-runner-6dbd79945f-wdqqw...
219
Fetching changes with git depth set to 10...
00:35
220Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-cip/.git/
221Created fresh repository.
222error: RPC failed; curl 92 HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2)
223fatal: the remote end hung up unexpectedly
224fatal: early EOF
225fatal: index-pack failed
227
Uploading artifacts.

I wonder... Is each of our workers pulling full copy of kernel from
gitlab?

If so, I understand that gitlab might be a bit unhappy. We probably
should populate the initial version from our servers (or from
kernel.org), or maybe include copy of recent linux directly into
machine images... to reduce load on gitlab.
Maybe you can consider using git depth of 1.


--
Regards
Sudip


Chris Paterson
 

Hello Pavel,

From: Pavel Machek <pavel@denx.de>
Sent: 23 November 2020 19:10

*** gpg4o | The signature of this email could not be verified because the
following public key is missing. Click here to search and import the key
30E7F06A95DBFAF2 ***

Hi!

This is going on for a few days now, but today it seems worse than
usual:
For me things seems to have stabilised now.
Are you still seeing a lot of issues?

Kind regards, Chris



https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843

builds are failing, 'HTTP 500 curl 22' error, so not a real build
problem. I can probably just click restart... 6 times. But something
is not there, and it is getting worse.

Best regards,
                                                              Pavel


g for pod gitlab/runner-bcrayztp-project-2678032-concurrent-7hmhsr to be
running, status is Pending
74Running on runner-bcrayztp-project-2678032-concurrent-7hmhsr via cip-
project-v3-gitlab-runner-6dbd79945f-wdqqw...
76
Fetching changes with git depth set to 10...
00:18
77Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-
cip/.git/
78Created fresh repository.
79error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500
80fatal: the remote end hung up unexpectedly
82
Uploading artifacts...
00:00
83WARNING: output: no matching files
84ERROR: No files to upload
86ERROR: Job failed: command terminated with exit code 1
--
DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany


Pavel Machek
 

Hi!

From: Pavel Machek <pavel@denx.de>
Sent: 23 November 2020 19:10

*** gpg4o | The signature of this email could not be verified because the
following public key is missing. Click here to search and import the key
30E7F06A95DBFAF2 ***

Hi!

This is going on for a few days now, but today it seems worse than
usual:
For me things seems to have stabilised now.
Are you still seeing a lot of issues?
I still see them:

https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/pipelines/225881953

2 builds failed, for example:

https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/jobs/893211490

225
Cloning into '.'...
00:32
226$ git clone --depth 10 --branch $CI_COMMIT_REF_NAME
https://gitlab.com/cip-project/cip-testing/linux-stable-rc.git .
227error: RPC failed; HTTP 500 curl 22 The requested URL returned
error: 500 Server Error
228fatal: The remote end hung up unexpectedly

Best regards,
Pavel

--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany