Re: -stable-rc tests failing


Chris Paterson
 

Hello,

From: cip-dev@... <cip-dev@...> On
Behalf Of Nobuhiro Iwamatsu via lists.cip-project.org
Sent: 16 August 2021 00:15

Hi,

-----Original Message-----
From: cip-dev@... [mailto:cip-dev@...]
On Behalf Of Pavel Machek
Sent: Saturday, August 14, 2021 4:47 AM
To: Chris Paterson <Chris.Paterson2@...>
Cc: Pavel Machek <pavel@...>; cip-dev@...
Subject: Re: [cip-dev] -stable-rc tests failing

Hi!

WARNING: Retrying...                                error=invalid argument
2170ERROR: Downloading artifacts from coordinator... error couldn't
execute
GET against
https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgitlab
.com%2Fapi%2Fv4%2Fjobs%2F1492901612%2Fartifacts&amp;data=04%7C01
%7Cchris.paterson2%40renesas.com%7C4479c8657b2a40a46e3108d960428bd
8%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C6376466612029063
02%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM
zIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=qwhRPtRSueYf9
7CTKC1JVJbJGJWHpfwkWq9GebqwLs4%3D&amp;reserved=0?: Get
https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgitlab
.com%2Fapi%2Fv4%2Fjobs%2F1492901612%2Fartifacts&amp;data=04%7C01
%7Cchris.paterson2%40renesas.com%7C4479c8657b2a40a46e3108d960428bd
8%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C6376466612029063
02%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM
zIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=qwhRPtRSueYf9
7CTKC1JVJbJGJWHpfwkWq9GebqwLs4%3D&amp;reserved=0?: dial tcp: i/o
timeout
id=1492901612 token=9gNGsuaZ
2171FATAL: invalid argument
2173
Uploading artifacts for failed job

But I don't usually see this one:

https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgitlab
.com%2Fcip-project%2Fcip-testing%2Flinux-stable-rc-ci%2F-
&amp;data=04%7C01%7Cchris.paterson2%40renesas.com%7C4479c8657b2a4
0a46e3108d960428bd8%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%
7C637646661202906302%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAw
MDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sda
ta=7bk5d%2FyboUuOw0l12NBKvIDvsnVLmzwvyVSniEUOjI4%3D&amp;reserv
ed=0
/jobs/1492901660

Job #371616: Submitted
219Health: Unknown
220Device Type: r8a7743-iwg20d-q7
221Device: None
222Test: boot
223URL:
https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.c
iplatform.org%2Fscheduler%2Fjob%2F371616&amp;data=04%7C01%7Cchris.
paterson2%40renesas.com%7C4479c8657b2a40a46e3108d960428bd8%7C53d
82571da1947e49cb4625a166a4a2a%7C0%7C0%7C637646661202906302%7CUn
known%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6
Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=Mkr7BDJRwjM%2F1Oeg4Q
GEOpN%2Bj6%2B8C2%2BZ8mtbOppdhY0%3D&amp;reserved=0
224
226ERROR: Job failed: execution took longer than 2h0m0s seconds
It looks like the LAVA server has stopped processing jobs. Our queue has
become very large!
I'll have to see what died and no doubt reboot it and the labs.

Sorry for the pain.
Thank you, it seems to be better now, and it looks like ctj_zynqmp is
available, too (I have not yet seen successful test, but it at least
tries).

But I still see problems with x86_qemu... the "2h timeout".
QEMU's queue is full. And QEMU of each lab is not working and it seems
that it can not be processed correctly.
All of the QEMU machines have somehow got stuck in the "reserved" state.
I'm trying to fix it. Will update you asap.

Chris


Best regards,
Nobuhiro

Join cip-dev@lists.cip-project.org to automatically receive all group messages.