Re: Failing -stable-rc tests


Michael Adler
 

Hi Pavel,

This is one of the common failures:

https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/jobs/1364210937
I suspect this is a network issue on the runner node:

- upload to AWS S3 failed
- upload to the Gitlab storage failed too

I'm wondering if this is just a temporary issue (which goes away after waiting for a couple of minutes) of if the
network is permanently down on our (ephermal) runner node.

I suggest adding some retry error handling logic to `/opt/submit_tests.sh`: if the upload to AWS S3 fails, perform some
network health checks, in particular ping/curl some other site like google.com, and try the upload again for a few minutes.

I have also upgraded our runners to v14 (although I don't think that will help in this case).

Kind Regards,
Michael

--
Michael Adler

Siemens AG
T RDA IOT SES-DE
Otto-Hahn-Ring 6
81739 München, Deutschland

Siemens Aktiengesellschaft: Vorsitzender des Aufsichtsrats: Jim Hagemann Snabe; Vorstand: Roland Busch, Vorsitzender; Klaus Helmrich, Cedrik Neike, Matthias Rebellius, Ralf P. Thomas, Judith Wiese; Sitz der Gesellschaft: Berlin und München, Deutschland; Registergericht: Berlin-Charlottenburg, HRB 12300, München, HRB 6684; WEEE-Reg.-Nr. DE 23691322

Join cip-dev@lists.cip-project.org to automatically receive all group messages.