cip-dev@lists.cip-project.org | Tests run on CIP-LAVA platform

Home Messages Hashtags Subgroups

Date Date 1 - 5 of 5

Tests run on CIP-LAVA platform

P T, Sarath

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case	CIP LAVA job link	Status	Comments
i) spectre-meltdown-checker-test	https://lava.ciplatform.org/scheduler/job/686074	Not run	Reason of failure ./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench	https://lava.ciplatform.org/results/634343	PASS
iii) cyclictest	https://lava.ciplatform.org/results/634097	SKIP	Reason of failure $ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error
iv) cyclicdeadline	https://lava.ciplatform.org/results/633692	Not run	Reason of failure while executing cyclicdeadline.sh getting an error like /usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

P T, Sarath

#9767

Hi Team ,

I can see in Linaro/test-definitions (https://github.com/Linaro/test-definitions/tree/master/automated/linux) there are 123 test-suites are present but only 4 test-suites are running on cip lava ?

Few more queries I am having regarding this.
i) Is CIP running the full QA of Linaro/test-definitions test-suites in any other platform ?
ii) All of the tests which has been run in the LAVA CIP platform is 2mins duration. Is there a particular reason for choosing these much duration of tests ?

Regards
Sarath P T

Show quoted text

From: P T, Sarath
Sent: 17 October 2022 12:34
To: 'cip-dev@...' <cip-dev@...>
Subject: Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case	CIP LAVA job link	Status	Comments
i) spectre-meltdown-checker-test	https://lava.ciplatform.org/scheduler/job/686074	Not run	Reason of failure ./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench	https://lava.ciplatform.org/results/634343	PASS
iii) cyclictest	https://lava.ciplatform.org/results/634097	SKIP	Reason of failure $ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error
iv) cyclicdeadline	https://lava.ciplatform.org/results/633692	Not run	Reason of failure while executing cyclicdeadline.sh getting an error like /usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

Chris Paterson

#9771

Hello Sarath,

From: cip-dev@... <cip-dev@...> On
Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 14:01

Hi Team ,

I can see in Linaro/test-definitions (https://github.com/Linaro/test-
definitions/tree/master/automated/linux) there are
123 test-suites are present but only 4 test-suites are running on cip lava ?The tests we currently run in our GitLab CI setup are listed here:
https://wiki.linuxfoundation.org/civilinfrastructureplatform/ciptesting/centalisedtesting/cioverview#when_tests_are_run

Note that in KernelCI a lot more gets tested.
You can see the latest testing run on the v5.10.147-cip18 release here:
https://linux.kernelci.org/test/job/cip/branch/linux-5.10.y-cip/kernel/v5.10.147-cip18/

Few more queries I am having regarding this.
      i)   Is CIP  running the full QA of Linaro/test-definitions test-suites in any
other platform ?We have only added a small sub-set to our GitLab CI testing.
As shown in the links above, more are run through KernelCI.

      ii)  All of the tests which has been run in the LAVA CIP platform is 2mins
duration. Is there a particular reason for choosing these much duration of
tests ?The test length depends on the test.
Some tests for example take much longer. For example this ltp-syscalls test took 1h45m:
https://lava.ciplatform.org/scheduler/job/763898

Kind regards, Chris

Regards
Sarath P T

From: P T, Sarath
Sent: 17 October 2022 12:34
To: 'cip-dev@...' <cip-dev@...>
Subject: Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I
am showing the list below what all LAVA tests are running in the CIP LAVA
platform.

Test-case

CIP LAVA job link

Status

Comments

i)                 spectre-meltdown-checker-test

https://lava.ciplatform.org/scheduler/job/686074
<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.pate
rson2%40renesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571
da1947e49cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknow
n%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1ha
WwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=lHQbDUMj23SLAG2%2B
qPEY1CtjYQ68%2B59QcgSpsGIg6WI%3D&reserved=0>

Not run

Reason of failure

./spectre-meltdown-checker.sh: Permission denied.

ii)               hackbench

https://lava.ciplatform.org/results/634343
<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40r
enesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571da1947e49
cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknown%7CTWFp
bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC
I6Mn0%3D%7C3000%7C%7C%7C&sdata=uM4%2F3rQ3QezNTAegpfi%2BjhKB
%2Fy6VgjhHQ1i0yjbHXoY%3D&reserved=0>

PASS

iii)             cyclictest

https://lava.ciplatform.org/results/634097
<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40r
enesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571da1947e49
cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknown%7CTWFp
bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC
I6Mn0%3D%7C3000%7C%7C%7C&sdata=%2BsVty8GVrmvdAcL%2BXOXQv8s
N4FiAJgnPDqzEfIMXCIo%3D&reserved=0>

SKIP

Reason of failure

$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving
“/usr/bin/cyclictest: unrecognized option” error

iv)              cyclicdeadline

https://lava.ciplatform.org/results/633692
<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40r
enesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571da1947e49
cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknown%7CTWFp
bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC
I6Mn0%3D%7C3000%7C%7C%7C&sdata=hzllFtkK7G6mNHHfIO%2BsSb7pAGd
Nag5mEtAx0FnH1Ek%3D&reserved=0>

Not run

Reason of failure

while executing cyclicdeadline.sh getting an error like

/usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

Chris Paterson

#9772

Hello Sarath,

Some of those test jobs you linked to are very old.

Looking at more recent jobs the smc issue you reported is no longer there.

However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”.

The tests seem to get run, but the final step is a python script that parses the results.

We’ll have to get that fixed.

Kind regards, Chris

Show quoted text

From: cip-dev@... <cip-dev@...> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: cip-dev@...
Subject: [cip-dev] Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case	CIP LAVA job link	Status	Comments
i) spectre-meltdown-checker-test	https://lava.ciplatform.org/scheduler/job/686074	Not run	Reason of failure ./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench	https://lava.ciplatform.org/results/634343	PASS
iii) cyclictest	https://lava.ciplatform.org/results/634097	SKIP	Reason of failure $ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error
iv) cyclicdeadline	https://lava.ciplatform.org/results/633692	Not run	Reason of failure while executing cyclicdeadline.sh getting an error like /usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

P T, Sarath

#9773

Hi Chris,

I can see in Linaro/test-definitions (https://github.com/Linaro/test-definitions/tree/master/automated/linux) there are 123 test-suites are present but only 4 test-suites are running on cip lava ?

Few more queries I am having regarding this.
i) Is CIP running the full QA of Linaro/test-definitions test-suites in any other platform ?
ii) All of the tests which has been run in the LAVA CIP platform is 2mins duration. Is there a particular reason for choosing these much duration of tests ?

Regards
Sarath P T

Show quoted text

From: cip-dev@... [mailto:cip-dev@...] On Behalf Of Chris Paterson
Sent: 18 October 2022 17:38
To: cip-dev@...
Subject: Re: [cip-dev] Tests run on CIP-LAVA platform

Hello Sarath,

Some of those test jobs you linked to are very old.

Looking at more recent jobs the smc issue you reported is no longer there.

However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”.

The tests seem to get run, but the final step is a python script that parses the results.

We’ll have to get that fixed.

Kind regards, Chris

From: cip-dev@... <cip-dev@...> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: cip-dev@...
Subject: [cip-dev] Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case	CIP LAVA job link	Status	Comments
i) spectre-meltdown-checker-test	https://lava.ciplatform.org/scheduler/job/686074	Not run	Reason of failure ./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench	https://lava.ciplatform.org/results/634343	PASS
iii) cyclictest	https://lava.ciplatform.org/results/634097	SKIP	Reason of failure $ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error
iv) cyclicdeadline	https://lava.ciplatform.org/results/633692	Not run	Reason of failure while executing cyclicdeadline.sh getting an error like /usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

1 - 5 of 5

Previous Topic Next Topic

Home Hashtags Subgroups Terms