Skip to content
This repository has been archived by the owner on Jul 30, 2024. It is now read-only.

add squad-compare-compat #40

Merged
merged 1 commit into from
Apr 17, 2024
Merged

Conversation

roxell
Copy link
Collaborator

@roxell roxell commented Apr 17, 2024

This script shows the differences between compat and non compat between build_name '*-compat' and replace('-compat', '').

Example output:

non-compat | compat | build_version/device/build_name/testsuite/test
--------------------------------------------------------------------
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/log-parser-test/check-kernel-oops 
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/ltp-fs/fs_fill 
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/ltp-fs_bind/fs_bind05_sh 
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/ltp-fs_bind/fs_bind13_sh 
pass | skip : next-20240403/e850-96/gcc-13-lkftconfig/ltp-hugetlb/hugemmap02 
pass | skip : next-20240403/e850-96/gcc-13-lkftconfig/ltp-hugetlb/hugemmap13 
pass | skip : next-20240403/e850-96/gcc-13-lkftconfig/ltp-hugetlb/hugemmap14

This script shows the differences between compat and non compat between
build_name '*-compat' and replace('-compat', '').

Example output:
non-compat | compat | build_version/device/build_name/testsuite/test
--------------------------------------------------------------------
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/log-parser-test/check-kernel-oops
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/ltp-fs/fs_fill
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/ltp-fs_bind/fs_bind05_sh
fail | pass : next-20240403/e850-96/gcc-13-lkftconfig/ltp-fs_bind/fs_bind13_sh
pass | skip : next-20240403/e850-96/gcc-13-lkftconfig/ltp-hugetlb/hugemmap02
pass | skip : next-20240403/e850-96/gcc-13-lkftconfig/ltp-hugetlb/hugemmap13
pass | skip : next-20240403/e850-96/gcc-13-lkftconfig/ltp-hugetlb/hugemmap14

Signed-off-by: Anders Roxell <[email protected]>
@roxell roxell force-pushed the squad-compare-compat branch from 11c17a1 to 5642333 Compare April 17, 2024 15:10
@chaws
Copy link
Collaborator

chaws commented Apr 17, 2024

@roxell updated your comment to fix formatting

LGTM!

You can confirm the data is correct by looking at all tests for build version next-20240403
https://qa-reports.linaro.org/api/builds/180260/tests/?metadata__name=fs_bind05_sh&environment=17275&fields=name,status,test_run,id

        {
            "id": 5011092507,
            "name": "ltp-fs_bind/fs_bind05_sh",
            "status": "fail",
            "test_run": "https://qa-reports.linaro.org/api/testruns/23278384/" # "build_name": "clang-nightly-lkftconfig"
        },
        {
            "id": 5011004258,
            "name": "ltp-fs_bind/fs_bind05_sh",
            "status": "fail",
            "test_run": "https://qa-reports.linaro.org/api/testruns/23278346/" # "build_name": "clang-17-lkftconfig"
        },
        {
            "id": 5010802882,
            "name": "ltp-fs_bind/fs_bind05_sh",
     >>>>>> "status": "fail",
            "test_run": "https://qa-reports.linaro.org/api/testruns/23277926/" # "build_name": "gcc-13-lkftconfig"
        },
        {
            "id": 5010800677,
            "name": "ltp-fs_bind/fs_bind05_sh",
            "status": "pass",
            "test_run": "https://qa-reports.linaro.org/api/testruns/23277837/" # "build_name": "gcc-13-lkftconfig-debug-kmemleak"
        },
        {
            "id": 5010637261,
            "name": "ltp-fs_bind/fs_bind05_sh",
     >>>>>> "status": "pass",
            "test_run": "https://qa-reports.linaro.org/api/testruns/23276535/" # "build_name": "gcc-13-lkftconfig-compat"
        }

@roxell roxell merged commit b918021 into Linaro:master Apr 17, 2024
1 check passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants