Package tests loop over every package artifact in /ci. This results in packages built only as dependencies of the selected package also being tested. As a result, a PR touching one package can fail because of a pre-existing test failure in an unrelated dependency package.
E.g. openwrt/packages#29784 tests fail on cgi-io, due to luci-app-openthread depending on luci-base, which in turn depends on cgi-io. I've submitted an override for the generic version check in cgi-io as a quick workaround: openwrt/packages#29786, but the real fix should happen in this repo. CI should not fail on failings tests in packages that are not touched in the PR itself.
Package tests loop over every package artifact in /ci. This results in packages built only as dependencies of the selected package also being tested. As a result, a PR touching one package can fail because of a pre-existing test failure in an unrelated dependency package.
E.g. openwrt/packages#29784 tests fail on cgi-io, due to luci-app-openthread depending on luci-base, which in turn depends on cgi-io. I've submitted an override for the generic version check in cgi-io as a quick workaround: openwrt/packages#29786, but the real fix should happen in this repo. CI should not fail on failings tests in packages that are not touched in the PR itself.