Skip to content

Conversation

@mvo5
Copy link
Contributor

@mvo5 mvo5 commented Oct 31, 2025

We could start by only enabling on weldr, it seems
the service very rarely deals with issue about
out-of-sync mirrors.


mocks: make BaseDepsolveResult() return a DepsolveResult

The BaseDepsolveResult was only returning the packages part of
the DepsolveResult. With librepo we need the repos as well so
that packages can be linked to repos. This commit returns the
full DepsolveResult with the Packages/Repos linked now.


weldr: enable librepo by default (and update tests)

This commit enables librepo by default in the weldr api. This
should help with on-prem out of sync mirror issues like:
#4427


cloudapi: enable librepo by default (and update tests)

This commit enables librepo by default in the cloudapi.

We have librepo in osbuild/images/ibcli/bib for a while now, c.f.
osbuild/image-builder-cli#51
osbuild/bootc-image-builder#786 (enable)
osbuild/bootc-image-builder#840 (make default)

It is not configurable right now, I am not sure there is a reason
to keep libcurl around for manifest generation as its more fragile
but if it is desired I can look into that too. Having it configurable
would allow us to revert to the previous org.osbuild.curl in case
anything is wrong with the new downloader (and arguably it was
only excercised by a relatively small number of people compared
to how much the service is building).

@mvo5 mvo5 requested a review from a team as a code owner October 31, 2025 10:05
@mvo5 mvo5 requested review from achilleas-k, croissanne and supakeen and removed request for a team October 31, 2025 10:05
@thozza
Copy link
Member

thozza commented Oct 31, 2025

This commit enables librepo by default in the cloudapi. This should help with on-prem out of sync mirror issues like: #4427

AFAIK, it won't, because CloudAPI is not used on-prem by default. Weldr API needs to use it to help with on-prem issues.

@mvo5 mvo5 marked this pull request as draft October 31, 2025 13:40
@mvo5 mvo5 force-pushed the librepo-by-default branch from c625126 to 4b23ad3 Compare October 31, 2025 16:17
@mvo5 mvo5 changed the title [RFC] cloudapi: enable librepo by default (and update tests) [RFC] cloudapi,weldr: enable librepo by default (and update tests) Oct 31, 2025
@mvo5 mvo5 marked this pull request as ready for review October 31, 2025 16:18
@mvo5
Copy link
Contributor Author

mvo5 commented Oct 31, 2025

This commit enables librepo by default in the cloudapi. This should help with on-prem out of sync mirror issues like: #4427

AFAIK, it won't, because CloudAPI is not used on-prem by default. Weldr API needs to use it to help with on-prem issues.

You are right of course, silly me! I added support for librepo into weldr too, I leave it as a single PR but we could split and/or start with weldr only etc.

@mvo5 mvo5 force-pushed the librepo-by-default branch from 4b23ad3 to 87ea3a6 Compare November 3, 2025 08:16
supakeen
supakeen previously approved these changes Nov 3, 2025
thozza
thozza previously approved these changes Nov 3, 2025
Copy link
Member

@thozza thozza left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks

@mvo5 mvo5 changed the title [RFC] cloudapi,weldr: enable librepo by default (and update tests) cloudapi,weldr: enable librepo by default (and update tests) Nov 4, 2025
@mvo5 mvo5 force-pushed the librepo-by-default branch from 87ea3a6 to bf5b3bd Compare November 4, 2025 12:18
@supakeen supakeen enabled auto-merge (rebase) November 4, 2025 13:05
@mvo5
Copy link
Contributor Author

mvo5 commented Nov 4, 2025

The tests are currently failing with a variant of

Nov 04 13:47:12 ip-10-31-19-241.us-east-1.aws.redhat.com osbuild-worker[6777]: osbuild.host.RemoteError: RuntimeError: Packages/crontabs-1.11^20190603git9e74f2d-6.el10.noarch.rpm: No more mirrors to try - All mirrors were already tried without success,Packages/passt-0^20250512.g8ec1341-2.el10.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success,Packages/passt-selinux-0^20250512.g8ec1341-2.el10.noarch.rpm: No more mirrors to try - All mirrors were already tried without success

so something is not quite right yet :/

@achilleas-k
Copy link
Member

Rebasing on 8f6ecc4.

@achilleas-k
Copy link
Member

The tests are currently failing with a variant of

Nov 04 13:47:12 ip-10-31-19-241.us-east-1.aws.redhat.com osbuild-worker[6777]: osbuild.host.RemoteError: RuntimeError: Packages/crontabs-1.11^20190603git9e74f2d-6.el10.noarch.rpm: No more mirrors to try - All mirrors were already tried without success,Packages/passt-0^20250512.g8ec1341-2.el10.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success,Packages/passt-selinux-0^20250512.g8ec1341-2.el10.noarch.rpm: No more mirrors to try - All mirrors were already tried without success

so something is not quite right yet :/

Funny. I'm getting the same on #4904. The manifest is generated with image-builder, so it uses librepo, and then the build fails with the same problem.

@mvo5
Copy link
Contributor Author

mvo5 commented Nov 21, 2025

The tests are currently failing with a variant of

Nov 04 13:47:12 ip-10-31-19-241.us-east-1.aws.redhat.com osbuild-worker[6777]: osbuild.host.RemoteError: RuntimeError: Packages/crontabs-1.11^20190603git9e74f2d-6.el10.noarch.rpm: No more mirrors to try - All mirrors were already tried without success,Packages/passt-0^20250512.g8ec1341-2.el10.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success,Packages/passt-selinux-0^20250512.g8ec1341-2.el10.noarch.rpm: No more mirrors to try - All mirrors were already tried without success

so something is not quite right yet :/

Funny. I'm getting the same on #4904. The manifest is generated with image-builder, so it uses librepo, and then the build fails with the same problem.

This will work once osbuild with osbuild/osbuild#2253 is released. this works now.

@mvo5 mvo5 dismissed stale reviews from thozza and supakeen via 9c992a4 November 21, 2025 12:08
@mvo5 mvo5 force-pushed the librepo-by-default branch 2 times, most recently from ddf74f5 to 16f66a3 Compare November 25, 2025 18:23
@mvo5 mvo5 force-pushed the librepo-by-default branch from 16f66a3 to 1055da2 Compare December 1, 2025 08:23
achilleas-k
achilleas-k previously approved these changes Dec 3, 2025
"dependencies": {
"osbuild": {
"commit": "a52e256c481c00e61f785f3ad68e29e1ac8a09fb"
"commit": "b1e74a309d5c2c088959c6e0322739fe20969912"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should also bump the mimimum osbuild version in the spec file, right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, excellent catch! Updated.

mvo5 added 2 commits December 3, 2025 13:27
This commit enables librepo by default in the cloudapi.

We have librepo in osbuild/images/ibcli/bib for a while now, c.f.
osbuild/image-builder-cli#51
osbuild/bootc-image-builder#786 (enable)
osbuild/bootc-image-builder#840 (make default)

It is not configurable right now, I am not sure there is a reason
to keep libcurl around for manifest generation as its more fragile
but if it is desired I can look into that too. Having it configurable
would allow us to revert to the previous org.osbuild.curl in case
anything is wrong with the new downloader (and arguably it was
only excercised by a relatively small number of people compared
to how much the service is building).
This commit enables librepo by default in the weldr api. This
should help with on-prem out of sync mirror issues like:
osbuild#4427
mvo5 added 3 commits December 3, 2025 13:27
The BaseDepsolveResult was only returning the packages part of
the DepsolveResult. With librepo we need the repos as well so
that packages can be linked to repos. This commit returns the
full DepsolveResult with the Packages/Repos linked now.
We need v166 of osbuild to ensure we have the "quoting"
fix in the librepo source [0].

[0] osbuild/osbuild#2253
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants