Clean up lightgbm install and fix build (#1488)

Bumping up the base image version to the latest. 

Good news, Colab installs lightgbm on both CPU and GPU, 
Bad news seems like the way they installed the package seems to give
issues.

I assume they install lightgbm in a similar manner to us, build the
wheel and install in a tmp folder.

UV PIP doesn't like this and errors at install requirement file step:
error: Distribution not found at:
file:///tmp/lightgbm/LightGBM/dist/lightgbm-4.5.0-py3-none-linux_x86_64.whl

Removing our pin on the package fixes the build.

I could also introduce a pin for lightgbm, but this could be
problematic, as we'll continuously have to update the pining.

Author: calderjo

Dockerfile.tmpl

@@ -1,20 +1,12 @@
 ARG BASE_IMAGE \
-    BASE_IMAGE_TAG \
-    LIGHTGBM_VERSION
+    BASE_IMAGE_TAG
 
-{{ if eq .Accelerator "gpu" }}
-FROM gcr.io/kaggle-images/python-lightgbm-whl:${BASE_IMAGE_TAG}-${LIGHTGBM_VERSION} AS lightgbm_whl
-{{ end }}
 FROM ${BASE_IMAGE}:${BASE_IMAGE_TAG}
 
-#b/415358342: UV reports missing requirements files https://github.com/googlecolab/colabtools/issues/5237
-ENV UV_CONSTRAINT= \ 
-    UV_BUILD_CONSTRAINT=
-
 ADD kaggle_requirements.txt /kaggle_requirements.txt
 
 # Freeze existing requirements from base image for critical packages:
-RUN pip freeze | grep -E 'tensorflow|keras|torch|jax|lightgbm' > /colab_requirements.txt
+RUN pip freeze | grep -E 'tensorflow|keras|torch|jax' > /colab_requirements.txt
 
 # Merge requirements files:
 RUN cat /colab_requirements.txt >> /requirements.txt
@@ -67,17 +59,6 @@ ARG PACKAGE_PATH=/usr/local/lib/python3.11/dist-packages
 # Install GPU-specific non-pip packages.
 {{ if eq .Accelerator "gpu" }}
 RUN uv pip install --system "pycuda"
-
-# b/381256047 Remove once installed in Colabs base image.
-# Install LightGBM
-COPY --from=lightgbm_whl /tmp/whl/*.whl /tmp/lightgbm/
-# Install OpenCL (required by LightGBM GPU version)
-RUN apt-get install -y ocl-icd-libopencl1 clinfo && \
-    mkdir -p /etc/OpenCL/vendors && \
-    echo "libnvidia-opencl.so.1" > /etc/OpenCL/vendors/nvidia.icd && \
-    uv pip install --system /tmp/lightgbm/*.whl && \
-    rm -rf /tmp/lightgbm && \
-    /tmp/clean-layer.sh
 {{ end }}
 
 

Jenkinsfile

@@ -21,29 +21,6 @@ pipeline {
   }
 
   stages {
-    stage('Pre-build Packages from Source') {
-      stages {
-        stage('lightgbm') {
-          options {
-            timeout(time: 10, unit: 'MINUTES')
-          }
-          steps {
-            sh '''#!/bin/bash
-              set -exo pipefail
-              source config.txt
-              cd packages/
-              ./build_package --base-image $BASE_IMAGE:$BASE_IMAGE_TAG \
-                --package lightgbm \
-                --version $LIGHTGBM_VERSION \
-                --build-arg CUDA_MAJOR_VERSION=$CUDA_MAJOR_VERSION \
-                --build-arg CUDA_MINOR_VERSION=$CUDA_MINOR_VERSION \
-                --push
-            '''
-          }
-        }
-      }
-    }
-
     stage('Build/Test/Diff') {
       parallel {
         stage('CPU') {

config.txt

@@ -1,5 +1,4 @@
 BASE_IMAGE=us-docker.pkg.dev/colab-images/public/runtime
-BASE_IMAGE_TAG=release-colab_20250404-060113_RC00
-LIGHTGBM_VERSION=4.6.0
+BASE_IMAGE_TAG=release-colab_20250603-060055_RC00
 CUDA_MAJOR_VERSION=12
 CUDA_MINOR_VERSION=5