precompile conda failure #104

Activity

1. stevengj commented on Apr 4, 2018

   

   stevengj

   on Apr 4, 2018

   Member

   More actions

   What does print(read(Pkg.dir("Conda", "deps", "deps.jl"), String)) output?
2. stevengj

   added a commit that references this issue on Apr 4, 2018

   More informative error message for invalid path

   ...

   b94203a
3. stevengj commented on Jun 13, 2018

   

   stevengj

   on Jun 13, 2018

   Member

   More actions

   Closing unless this issue re-appears.
4. stevengj

   closed this as completedon Jun 13, 2018
5. vinnief commented on Mar 4, 2020

   

   vinnief

   on Mar 4, 2020

   More actions

   I have a precompile Conda failure with Julia 1.3.1 on Win10 , installed for local user.
   Build Conda complains about makedir not having rights to C:/users/Julia
   and import conda complains about
   LoadError: ArgumentError: Path to conda environment is not valid: C:\Users\julia\AppData\Local\JuliaPro\packages\padding_some_junk_value\in_here\creating_a_pattern_to_be_replaced\conda\3
   obviously that path is wrong, but why is it not set? is this meant to be a manual setting I need to make? where?
   I made a comment on https://discourse.julialang.org, and hesitated about making a new issue but the issue title is still applicable, even if the version is not 0.6 any more.
6. kerim371 commented on Apr 28, 2021

   

   kerim371

   on Apr 28, 2021

   More actions

   I'm newbie in Julia and I have similar problem.
   When I type:
   Pkg.add("Conda")
   I get error:

   julia> import Conda
   [ Info: Precompiling Conda [8f4d0f93-b110-5947-807f-2305c1781a2d]
   ERROR: LoadError: ArgumentError: Path to conda environment is not valid:
   Stacktrace:
    [1] prefix(path::String)
      @ Conda C:\Users\tasik\.julia\packages\Conda\sNGum\src\Conda.jl:41
   

   @stevengj when I type print(read(Pkg.dir("Conda", "deps", "deps.jl"), String)) I get:

   julia> print(read(Pkg.dir("Conda", "deps", "deps.jl"), String))
   ┌ Warning: `Pkg.dir(pkgname, paths...)` is deprecated; instead, do `import Conda; joinpath(dirname(pathof(Conda)), "..", paths...)`.
   └ @ Pkg C:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.6\Pkg\src\Pkg.jl:578
   const ROOTENV = ""
   const MINICONDA_VERSION = "3"
   const USE_MINIFORGE = false
   

   I can't understand does Conda.jl install conda.exe or I have to preinstall it by myself?
7. kerim371 commented on Apr 28, 2021

   

   kerim371

   on Apr 28, 2021

   More actions

   I just found that I can build Conda.jl on preinstalled conda. But is it possible to build Conda.jl on preinstalled python without preinstalled conda?
8. timholy commented on Mar 11, 2022

   

   timholy

   on Mar 11, 2022

   Last edited by timholy

   More actions

   https://github.com/timholy/BasicBlockRewriter.jl/runs/5516227052?check_suite_focus=true

   Note the CI script sets the PYTHON environment variable

   👍React with 👍1Reacted by Frankie Robertson
9. BeastyBlacksmith commented on Jun 1, 2022

   

   BeastyBlacksmith

   on Jun 1, 2022

   More actions

   I'm getting the same on the Plots.jl documentation build. Is there some workaround?

   👍React with 👍1Reacted by Frankie Robertson
10. frankier commented on Nov 7, 2022

    

    frankier

    on Nov 7, 2022

    More actions

    Now I have the same problem

    https://github.com/frankier/ComputerAdaptiveTesting.jl/actions/runs/3408009528/jobs/5668188461

    Pasting the error because GitHub actions will delete it at some point

    ERROR: LoadError: ArgumentError: Path to conda environment is not valid: /home/runner/.julia/conda/3
    Stacktrace:
     [1] prefix(path::String)
       @ Conda ~/.julia/packages/Conda/x2UxR/src/Conda.jl:42
     [2] top-level scope
       @ ~/.julia/packages/Conda/x2UxR/src/Conda.jl:47
     [3] include
       @ ./Base.jl:41[9](https://github.com/frankier/ComputerAdaptiveTesting.jl/actions/runs/3408009528/jobs/5668188461#step:7:10) [inlined]
     [4] include_package_for_output(pkg::Base.PkgId, input::String, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt64}}, source::String)
       @ Base ./loading.jl:1554
     [5] top-level scope
       @ stdin:1
    in expression starting at /home/runner/.julia/packages/Conda/x2UxR/src/Conda.jl:1
    in expression starting at stdin:1
    ERROR: LoadError: Failed to precompile Conda [8f4d0f93-b1[10](https://github.com/frankier/ComputerAdaptiveTesting.jl/actions/runs/3408009528/jobs/5668188461#step:7:11)-5947-807f-2305c[17](https://github.com/frankier/ComputerAdaptiveTesting.jl/actions/runs/3408009528/jobs/5668188461#step:7:18)81a2d] to /home/runner/.julia/compiled/v1.8/Conda/jl_DcRrZY.
    

    There have also been successful runs

    https://github.com/frankier/ComputerAdaptiveTesting.jl/actions/runs/3403780584/jobs/5660539740

    Did either of you manage to fix it or otherwise workaround it?

    👍React with 👍1Reacted by Tomas Fiers
11. tfiers commented on Jan 30, 2023

    

    tfiers

    on Jan 30, 2023

    Last edited by tfiers

    More actions

    Same here: I cannot have PyPlot installed in CI

    ERROR: The following 1 direct dependency failed to precompile:
    
    PyPlot [d330b81b-6aea-500a-939a-2ce795aea3ee]
    
    Failed to precompile PyPlot [d330b81b-6aea-500a-939a-2ce795aea3ee] to "/home/runner/.julia/compiled/v1.10/PyPlot/jl_Dr7FmQ".
    ERROR: LoadError: ArgumentError: Path to conda environment is not valid: /home/runner/.julia/conda/3
    Stacktrace:
     [1] prefix(path::String)
       @ Conda ~/.julia/packages/Conda/x2UxR/src/Conda.jl:42
     [2] …
    

    (link)

    though presumably PyPlot's own CI does run succesfully
    https://github.com/JuliaPy/PyPlot.jl/actions/workflows/CI.yml
    (unfortunately github has deleted the last logs).
    Not sure what's different
12. frankier commented on Jan 30, 2023

    

    frankier

    on Jan 30, 2023

    More actions

    It looks like the best chance of solving this would be to add https://github.com/mxschmitt/action-tmate before the failing bit (or is it possible to run it "on-fail"?) Then we could go in and poke around in /home/runner and /home/runner/.julia to try and figure out what happened.

    I will note that I had a slightly "model-challenging" moment with regards to Github Actions when reading https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#file-systems . This says that $GITHUB_WORKSPACE is persisted between steps, but it says no such thing about $HOME. I really don't think so, but I wanted to check what others think, is it possible for a Github action to be pre-empted and end up with an empty home directory between steps?

    What's happening is that an empty directory is made here and looked for here. Between the build script and the pre-compile script, the directory has gone missing.

    This could be worked around in any one of the following ways:

    • Run _install_conda(ROOTENV) at the very beginning of Conda.jl (it is already run on
    • Remove the PREFIX, etc. constants and replace them with a method of prefix()
    • Remove the isdir check in prefix(...)
    • Specialise prefix(...) for ROOTDIR and run mkdir there

    I do not know what exactly is happening, but one possibility is that /home/runner/.julia/conda/3 is available both when build.jl runs and when Conda.jl runs, but at different locations. In that case, perhaps if there is a symlink in the directory path, realdir() could be used in build.jl. Another option would be to add a relative directory, and look in DEPOT_PATH to make an absolute directory when Conda.jl is run.

    Another possibility is that the problem occurs because the built Conda package, including deps.jl is getting cached, but the directory /home/runner/.julia/conda/ is not.

    @stevengj The problem seems to be persistent, and I believe there are some paths to either a proper fix, or at least a workaround, so perhaps this issue could be reopened?

    ❤️React with ❤️2Reacted by Tomas Fiers and Nero Blackstone​
13. NeroBlackstone commented on Jul 7, 2023

    

    NeroBlackstone

    on Jul 7, 2023

    More actions

    Same problem here, this problem should be solved seriously.
14. lxvm commented on Nov 1, 2024

    

    lxvm

    on Nov 1, 2024

    More actions

    I agree that there is an issue here regarding a directory that goes missing on Github Actions CI. In my case, I wanted to install a pip-only package when building package documentation to show-off and test Python interoperability, so I also encountered the following error similar to the original:

    ERROR: ArgumentError: Path to conda environment is not valid: /home/runner/.julia/conda/3/x86_64
    Stacktrace:
     [1] prefix
       @ ~/.julia/packages/Conda/zReqD/src/Conda.jl:52 [inlined]
     [2] conda_rc(env::String)
       @ Conda ~/.julia/packages/Conda/zReqD/src/Conda.jl:125
     [3] pip_interop
       @ ~/.julia/packages/Conda/zReqD/src/Conda.jl:622 [inlined]
     [4] pip_interop(enabled::Bool)
       @ Conda ~/.julia/packages/Conda/zReqD/src/Conda.jl:622
     [5] top-level scope
       @ none:1
    

    However, by forcing PyCall.jl to (re)build in my CI script I was able to get this to work

    julia --project=docs/ -e 'ENV["PYTHON"]=""; using Pkg; Pkg.develop(PackageSpec(path=pwd())); Pkg.instantiate(); Pkg.build("PyCall"); using Conda; print(read(joinpath(dirname(pathof(Conda)), "..", "deps", "deps.jl"),String)); Conda.pip_interop(true); Conda.pip("install", "pythtb")'
    

    I made it print some of the paths when working and I get

    const ROOTENV = "/home/runner/.julia/conda/3/x86_64"
    const MINICONDA_VERSION = "3"
    const USE_MINIFORGE = true
    const CONDA_EXE = "/home/runner/.julia/conda/3/x86_64/bin/conda"
    
15. penelopeysm commented on Oct 15, 2025

    

    penelopeysm

    on Oct 15, 2025

    More actions

    For anyone dropping by via Google: with the release of 1.12 I ran into precompile failures on CI and the same error message

    ERROR: LoadError: ArgumentError: Path to conda environment is not valid: /home/runner/.julia/conda/3/x86_64
    

    I solved it by deleting the GitHub Actions caches (https://github.com/{user}/{repo}/actions/caches).
16. bjarthur

    added a commit that references this issue on Oct 12, 2026

    CI: create Conda's root environment directory before testing

    ...

    ed45a08