# Failed pipeline after migration to latest version fro Renku

**URL:** <https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025>\
**Category:** General\
**Created:** [19 March 2024 16:15 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025 "2024-03-19T16:15:43Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![colinem](https://avatars.discourse-cdn.com/v4/letter/c/e9bcb4/32.png) [@colinem](https://renku.discourse.group/u/colinem)\
**Post date:** [19 March 2024 16:15 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/1 "2024-03-19T16:15:43Z")

</div>

Dear Renku-developpers,

In one of my Renku-project, the image cannot be built anymore since I updated the project:  
[renkulab.io](http://renkulab.io): migrate to latest version for renku 2.9.1  
(and same now when trying a new update: [renkulab.io](http://renkulab.io): migrate to latest version for renku 2.9.2)

Should I try to go back to a previous version of Renku?

My project is private (called joint-inv). Please let me know what other information you need to be able to help with this issue.  
Many thanks!  
Coline

---

<div class="post-metadata">

**Author:** ![ralf.grubenmann](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/ralf.grubenmann/32/78_2.png) [@ralf.grubenmann](https://renku.discourse.group/u/ralf.grubenmann)\
**Post date:** [19 March 2024 16:18 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/2 "2024-03-19T16:18:18Z")

</div>

What exception do you get in the pipeline? To my knowledge, there’s not really anything in 2.9.2 that would cause something like this, but the update might have updated your Dockerfile from the project template as well and that might be causing this.

---

<div class="post-metadata">

**Author:** ![colinem](https://avatars.discourse-cdn.com/v4/letter/c/e9bcb4/32.png) [@colinem](https://renku.discourse.group/u/colinem)\
**Post date:** [19 March 2024 16:23 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/3 "2024-03-19T16:23:36Z")

</div>

I find this information linked with the message “failed pipeline” (is it waht you were asking?):

```shell
#7 234.3 ERROR: Could not find a version that satisfies the requirement postgresql-wheel (from versions: none)
#7 234.3 ERROR: No matching distribution found for postgresql-wheel
#7 ERROR: executor failed running [/bin/bash -c -o pipefail mamba env update -q -f /tmp/environment.yml && /opt/conda/bin/pip install -r /tmp/requirements.txt --no-cache-dir && mamba clean -y --all && mamba env export -n "root" && rm -rf ${HOME}/.renku/venv]: exit code: 1
------
 > [stage-1 3/4] RUN mamba env update -q -f /tmp/environment.yml && /opt/conda/bin/pip install -r /tmp/requirements.txt --no-cache-dir && mamba clean -y --all && mamba env export -n "root" && rm -rf /home/jovyan/.renku/venv:
------
executor failed running [/bin/bash -c -o pipefail mamba env update -q -f /tmp/environment.yml && /opt/conda/bin/pip install -r /tmp/requirements.txt --no-cache-dir && mamba clean -y --all && mamba env export -n "root" && rm -rf ${HOME}/.renku/venv]: exit code: 1
Cleaning up project directory and file based variables
ERROR: Job failed: exit code 1

```

---

<div class="post-metadata">

**Author:** ![ralf.grubenmann](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/ralf.grubenmann/32/78_2.png) [@ralf.grubenmann](https://renku.discourse.group/u/ralf.grubenmann)\
**Post date:** [19 March 2024 16:33 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/4 "2024-03-19T16:33:47Z")

</div>

> [@colinem](#):
>
> postgresql-wheel

It sounds like it can’t install this python package. I don’t think this is installed by renku, so it sounds like something is off with your dependencies in either requirements.txt or environment.yaml.

---

<div class="post-metadata">

**Author:** ![rrrrrok](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/rrrrrok/32/117_2.png) [@rrrrrok](https://renku.discourse.group/u/rrrrrok)\
**Post date:** [19 March 2024 17:29 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/5 "2024-03-19T17:29:37Z")

</div>

`postgres-wheel` is [not available for `python>=3.10`](https://github.com/michelp/postgresql-wheel/blob/main/setup.py#L34). I suggest you switch your base docker image to one that uses python 3.9. To do that, you have to change the base image in _two_ places in the `Dockerfile`; you have two `FROM` lines that say probably something like

```auto
FROM renku/renkulab-py:3.10-0.21.0

```

Simply change `3.10` to `3.9` in both places and you should be good to go!

---

<div class="post-metadata">

**Author:** ![colinem](https://avatars.discourse-cdn.com/v4/letter/c/e9bcb4/32.png) [@colinem](https://renku.discourse.group/u/colinem)\
**Post date:** [20 March 2024 09:57 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/6 "2024-03-20T09:57:29Z")

</div>

Ok, thanks @ralf.grubenmann and @rrrrrok,  
I just removed the “postgresql-wheel” package, as I actually do not need it. And it solved the problem of the failed pipeline. The pipeline passed successfully now.  
But, I now get another issue when I open the project :

```auto
Build Recommended
JupyterLab build is suggested:
@plotly/dash-jupyterlab needs to be included in build
jupyterlab-dash needs to be included in build

```

And when I try to click on the “build” button, then I get the following error:

```auto
Build failed with 502.

        If you are experiencing the build failure after installing an extension (or trying to include previously installed extension after updating JupyterLab) please check the extension repository for new installation instructions as many extensions migrated to the prebuilt extensions system which no longer requires rebuilding JupyterLab (but uses a different installation procedure, typically involving a package manager such as 'pip' or 'conda').

        If you specifically intended to install a source extension, please run 'jupyter lab build' on the server for full output.

```

I then searched on the forum and found this [Dash app with jupyter-server-proxy - #17 by tolevski](https://renku.discourse.group/t/dash-app-with-jupyter-server-proxy/626/17) but in my case werkzeug is already downgraded to 2.2.1.  
Concerning the rest I read through on the post [Dash app with jupyter-server-proxy - #23 by rrrrrok](https://renku.discourse.group/t/dash-app-with-jupyter-server-proxy/626/23), I am not sure what I should try to solve it.  
A consequence is that I don’t see anymore the git user-friendly interface (I can only commit through the terminal).

---

<div class="post-metadata">

**Author:** ![rrrrrok](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/rrrrrok/32/117_2.png) [@rrrrrok](https://renku.discourse.group/u/rrrrrok)\
**Post date:** [20 March 2024 10:09 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/7 "2024-03-20T10:09:58Z")

</div>

Hi @colinem I’m glad you fixed (one of) the problems! 🙂

For the second one, have you added [this line](https://gitlab.renkulab.io/tasko.olevski/dash-example/blob/master/Dockerfile#L26) to your `Dockerfile`? For most JupyterLab extensions it’s not needed anymore, but apparently in this case it is.

---

<div class="post-metadata">

**Author:** ![colinem](https://avatars.discourse-cdn.com/v4/letter/c/e9bcb4/32.png) [@colinem](https://renku.discourse.group/u/colinem)\
**Post date:** [20 March 2024 10:24 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/8 "2024-03-20T10:24:04Z")

</div>

Thanks! No I have not this line included yet.

The end of my Docker file is:

```Dockerfile
# install the python dependencies
COPY requirements.txt environment.yml /tmp/
RUN mamba env update -q -f /tmp/environment.yml && \
    /opt/conda/bin/pip install -r /tmp/requirements.txt --no-cache-dir && \
    mamba clean -y --all && \
    mamba env export -n "root" && \
    rm -rf ${HOME}/.renku/venv 
 
COPY --from=builder ${HOME}/.renku/venv ${HOME}/.renku/venv

```

Should I try to remove the 2 last lines and add ` jupyter lab build` instead or should I try to add it in addition?

---

<div class="post-metadata">

**Author:** ![rrrrrok](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/rrrrrok/32/117_2.png) [@rrrrrok](https://renku.discourse.group/u/rrrrrok)\
**Post date:** [20 March 2024 10:33 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/9 "2024-03-20T10:33:04Z")

</div>

you can have it like this:

```Dockerfile
# install the python dependencies
COPY requirements.txt environment.yml /tmp/
RUN mamba env update -q -f /tmp/environment.yml && \
    /opt/conda/bin/pip install -r /tmp/requirements.txt --no-cache-dir && \
    mamba clean -y --all && \
    mamba env export -n "root" && \
    rm -rf ${HOME}/.renku/venv && \
    jupyter lab build

COPY --from=builder ${HOME}/.renku/venv ${HOME}/.renku/venv

```

(a side note): when copy/pasting code into a message here, use the three back-ticks to create a [fenced code block](https://docs.github.com/en/get-started/writing-on-github/working-with-advanced-formatting/creating-and-highlighting-code-blocks#fenced-code-blocks) to make it easier to read. 🙌

---

<div class="post-metadata">

**Author:** ![colinem](https://avatars.discourse-cdn.com/v4/letter/c/e9bcb4/32.png) [@colinem](https://renku.discourse.group/u/colinem)\
**Post date:** [20 March 2024 14:10 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/10 "2024-03-20T14:10:39Z")

</div>

I tried it, and now at the session opening, I get a window saying:

```auto
Error Registering Plugins

Plugin 'jupyterlab_dash' is already registered

```

jupyter-dash is one of the package in the requirements.txt file.  
Any further idea to solve it? (the git button is still missing from the jupsterlab interface)

---

<div class="post-metadata">

**Author:** ![rrrrrok](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/rrrrrok/32/117_2.png) [@rrrrrok](https://renku.discourse.group/u/rrrrrok)\
**Post date:** [20 March 2024 15:42 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/11 "2024-03-20T15:42:33Z")

</div>

Hmm… if you can point me to your project that would be a big help, I’m not really sure what to suggest otherwise. If it’s a private project and you can add me, my username is `rok.roskar`.

---

<div class="post-metadata">

**Author:** ![colinem](https://avatars.discourse-cdn.com/v4/letter/c/e9bcb4/32.png) [@colinem](https://renku.discourse.group/u/colinem)\
**Post date:** [12 November 2024 09:25 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/12 "2024-11-12T09:25:16Z")

</div>

Dear Renku team,

It seems I get a similar error (that rrrrrok helped me to solve in March), but again I don’t manage to solve it on my own.  
The pipeline always fail since a certain commit. Every new pipeline fail.

I could still start the project with a previous commit (before the migration to latest renku version) and still commit and push my changes. But the pipeline always fails and the Docker image cannot be built anymore.

I hope you can help again?  
(The project is private, I can add you again if needed)  
Thanks!

---

<div class="post-metadata">

**Author:** ![rrrrrok](https://yyz2.discourse-cdn.com/free1/user_avatar/renku.discourse.group/rrrrrok/32/117_2.png) [@rrrrrok](https://renku.discourse.group/u/rrrrrok)\
**Post date:** [13 November 2024 11:57 UTC](https://renku.discourse.group/t/failed-pipeline-after-migration-to-latest-version-fro-renku/1025/13 "2024-11-13T11:57:31Z")

</div>

hi @colinem - sorry you’re having trouble! Can you copy/paste the error here?
