Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Per-notebook environments #19

Open
grst opened this issue Dec 8, 2022 · 4 comments
Open

Per-notebook environments #19

grst opened this issue Dec 8, 2022 · 4 comments

Comments

@grst
Copy link
Collaborator

grst commented Dec 8, 2022

it should be possible to define dependencies per notebook (conda envs?)

@grst grst converted this from a draft issue Dec 8, 2022
@grst
Copy link
Collaborator Author

grst commented Dec 8, 2022

@Zethson @ivirshup one issue is that binder only supports one environment.yaml per repo (and they don't want to support multiple ones: jupyterhub/binderhub#555).

A workaround they suggest is to !pip install packages at the beginning of notebooks as it's commonly done in colab.

What do we do? Is there any chance we can get away with a single environment for all notebooks?

@Zethson
Copy link
Member

Zethson commented Dec 8, 2022

Not a big fan of having a list of pip installs in the beginning. I'd even argue that if our ecosystem is very compatible, a single environment should work out. It should work for all scverse core packages.

I wouldn't be surprised however if many of the scverse ecosystem packages would not fit into such a massive environment. Some of them pin some fundamental packages.

@grst
Copy link
Collaborator Author

grst commented Dec 8, 2022

If we were to ever use the galaxy jupyter, how would we define dependencies here?

I tried setting up a binder with a docker container that contains multiple conda envs, but it doesn't want to start for me:
https://github.com/grst/test-binder-conda-docker

@grst grst mentioned this issue Dec 8, 2022
@grst
Copy link
Collaborator Author

grst commented Dec 9, 2022

For now, going for a single environment.yaml, because we need something that works.

Eventually, we'll need to figure something out, but I still don't know what a solution that works with binder could look like (unless someone else makes the multi-env docker work)

@grst grst changed the title manage dependencies Per-notebook environments Dec 9, 2022
@ivirshup ivirshup moved this from In Progress to Pushed in 2022-12-08 hackathon ibk Jan 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

No branches or pull requests

2 participants