Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dockerfile for Python Runtime Image & parameterize images in makefile via env #258

Merged
merged 3 commits into from
Jan 27, 2025

Conversation

HumairAK
Copy link
Contributor

@HumairAK HumairAK commented Jan 27, 2025

Description

This change does the following:

  • Add dockerfile to be used as the python_image for runtime. The image includes the kfp/kubeflow training dependencies
    • The image needs to have all the dependencies required to make the pipeline(s)
  • Include requirements.txt to leverage for system wide python package installs
  • Add requirements.txt check to ci and readme
  • Parameterize image files at makefile level

The following change will allow us to build the pipeline during a runtime init container step, that will allow us to consume updated images in an automated way in the future.

Image defaults in makefile are kept as SHA for now, once automation is enabled, we should set these to floating tags.

Instead of adding requirements.txt another option is to just leverage uv, this would require us to include this as an additional package dependency in the image, and I think do a uv pip install --system, I'm not that familiar with uv however.

Jira: https://issues.redhat.com/browse/RHOAIENG-18413

How Has This Been Tested?

Ran the pipeline with the built image set to PYTHON Image.

Merge criteria:

  • The commits are squashed in a cohesive manner and have meaningful messages.
  • Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
  • The developer has manually tested the changes and verified that the changes work

This change also includes an addition of a requirements.txt for
installing the packages during image build, this allows us to avoid
including uv as a dependency in the image.

Also included is a dockerignore file, ci, and readme changes to
accomodate the change.

Signed-off-by: Humair Khan <[email protected]>
@HumairAK HumairAK changed the title Dockerfile Add dockerfile for Python Runtime Image & parameterize images in makefile via env Jan 27, 2025
@HumairAK HumairAK merged commit 95b1745 into opendatahub-io:main Jan 27, 2025
1 check passed
@HumairAK
Copy link
Contributor Author

fyi @MichaelClifford / @leseb / @tumido / @Shreyanand / et al

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants